2024-09-21T05:51:27.883 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T05:51:27.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:51:27.998 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913521' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBOt3hscZ8rXDLj53kK0m+NRfhFfgqVGs5GNx0A3DadTMjK0f/6hJd5qEQePlwmpOGklryo//UQNgOMV3hkAnw= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyToTa0Umt54Y1hEkRxU0HcpIIMVULstmszk7yKOmdOm+WpY+3rg5egmzTr00q/riDgX/BhyrgEbigu7KJ8Jro= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4dCJBjV9Xi3cGvzlE1DDE0qqab2g76fP6Sv82swO6TehLkFUYdZ+SkgOW9Q3oeTOD+1A4Sr2kYFuIrKbcHYIg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - quiescer: null - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T05:51:27.998 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T05:51:27.998 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T05:51:27.999 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T05:51:28.000 INFO:teuthology.task.internal:Checking packages... 2024-09-21T05:51:28.020 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T05:51:28.020 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T05:51:28.020 INFO:teuthology.packaging:ref: None 2024-09-21T05:51:28.020 INFO:teuthology.packaging:tag: None 2024-09-21T05:51:28.020 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:51:28.020 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:51:28.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:51:28.168 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T05:51:28.169 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T05:51:28.174 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T05:51:28.174 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T05:51:28.180 INFO:teuthology.task.internal:Saving configuration 2024-09-21T05:51:28.199 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T05:51:28.205 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T05:51:28.229 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:46:28.154776', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBOt3hscZ8rXDLj53kK0m+NRfhFfgqVGs5GNx0A3DadTMjK0f/6hJd5qEQePlwmpOGklryo//UQNgOMV3hkAnw='} 2024-09-21T05:51:28.251 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:46:28.152067', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAyToTa0Umt54Y1hEkRxU0HcpIIMVULstmszk7yKOmdOm+WpY+3rg5egmzTr00q/riDgX/BhyrgEbigu7KJ8Jro='} 2024-09-21T05:51:28.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:46:28.153447', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4dCJBjV9Xi3cGvzlE1DDE0qqab2g76fP6Sv82swO6TehLkFUYdZ+SkgOW9Q3oeTOD+1A4Sr2kYFuIrKbcHYIg='} 2024-09-21T05:51:28.271 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T05:51:28.277 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T05:51:28.277 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T05:51:28.277 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T05:51:28.277 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T05:51:28.362 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f234c574160>, signals=[15]) 2024-09-21T05:51:28.362 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T05:51:28.367 INFO:teuthology.task.internal:Opening connections... 2024-09-21T05:51:28.367 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T05:51:28.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:51:28.441 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T05:51:28.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:51:28.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T05:51:28.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:51:28.588 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T05:51:28.594 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-21T05:51:28.612 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-21T05:51:28.612 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:51:28.670 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:51:28.671 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:51:28.671 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:51:28.671 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:51:28.671 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-21T05:51:28.905 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-21T05:51:28.924 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-21T05:51:28.924 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:51:28.982 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:51:28.983 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:51:28.983 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-21T05:51:29.009 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-21T05:51:29.028 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-21T05:51:29.028 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:51:29.086 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:51:29.087 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:51:29.087 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-21T05:51:29.118 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T05:51:29.127 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T05:51:29.132 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T05:51:29.132 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:51:29.134 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:51:29.136 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:51:29.153 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T05:51:29.160 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T05:51:29.160 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:51:29.191 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:51:29.194 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:51:29.222 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T05:51:29.312 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T05:51:29.325 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T05:51:29.325 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T05:51:29.325 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:51:29.326 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:51:29.326 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:51:29.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:51:29.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:51:29.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:51:29.345 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-21T05:51:29.345 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-21T05:51:29.345 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-21T05:51:29.402 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:51:29.402 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-21T05:51:29.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-21T05:51:29.404 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:51:29.404 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:51:29.404 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-21T05:51:29.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-21T05:51:29.404 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-21T05:51:29.404 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-21T05:51:32.027 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.3 MB 00:00 2024-09-21T05:51:32.803 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T05:51:34.338 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.3 MB 00:03 2024-09-21T05:51:34.587 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T05:51:35.137 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-21T05:51:36.056 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-21T05:51:39.762 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-21T05:51:40.865 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.5 MB 00:01 2024-09-21T05:51:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-21T05:51:41.471 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-21T05:51:42.359 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T05:51:42.482 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T05:51:42.813 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T05:51:43.378 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T05:51:43.817 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-21T05:51:48.473 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 2.0 kB/s | 1.7 kB 00:00 2024-09-21T05:51:49.276 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 2.8 kB/s | 1.7 kB 00:00 2024-09-21T05:51:49.356 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T05:51:50.413 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:51:50.413 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:51:50.507 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-21T05:51:50.515 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-21T05:51:50.516 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-21T05:51:50.517 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:51:50.517 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-21T05:51:50.517 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-21T05:51:50.517 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-21T05:51:50.633 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 384 kB/s | 36 kB 00:00 2024-09-21T05:51:51.016 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-21T05:51:51.174 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:51:51.174 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:51:51.273 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-21T05:51:51.284 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T05:51:51.284 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-21T05:51:51.284 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T05:51:51.284 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-21T05:51:51.284 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-21T05:51:51.285 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:51:51.286 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-21T05:51:51.286 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-21T05:51:51.286 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-21T05:51:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:51:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:51:51.392 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-21T05:51:51.411 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 464 kB/s | 36 kB 00:00 2024-09-21T05:51:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-21T05:51:51.482 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-21T05:51:51.482 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 79 M 2024-09-21T05:51:51.483 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 126 M 2024-09-21T05:51:51.484 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-21T05:51:51.701 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-21T05:51:51.701 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:51:51.701 INFO:teuthology.orchestra.run.smithi089.stdout:Total 67 MB/s | 79 MB 00:01 2024-09-21T05:51:51.903 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-21T05:51:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 194 kB/s | 36 kB 00:00 2024-09-21T05:51:52.384 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-21T05:51:52.403 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 29 MB/s | 29 MB 00:00 2024-09-21T05:51:52.732 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-21T05:51:52.732 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-21T05:51:52.870 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 22 MB/s | 35 MB 00:01 2024-09-21T05:51:52.871 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:51:52.871 INFO:teuthology.orchestra.run.smithi081.stdout:Total 50 MB/s | 79 MB 00:01 2024-09-21T05:51:53.555 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-21T05:51:53.712 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-21T05:51:53.712 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-21T05:51:53.905 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-21T05:51:53.905 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-21T05:51:54.868 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-21T05:51:54.868 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-21T05:51:55.108 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-09-21T05:51:56.131 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-21T05:51:56.760 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:51:56.843 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:51:57.175 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.5 MB/s | 29 MB 00:05 2024-09-21T05:51:57.308 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-21T05:51:57.691 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.9 MB/s | 35 MB 00:05 2024-09-21T05:51:57.691 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:51:57.692 INFO:teuthology.orchestra.run.smithi017.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-21T05:51:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:51:58.081 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:51:58.405 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-21T05:51:58.787 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-21T05:51:58.787 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-21T05:51:59.587 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:51:59.722 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:51:59.784 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-21T05:51:59.785 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-21T05:52:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:52:01.009 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:02.344 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-21T05:52:02.989 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:52:03.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:52:04.524 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:04.647 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:05.817 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:52:05.855 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:05.894 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:09.491 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:10.729 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:11.069 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:11.111 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:16.247 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:47.713 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:47.753 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:48.035 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:48.035 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:52:48.035 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:52:48.035 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:48.893 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:48.893 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:52:48.894 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-21T05:52:48.963 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:49.266 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:52:49.351 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:49.352 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:52:49.352 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:52:49.352 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:52:49.352 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:52:49.352 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T05:52:49.352 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:52:49.353 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:52:49.393 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:49.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:52:49.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:52:49.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:49.410 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:49.411 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:52:49.411 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-21T05:52:49.448 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:52:49.449 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:52:49.450 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:52:49.451 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:52:49.451 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:52:49.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:52:50.139 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-21T05:52:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:52:50.287 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-21T05:52:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:52:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:52:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:52:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:52:50.288 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-21T05:52:50.630 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:52:50.709 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:50.710 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:52:50.710 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:52:50.710 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:52:50.710 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:52:50.710 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T05:52:50.710 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:52:50.710 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:52:50.768 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:50.768 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:52:50.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:52:50.800 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:52:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:52:50.802 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:52:50.802 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:52:50.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:52:51.457 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:52:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-21T05:52:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-21T05:52:51.499 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-21T05:52:51.515 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.kyfiDfiirI 2024-09-21T05:52:51.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kyfiDfiirI 2024-09-21T05:52:51.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.kyfiDfiirI 2024-09-21T05:52:51.708 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.kyfiDfiirI is 6KB 2024-09-21T05:52:51.756 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.kyfiDfiirI 2024-09-21T05:52:51.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:52:51.841 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:52:51.841 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:52:51.841 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:52:51.841 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:52:51.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:52:51.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-21T05:52:52.864 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:52:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-21T05:52:52.907 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-21T05:52:52.922 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.GAMWJLgFK8 2024-09-21T05:52:52.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GAMWJLgFK8 2024-09-21T05:52:52.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.GAMWJLgFK8 2024-09-21T05:52:53.133 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.GAMWJLgFK8 is 6KB 2024-09-21T05:52:53.181 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.GAMWJLgFK8 2024-09-21T05:52:53.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:52:53.258 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:52:53.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:52:53.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-21T05:52:55.538 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:52:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:52:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:52:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:52:56.739 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-21T05:52:57.102 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:52:57.187 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:57.188 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:52:57.188 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:52:57.188 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:52:57.188 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:52:57.188 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T05:52:57.188 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:52:57.188 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:52:57.246 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:52:57.247 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:52:57.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-21T05:52:57.278 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-21T05:52:57.278 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-21T05:52:57.278 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-21T05:52:57.278 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-21T05:52:57.278 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-21T05:52:57.278 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:52:57.279 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:52:57.280 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:52:57.280 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-21T05:52:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:52:57.280 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:52:57.280 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:52:57.280 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:52:57.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:52:57.948 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-21T05:52:59.374 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:52:59.404 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-21T05:52:59.409 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-21T05:52:59.465 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.nteT4KhKUG 2024-09-21T05:52:59.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nteT4KhKUG 2024-09-21T05:52:59.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.nteT4KhKUG 2024-09-21T05:52:59.681 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.nteT4KhKUG is 6KB 2024-09-21T05:52:59.729 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.nteT4KhKUG 2024-09-21T05:52:59.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:52:59.805 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:52:59.805 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:52:59.805 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:52:59.805 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:52:59.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:52:59.962 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-21T05:53:22.000 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T05:53:22.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:53:22.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:53:23.417 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T05:53:23.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T05:53:23.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:53:29.972 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T05:53:29.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-21T05:53:29.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:53:40.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T05:53:41.871 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-21T05:53:48.527 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-21T05:53:49.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:53:49.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:53:50.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T05:53:50.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:53:52.399 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T05:53:53.935 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-21T05:53:57.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-21T05:53:57.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:54:04.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:54:04.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:54:05.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T05:54:05.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:54:22.835 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T05:54:37.761 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-21T05:54:37.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:54:37.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:54:38.161 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-21T05:54:38.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T05:54:38.353 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:54:38.353 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-21T05:54:38.368 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:54:38.368 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:54:38.368 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:54:38.368 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:54:38.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:54:38.577 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:54:38.577 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-21T05:54:38.591 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:54:38.591 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:54:38.591 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:54:38.591 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:54:39.369 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T05:54:39.370 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T05:54:39.444 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-21T05:54:39.480 DEBUG:teuthology.parallel:result is None 2024-09-21T05:54:39.593 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T05:54:39.593 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T05:54:39.679 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-21T05:54:39.707 DEBUG:teuthology.parallel:result is None 2024-09-21T05:54:57.534 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T05:55:09.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-21T05:55:09.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:55:09.838 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-21T05:55:10.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-21T05:55:10.180 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T05:55:10.180 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-21T05:55:10.196 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-508.el9.x86_64 2024-09-21T05:55:10.196 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T05:55:10.196 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T05:55:10.197 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T05:55:11.197 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T05:55:11.197 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T05:55:11.275 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-21T05:55:11.296 DEBUG:teuthology.parallel:result is None 2024-09-21T05:55:11.296 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T05:55:11.304 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T05:55:11.304 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:55:11.306 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:55:11.309 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T05:55:11.329 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T05:55:11.335 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T05:55:11.345 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T05:55:11.345 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:55:11.365 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:55:11.368 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T05:55:11.452 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T05:55:11.458 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T05:55:11.458 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:55:11.460 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:55:11.463 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T05:55:11.489 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:55:11.493 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:55:11.495 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:55:11.501 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:55:11.505 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:55:11.506 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T05:55:11.508 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T05:55:11.515 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T05:55:11.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:55:11.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:55:11.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T05:55:11.579 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T05:55:11.588 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T05:55:11.588 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:55:11.614 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:55:11.620 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T05:55:11.636 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:55:11.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:55:11.769 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:55:11.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:55:11.895 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T05:55:11.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:55:11.962 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:55:12.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:55:12.057 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:55:12.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:55:12.185 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T05:55:12.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:55:12.253 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:55:12.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T05:55:12.358 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:55:12.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T05:55:12.444 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T05:55:12.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T05:55:12.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-21T05:55:12.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-21T05:55:12.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-21T05:55:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:55:12.567 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:55:12.606 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T05:55:13.048 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T05:55:13.057 INFO:teuthology.task.internal:Starting timer... 2024-09-21T05:55:13.057 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T05:55:13.067 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T05:55:13.076 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T05:55:13.076 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-21T05:55:13.143 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-21T05:55:13.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-21T05:55:13.205 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-21T05:55:13.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-21T05:55:13.254 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-21T05:55:13.257 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T05:55:13.257 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-21T05:55:13.285 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-21T05:55:13.285 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-21T05:55:13.309 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-21T05:55:13.310 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-21T05:55:13.351 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-21T05:55:13.351 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2024-09-21T05:55:13.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:55:13.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:55:13.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:55:13.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:55:13.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T05:55:13.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:55:13.436 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T05:55:13.436 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:55:13.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:55:13.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-21T05:55:13.540 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T05:55:13.550 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T05:55:13.552 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T05:55:13.652 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T05:55:13.662 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T05:55:13.662 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi081.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T05:58:59.664 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2024-09-21T05:58:59.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-21T05:58:59.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:58:59.741 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-21T05:58:59.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-21T05:58:59.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T05:58:59.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:58:59.919 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-21T05:59:00.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T05:59:00.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:59:00.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:59:00.083 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-21T05:59:00.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T05:59:00.169 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T05:59:00.179 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T05:59:00.180 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:59:00.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:59:00.183 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:59:00.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:59:00.185 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T05:59:00.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:59:00.216 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:59:00.217 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:59:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:59:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:59:00.241 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T05:59:00.257 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T05:59:00.259 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-21T05:59:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-21T05:59:00.271 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-21T05:59:00.274 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-21T05:59:00.283 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-21T05:59:00.286 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:59:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:59:00.294 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-21T05:59:00.301 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:59:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:59:00.308 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T05:59:00.323 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T05:59:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:59:00.369 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:59:00.369 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:59:00.370 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-21T05:59:00.370 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.370 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.370 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.370 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.374 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:59:00.374 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-21T05:59:00.374 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.374 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.374 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.374 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.379 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-21T05:59:00.382 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T05:59:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-21T05:59:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.383 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T05:59:00.383 INFO:teuthology.run_tasks:Running task install... 2024-09-21T05:59:00.391 DEBUG:teuthology.task.install:project ceph 2024-09-21T05:59:00.391 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T05:59:00.391 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T05:59:00.391 INFO:teuthology.task.install:Using flavor: default 2024-09-21T05:59:00.396 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T05:59:00.396 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T05:59:00.397 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:59:00.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:59:00.399 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:59:00.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:59:00.400 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T05:59:00.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:59:00.542 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:59:00.542 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:59:00.557 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:59:00.557 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:59:00.560 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T05:59:00.560 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T05:59:00.651 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:59:00.651 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T05:59:00.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:59:00.666 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:59:00.666 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T05:59:00.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:59:00.672 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T05:59:00.672 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T05:59:00.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T05:59:00.679 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:59:00.679 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:59:00.691 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:59:00.691 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:59:00.698 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T05:59:00.698 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T05:59:00.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:59:00.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:59:00.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T05:59:00.823 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:59:00.831 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:59:00.838 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T05:59:00.888 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-21T05:59:00.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-21T05:59:00.895 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-21T05:59:00.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-21T05:59:00.902 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-21T05:59:00.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-21T05:59:01.127 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-21T05:59:01.128 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-21T05:59:01.133 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-21T05:59:01.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:59:01.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:59:01.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T05:59:01.714 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-21T05:59:01.720 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-21T05:59:01.726 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T05:59:01.998 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T05:59:02.010 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 102 kB/s | 24 kB 00:00 2024-09-21T05:59:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T05:59:02.265 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T05:59:02.277 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T05:59:02.296 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T05:59:02.757 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-21T05:59:03.902 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.3 MB 00:01 2024-09-21T05:59:04.021 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-21T05:59:04.775 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T05:59:05.720 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T05:59:09.085 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T05:59:10.280 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T05:59:10.502 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 120 kB/s | 19 kB 00:00 2024-09-21T05:59:11.298 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T05:59:11.981 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-21T05:59:12.752 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T05:59:16.646 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T05:59:18.441 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T05:59:18.841 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:59:18.842 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:59:18.855 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:59:18.855 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:59:18.856 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:59:18.857 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:59:18.859 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:59:18.862 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:59:18.863 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:59:18.925 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:59:18.935 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:59:18.936 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:59:18.937 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:59:18.938 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:59:18.940 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:59:18.941 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:59:18.942 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:59:18.943 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:59:18.944 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:59:18.945 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:59:18.946 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-21T05:59:18.947 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T05:59:18.947 INFO:teuthology.orchestra.run.smithi081.stdout:Install 149 Packages 2024-09-21T05:59:18.947 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-21T05:59:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:59:18.947 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 228 M 2024-09-21T05:59:18.947 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-21T05:59:19.414 INFO:teuthology.orchestra.run.smithi081.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-21T05:59:19.614 INFO:teuthology.orchestra.run.smithi081.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.3 MB/s | 873 kB 00:00 2024-09-21T05:59:19.672 INFO:teuthology.orchestra.run.smithi081.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T05:59:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T05:59:19.881 INFO:teuthology.orchestra.run.smithi081.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T05:59:19.957 INFO:teuthology.orchestra.run.smithi081.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T05:59:20.274 INFO:teuthology.orchestra.run.smithi081.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-21T05:59:20.557 INFO:teuthology.orchestra.run.smithi081.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T05:59:20.637 INFO:teuthology.orchestra.run.smithi081.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 318 kB/s | 25 kB 00:00 2024-09-21T05:59:20.711 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:59:20.712 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:59:20.724 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:59:20.725 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:59:20.726 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:59:20.726 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:59:20.728 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:59:20.731 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:59:20.732 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:59:20.799 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================= 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================= 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:59:20.829 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:59:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:59:20.831 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:59:20.832 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:59:20.833 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:59:20.834 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:59:20.835 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:59:20.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:59:20.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:59:20.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:59:20.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:59:20.840 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================= 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout:Install 149 Packages 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 8 Packages 2024-09-21T05:59:20.841 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:59:20.842 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 228 M 2024-09-21T05:59:20.842 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-21T05:59:21.016 INFO:teuthology.orchestra.run.smithi081.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T05:59:21.133 INFO:teuthology.orchestra.run.smithi081.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T05:59:21.159 INFO:teuthology.orchestra.run.smithi081.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T05:59:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 538 kB/s | 27 kB 00:00 2024-09-21T05:59:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 634 kB/s | 32 kB 00:00 2024-09-21T05:59:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T05:59:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.4 MB/s | 766 kB 00:00 2024-09-21T05:59:21.318 INFO:teuthology.orchestra.run.smithi081.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T05:59:21.360 INFO:teuthology.orchestra.run.smithi081.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T05:59:21.402 INFO:teuthology.orchestra.run.smithi081.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.1 MB/s | 45 kB 00:00 2024-09-21T05:59:21.486 INFO:teuthology.orchestra.run.smithi081.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T05:59:21.570 INFO:teuthology.orchestra.run.smithi081.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T05:59:21.653 INFO:teuthology.orchestra.run.smithi081.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.8 MB/s | 321 kB 00:00 2024-09-21T05:59:21.762 INFO:teuthology.orchestra.run.smithi081.stdout:(23/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T05:59:21.787 INFO:teuthology.orchestra.run.smithi081.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 2.2 MB/s | 307 kB 00:00 2024-09-21T05:59:21.813 INFO:teuthology.orchestra.run.smithi081.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T05:59:21.826 INFO:teuthology.orchestra.run.smithi017.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-09-21T05:59:21.838 INFO:teuthology.orchestra.run.smithi081.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:59:21.955 INFO:teuthology.orchestra.run.smithi081.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.4 MB/s | 170 kB 00:00 2024-09-21T05:59:22.072 INFO:teuthology.orchestra.run.smithi081.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T05:59:22.097 INFO:teuthology.orchestra.run.smithi081.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 241 kB/s | 34 kB 00:00 2024-09-21T05:59:22.123 INFO:teuthology.orchestra.run.smithi081.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:59:22.209 INFO:teuthology.orchestra.run.smithi017.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.2 MB/s | 873 kB 00:00 2024-09-21T05:59:22.276 INFO:teuthology.orchestra.run.smithi017.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T05:59:22.481 INFO:teuthology.orchestra.run.smithi081.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 22 MB/s | 40 MB 00:01 2024-09-21T05:59:22.531 INFO:teuthology.orchestra.run.smithi081.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.8 MB/s | 292 kB 00:00 2024-09-21T05:59:22.552 INFO:teuthology.orchestra.run.smithi017.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 6.2 MB/s | 5.5 MB 00:00 2024-09-21T05:59:22.598 INFO:teuthology.orchestra.run.smithi081.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 742 kB/s | 49 kB 00:00 2024-09-21T05:59:22.674 INFO:teuthology.orchestra.run.smithi081.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 220 kB/s | 16 kB 00:00 2024-09-21T05:59:22.765 INFO:teuthology.orchestra.run.smithi081.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T05:59:22.769 INFO:teuthology.orchestra.run.smithi017.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.6 MB/s | 2.3 MB 00:00 2024-09-21T05:59:22.791 INFO:teuthology.orchestra.run.smithi081.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.4 MB/s | 285 kB 00:00 2024-09-21T05:59:22.811 INFO:teuthology.orchestra.run.smithi017.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-09-21T05:59:22.841 INFO:teuthology.orchestra.run.smithi081.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 10 MB/s | 784 kB 00:00 2024-09-21T05:59:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 244 kB/s | 18 kB 00:00 2024-09-21T05:59:23.017 INFO:teuthology.orchestra.run.smithi081.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T05:59:23.117 INFO:teuthology.orchestra.run.smithi081.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 290 kB/s | 80 kB 00:00 2024-09-21T05:59:23.151 INFO:teuthology.orchestra.run.smithi081.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T05:59:23.201 INFO:teuthology.orchestra.run.smithi081.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-21T05:59:23.226 INFO:teuthology.orchestra.run.smithi081.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T05:59:23.251 INFO:teuthology.orchestra.run.smithi081.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T05:59:23.277 INFO:teuthology.orchestra.run.smithi081.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T05:59:23.294 INFO:teuthology.orchestra.run.smithi017.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.5 MB/s | 5.0 MB 00:00 2024-09-21T05:59:23.302 INFO:teuthology.orchestra.run.smithi081.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T05:59:23.327 INFO:teuthology.orchestra.run.smithi081.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T05:59:23.361 INFO:teuthology.orchestra.run.smithi081.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-21T05:59:23.461 INFO:teuthology.orchestra.run.smithi081.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-21T05:59:23.486 INFO:teuthology.orchestra.run.smithi081.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-21T05:59:23.512 INFO:teuthology.orchestra.run.smithi081.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T05:59:23.545 INFO:teuthology.orchestra.run.smithi081.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T05:59:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T05:59:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-21T05:59:23.613 INFO:teuthology.orchestra.run.smithi081.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-09-21T05:59:23.630 INFO:teuthology.orchestra.run.smithi081.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-09-21T05:59:23.655 INFO:teuthology.orchestra.run.smithi081.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-21T05:59:23.697 INFO:teuthology.orchestra.run.smithi081.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T05:59:23.714 INFO:teuthology.orchestra.run.smithi081.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-21T05:59:23.720 INFO:teuthology.orchestra.run.smithi017.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 9.7 MB/s | 20 MB 00:02 2024-09-21T05:59:23.781 INFO:teuthology.orchestra.run.smithi081.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-21T05:59:23.814 INFO:teuthology.orchestra.run.smithi081.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T05:59:23.840 INFO:teuthology.orchestra.run.smithi081.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T05:59:23.865 INFO:teuthology.orchestra.run.smithi081.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T05:59:23.899 INFO:teuthology.orchestra.run.smithi081.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-21T05:59:23.903 INFO:teuthology.orchestra.run.smithi017.stdout:(9/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 16 MB/s | 18 MB 00:01 2024-09-21T05:59:23.920 INFO:teuthology.orchestra.run.smithi017.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 126 kB/s | 25 kB 00:00 2024-09-21T05:59:23.924 INFO:teuthology.orchestra.run.smithi081.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T05:59:23.949 INFO:teuthology.orchestra.run.smithi081.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T05:59:23.970 INFO:teuthology.orchestra.run.smithi017.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T05:59:23.974 INFO:teuthology.orchestra.run.smithi081.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-21T05:59:24.037 INFO:teuthology.orchestra.run.smithi017.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 407 kB/s | 27 kB 00:00 2024-09-21T05:59:24.104 INFO:teuthology.orchestra.run.smithi017.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 476 kB/s | 32 kB 00:00 2024-09-21T05:59:24.125 INFO:teuthology.orchestra.run.smithi081.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-21T05:59:24.167 INFO:teuthology.orchestra.run.smithi081.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-21T05:59:24.201 INFO:teuthology.orchestra.run.smithi081.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T05:59:24.226 INFO:teuthology.orchestra.run.smithi081.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T05:59:24.230 INFO:teuthology.orchestra.run.smithi017.stdout:(14/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T05:59:24.263 INFO:teuthology.orchestra.run.smithi017.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 4.7 MB/s | 766 kB 00:00 2024-09-21T05:59:24.284 INFO:teuthology.orchestra.run.smithi081.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T05:59:24.288 INFO:teuthology.orchestra.run.smithi017.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T05:59:24.314 INFO:teuthology.orchestra.run.smithi017.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T05:59:24.318 INFO:teuthology.orchestra.run.smithi081.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-21T05:59:24.343 INFO:teuthology.orchestra.run.smithi081.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T05:59:24.356 INFO:teuthology.orchestra.run.smithi017.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T05:59:24.385 INFO:teuthology.orchestra.run.smithi081.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T05:59:24.414 INFO:teuthology.orchestra.run.smithi017.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 777 kB/s | 45 kB 00:00 2024-09-21T05:59:24.460 INFO:teuthology.orchestra.run.smithi081.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-21T05:59:24.489 INFO:teuthology.orchestra.run.smithi017.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T05:59:24.494 INFO:teuthology.orchestra.run.smithi081.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T05:59:24.519 INFO:teuthology.orchestra.run.smithi081.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-21T05:59:24.545 INFO:teuthology.orchestra.run.smithi081.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-21T05:59:24.570 INFO:teuthology.orchestra.run.smithi081.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T05:59:24.595 INFO:teuthology.orchestra.run.smithi081.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T05:59:24.598 INFO:teuthology.orchestra.run.smithi017.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T05:59:24.620 INFO:teuthology.orchestra.run.smithi081.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-21T05:59:24.632 INFO:teuthology.orchestra.run.smithi017.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.1 MB/s | 161 kB 00:00 2024-09-21T05:59:24.657 INFO:teuthology.orchestra.run.smithi017.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T05:59:24.683 INFO:teuthology.orchestra.run.smithi017.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T05:59:24.708 INFO:teuthology.orchestra.run.smithi017.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T05:59:24.713 INFO:teuthology.orchestra.run.smithi081.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T05:59:24.733 INFO:teuthology.orchestra.run.smithi017.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:59:24.738 INFO:teuthology.orchestra.run.smithi081.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T05:59:24.763 INFO:teuthology.orchestra.run.smithi081.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T05:59:24.789 INFO:teuthology.orchestra.run.smithi081.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T05:59:24.792 INFO:teuthology.orchestra.run.smithi017.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T05:59:24.811 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:19 2024-09-21T05:59:24.814 INFO:teuthology.orchestra.run.smithi081.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-21T05:59:24.839 INFO:teuthology.orchestra.run.smithi081.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T05:59:24.850 INFO:teuthology.orchestra.run.smithi017.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 22 MB/s | 3.1 MB 00:00 2024-09-21T05:59:24.873 INFO:teuthology.orchestra.run.smithi081.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T05:59:24.876 INFO:teuthology.orchestra.run.smithi017.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 410 kB/s | 34 kB 00:00 2024-09-21T05:59:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T05:59:24.901 INFO:teuthology.orchestra.run.smithi017.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:59:24.915 INFO:teuthology.orchestra.run.smithi081.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T05:59:24.932 INFO:teuthology.orchestra.run.smithi081.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-21T05:59:25.007 INFO:teuthology.orchestra.run.smithi081.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T05:59:25.033 INFO:teuthology.orchestra.run.smithi081.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 413 kB/s | 42 kB 00:00 2024-09-21T05:59:25.058 INFO:teuthology.orchestra.run.smithi081.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-09-21T05:59:25.083 INFO:teuthology.orchestra.run.smithi081.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:59:25.108 INFO:teuthology.orchestra.run.smithi081.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T05:59:25.134 INFO:teuthology.orchestra.run.smithi081.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T05:59:25.159 INFO:teuthology.orchestra.run.smithi081.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T05:59:25.184 INFO:teuthology.orchestra.run.smithi081.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T05:59:25.209 INFO:teuthology.orchestra.run.smithi081.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T05:59:25.235 INFO:teuthology.orchestra.run.smithi081.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:59:25.260 INFO:teuthology.orchestra.run.smithi081.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-21T05:59:25.351 INFO:teuthology.orchestra.run.smithi017.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-21T05:59:25.402 INFO:teuthology.orchestra.run.smithi017.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T05:59:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T05:59:25.569 INFO:teuthology.orchestra.run.smithi081.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2024-09-21T05:59:25.619 INFO:teuthology.orchestra.run.smithi081.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-21T05:59:25.645 INFO:teuthology.orchestra.run.smithi081.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-21T05:59:25.670 INFO:teuthology.orchestra.run.smithi081.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-21T05:59:25.695 INFO:teuthology.orchestra.run.smithi081.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T05:59:25.720 INFO:teuthology.orchestra.run.smithi081.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:59:25.745 INFO:teuthology.orchestra.run.smithi081.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:59:25.761 INFO:teuthology.orchestra.run.smithi017.stdout:(33/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T05:59:25.779 INFO:teuthology.orchestra.run.smithi081.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T05:59:25.786 INFO:teuthology.orchestra.run.smithi017.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 128 kB/s | 49 kB 00:00 2024-09-21T05:59:25.811 INFO:teuthology.orchestra.run.smithi017.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T05:59:25.830 INFO:teuthology.orchestra.run.smithi081.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T05:59:25.836 INFO:teuthology.orchestra.run.smithi017.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T05:59:25.887 INFO:teuthology.orchestra.run.smithi017.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 10 MB/s | 784 kB 00:00 2024-09-21T05:59:25.904 INFO:teuthology.orchestra.run.smithi017.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T05:59:25.913 INFO:teuthology.orchestra.run.smithi081.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-21T05:59:25.930 INFO:teuthology.orchestra.run.smithi081.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T05:59:25.956 INFO:teuthology.orchestra.run.smithi081.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-21T05:59:25.972 INFO:teuthology.orchestra.run.smithi081.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 772 kB/s | 32 kB 00:00 2024-09-21T05:59:25.998 INFO:teuthology.orchestra.run.smithi081.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-21T05:59:26.031 INFO:teuthology.orchestra.run.smithi081.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T05:59:26.056 INFO:teuthology.orchestra.run.smithi081.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T05:59:26.070 INFO:teuthology.orchestra.run.smithi017.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T05:59:26.082 INFO:teuthology.orchestra.run.smithi081.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T05:59:26.107 INFO:teuthology.orchestra.run.smithi081.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T05:59:26.121 INFO:teuthology.orchestra.run.smithi017.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 341 kB/s | 80 kB 00:00 2024-09-21T05:59:26.141 INFO:teuthology.orchestra.run.smithi081.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T05:59:26.174 INFO:teuthology.orchestra.run.smithi081.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 318 kB/s | 11 kB 00:00 2024-09-21T05:59:26.200 INFO:teuthology.orchestra.run.smithi081.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-21T05:59:26.204 INFO:teuthology.orchestra.run.smithi017.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T05:59:26.225 INFO:teuthology.orchestra.run.smithi081.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-21T05:59:26.230 INFO:teuthology.orchestra.run.smithi017.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T05:59:26.267 INFO:teuthology.orchestra.run.smithi081.stdout:(127/157): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-21T05:59:26.271 INFO:teuthology.orchestra.run.smithi017.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-21T05:59:26.292 INFO:teuthology.orchestra.run.smithi081.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-09-21T05:59:26.297 INFO:teuthology.orchestra.run.smithi017.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T05:59:26.318 INFO:teuthology.orchestra.run.smithi081.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-21T05:59:26.331 INFO:teuthology.orchestra.run.smithi017.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T05:59:26.343 INFO:teuthology.orchestra.run.smithi081.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:59:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T05:59:26.368 INFO:teuthology.orchestra.run.smithi081.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:59:26.402 INFO:teuthology.orchestra.run.smithi081.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-21T05:59:26.415 INFO:teuthology.orchestra.run.smithi017.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T05:59:26.427 INFO:teuthology.orchestra.run.smithi081.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 981 kB/s | 58 kB 00:00 2024-09-21T05:59:26.448 INFO:teuthology.orchestra.run.smithi017.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-21T05:59:26.452 INFO:teuthology.orchestra.run.smithi081.stdout:(134/157): protobuf-compiler-3.14.0-13.el9.x86_ 724 kB/s | 863 kB 00:01 2024-09-21T05:59:26.478 INFO:teuthology.orchestra.run.smithi081.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-21T05:59:26.503 INFO:teuthology.orchestra.run.smithi081.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.2 MB/s | 28 kB 00:00 2024-09-21T05:59:26.528 INFO:teuthology.orchestra.run.smithi081.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T05:59:26.554 INFO:teuthology.orchestra.run.smithi081.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T05:59:26.557 INFO:teuthology.orchestra.run.smithi017.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-21T05:59:26.579 INFO:teuthology.orchestra.run.smithi081.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-21T05:59:26.591 INFO:teuthology.orchestra.run.smithi017.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 753 kB/s | 107 kB 00:00 2024-09-21T05:59:26.604 INFO:teuthology.orchestra.run.smithi081.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T05:59:26.616 INFO:teuthology.orchestra.run.smithi017.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-21T05:59:26.629 INFO:teuthology.orchestra.run.smithi081.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-21T05:59:26.649 INFO:teuthology.orchestra.run.smithi017.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-21T05:59:26.654 INFO:teuthology.orchestra.run.smithi081.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T05:59:26.680 INFO:teuthology.orchestra.run.smithi081.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-21T05:59:26.705 INFO:teuthology.orchestra.run.smithi081.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T05:59:26.730 INFO:teuthology.orchestra.run.smithi081.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-21T05:59:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T05:59:26.781 INFO:teuthology.orchestra.run.smithi081.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:59:26.791 INFO:teuthology.orchestra.run.smithi017.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 187 kB/s | 33 kB 00:00 2024-09-21T05:59:26.816 INFO:teuthology.orchestra.run.smithi017.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-09-21T05:59:26.831 INFO:teuthology.orchestra.run.smithi081.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T05:59:26.842 INFO:teuthology.orchestra.run.smithi017.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-09-21T05:59:26.867 INFO:teuthology.orchestra.run.smithi017.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T05:59:26.882 INFO:teuthology.orchestra.run.smithi081.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T05:59:26.892 INFO:teuthology.orchestra.run.smithi017.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T05:59:26.917 INFO:teuthology.orchestra.run.smithi017.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T05:59:26.943 INFO:teuthology.orchestra.run.smithi017.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-21T05:59:27.010 INFO:teuthology.orchestra.run.smithi017.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-09-21T05:59:27.024 INFO:teuthology.orchestra.run.smithi081.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T05:59:27.036 INFO:teuthology.orchestra.run.smithi017.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T05:59:27.061 INFO:teuthology.orchestra.run.smithi017.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 484 kB/s | 24 kB 00:00 2024-09-21T05:59:27.082 INFO:teuthology.orchestra.run.smithi081.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T05:59:27.086 INFO:teuthology.orchestra.run.smithi017.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T05:59:27.111 INFO:teuthology.orchestra.run.smithi017.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T05:59:27.124 INFO:teuthology.orchestra.run.smithi081.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 981 kB/s | 41 kB 00:00 2024-09-21T05:59:27.145 INFO:teuthology.orchestra.run.smithi017.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T05:59:27.166 INFO:teuthology.orchestra.run.smithi081.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-21T05:59:27.170 INFO:teuthology.orchestra.run.smithi017.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-21T05:59:27.212 INFO:teuthology.orchestra.run.smithi017.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-21T05:59:27.217 INFO:teuthology.orchestra.run.smithi081.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.4 MB/s | 1.8 MB 00:00 2024-09-21T05:59:27.267 INFO:teuthology.orchestra.run.smithi081.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-21T05:59:27.296 INFO:teuthology.orchestra.run.smithi017.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T05:59:27.317 INFO:teuthology.orchestra.run.smithi081.stdout:(156/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.5 MB/s | 3.2 MB 00:00 2024-09-21T05:59:27.338 INFO:teuthology.orchestra.run.smithi017.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T05:59:27.359 INFO:teuthology.orchestra.run.smithi081.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-21T05:59:27.364 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:59:27.365 INFO:teuthology.orchestra.run.smithi081.stdout:Total 27 MB/s | 228 MB 00:08 2024-09-21T05:59:27.371 INFO:teuthology.orchestra.run.smithi017.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T05:59:27.397 INFO:teuthology.orchestra.run.smithi017.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T05:59:27.463 INFO:teuthology.orchestra.run.smithi017.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-21T05:59:27.505 INFO:teuthology.orchestra.run.smithi017.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T05:59:27.531 INFO:teuthology.orchestra.run.smithi017.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T05:59:27.581 INFO:teuthology.orchestra.run.smithi017.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T05:59:27.657 INFO:teuthology.orchestra.run.smithi017.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T05:59:27.682 INFO:teuthology.orchestra.run.smithi017.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T05:59:27.707 INFO:teuthology.orchestra.run.smithi017.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T05:59:27.732 INFO:teuthology.orchestra.run.smithi017.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-21T05:59:27.757 INFO:teuthology.orchestra.run.smithi017.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T05:59:27.783 INFO:teuthology.orchestra.run.smithi017.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T05:59:27.808 INFO:teuthology.orchestra.run.smithi017.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-21T05:59:27.892 INFO:teuthology.orchestra.run.smithi017.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T05:59:27.917 INFO:teuthology.orchestra.run.smithi017.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T05:59:27.942 INFO:teuthology.orchestra.run.smithi017.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T05:59:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T05:59:27.985 INFO:teuthology.orchestra.run.smithi017.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T05:59:28.018 INFO:teuthology.orchestra.run.smithi017.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T05:59:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T05:59:28.069 INFO:teuthology.orchestra.run.smithi017.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T05:59:28.094 INFO:teuthology.orchestra.run.smithi017.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T05:59:28.119 INFO:teuthology.orchestra.run.smithi017.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T05:59:28.203 INFO:teuthology.orchestra.run.smithi017.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T05:59:28.228 INFO:teuthology.orchestra.run.smithi017.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-21T05:59:28.254 INFO:teuthology.orchestra.run.smithi017.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-21T05:59:28.279 INFO:teuthology.orchestra.run.smithi017.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:59:28.304 INFO:teuthology.orchestra.run.smithi017.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T05:59:28.330 INFO:teuthology.orchestra.run.smithi017.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T05:59:28.355 INFO:teuthology.orchestra.run.smithi017.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T05:59:28.380 INFO:teuthology.orchestra.run.smithi017.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T05:59:28.405 INFO:teuthology.orchestra.run.smithi017.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T05:59:28.431 INFO:teuthology.orchestra.run.smithi017.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:59:28.456 INFO:teuthology.orchestra.run.smithi017.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-21T05:59:28.559 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-21T05:59:28.690 INFO:teuthology.orchestra.run.smithi017.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-21T05:59:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-21T05:59:28.711 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-21T05:59:28.748 INFO:teuthology.orchestra.run.smithi017.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-21T05:59:28.782 INFO:teuthology.orchestra.run.smithi017.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T05:59:28.807 INFO:teuthology.orchestra.run.smithi017.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-21T05:59:28.916 INFO:teuthology.orchestra.run.smithi017.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T05:59:28.958 INFO:teuthology.orchestra.run.smithi017.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 976 kB/s | 26 kB 00:00 2024-09-21T05:59:28.983 INFO:teuthology.orchestra.run.smithi017.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:59:29.008 INFO:teuthology.orchestra.run.smithi017.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:59:29.042 INFO:teuthology.orchestra.run.smithi017.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-21T05:59:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T05:59:29.109 INFO:teuthology.orchestra.run.smithi017.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T05:59:29.121 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T05:59:29.134 INFO:teuthology.orchestra.run.smithi017.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:59:29.159 INFO:teuthology.orchestra.run.smithi017.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T05:59:29.185 INFO:teuthology.orchestra.run.smithi017.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-21T05:59:29.210 INFO:teuthology.orchestra.run.smithi017.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T05:59:29.261 INFO:teuthology.orchestra.run.smithi017.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T05:59:29.286 INFO:teuthology.orchestra.run.smithi017.stdout:(120/157): lua-devel-5.4.4-4.el9.x86_64.rpm 26 kB/s | 22 kB 00:00 2024-09-21T05:59:29.319 INFO:teuthology.orchestra.run.smithi017.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T05:59:29.370 INFO:teuthology.orchestra.run.smithi017.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T05:59:29.395 INFO:teuthology.orchestra.run.smithi017.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T05:59:29.421 INFO:teuthology.orchestra.run.smithi017.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T05:59:29.446 INFO:teuthology.orchestra.run.smithi017.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-21T05:59:29.471 INFO:teuthology.orchestra.run.smithi017.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-21T05:59:29.513 INFO:teuthology.orchestra.run.smithi017.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 469 kB/s | 19 kB 00:00 2024-09-21T05:59:29.563 INFO:teuthology.orchestra.run.smithi017.stdout:(128/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T05:59:29.589 INFO:teuthology.orchestra.run.smithi017.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-21T05:59:29.614 INFO:teuthology.orchestra.run.smithi017.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:59:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T05:59:29.664 INFO:teuthology.orchestra.run.smithi017.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T05:59:29.707 INFO:teuthology.orchestra.run.smithi017.stdout:(133/157): protobuf-compiler-3.14.0-13.el9.x86_ 690 kB/s | 863 kB 00:01 2024-09-21T05:59:29.740 INFO:teuthology.orchestra.run.smithi017.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T05:59:29.765 INFO:teuthology.orchestra.run.smithi017.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-21T05:59:29.799 INFO:teuthology.orchestra.run.smithi017.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.6 MB/s | 90 kB 00:00 2024-09-21T05:59:29.824 INFO:teuthology.orchestra.run.smithi017.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-09-21T05:59:29.850 INFO:teuthology.orchestra.run.smithi017.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T05:59:29.875 INFO:teuthology.orchestra.run.smithi017.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:59:29.908 INFO:teuthology.orchestra.run.smithi017.stdout:(140/157): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-09-21T05:59:29.934 INFO:teuthology.orchestra.run.smithi017.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-21T05:59:29.959 INFO:teuthology.orchestra.run.smithi017.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-21T05:59:29.984 INFO:teuthology.orchestra.run.smithi017.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 984 kB/s | 74 kB 00:00 2024-09-21T05:59:30.010 INFO:teuthology.orchestra.run.smithi017.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T05:59:30.035 INFO:teuthology.orchestra.run.smithi017.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T05:59:30.052 INFO:teuthology.orchestra.run.smithi017.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-21T05:59:30.077 INFO:teuthology.orchestra.run.smithi017.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T05:59:30.119 INFO:teuthology.orchestra.run.smithi017.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T05:59:30.178 INFO:teuthology.orchestra.run.smithi017.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T05:59:30.420 INFO:teuthology.orchestra.run.smithi017.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 3.4 MB 00:00 2024-09-21T05:59:30.479 INFO:teuthology.orchestra.run.smithi017.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.8 MB/s | 3.2 MB 00:00 2024-09-21T05:59:30.546 INFO:teuthology.orchestra.run.smithi017.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 614 kB/s | 41 kB 00:00 2024-09-21T05:59:30.621 INFO:teuthology.orchestra.run.smithi017.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-21T05:59:30.622 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-21T05:59:30.713 INFO:teuthology.orchestra.run.smithi017.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.3 MB/s | 2.3 MB 00:00 2024-09-21T05:59:30.863 INFO:teuthology.orchestra.run.smithi017.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.1 MB/s | 1.8 MB 00:00 2024-09-21T05:59:30.963 INFO:teuthology.orchestra.run.smithi017.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 1.4 MB 00:00 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-21T05:59:30.994 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-21T05:59:31.055 INFO:teuthology.orchestra.run.smithi017.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 2.4 MB 00:00 2024-09-21T05:59:31.061 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:59:31.061 INFO:teuthology.orchestra.run.smithi017.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T05:59:31.526 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T05:59:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-21T05:59:32.498 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-21T05:59:32.499 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-21T05:59:34.837 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-21T05:59:34.837 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-21T05:59:36.924 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-09-21T05:59:37.372 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-21T05:59:37.488 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:59:37.534 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:59:37.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:59:37.638 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:59:37.664 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:59:37.739 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:59:38.140 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:59:38.208 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:59:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:59:38.359 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:59:38.451 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:59:38.490 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:59:38.528 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:59:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:59:38.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:59:38.790 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:59:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:59:38.932 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:59:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:59:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:59:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:59:39.112 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:59:39.112 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T05:59:39.126 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T05:59:39.126 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T05:59:39.127 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T05:59:39.128 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T05:59:39.130 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T05:59:39.133 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T05:59:39.134 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T05:59:39.196 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-21T05:59:39.222 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-21T05:59:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-21T05:59:39.222 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-21T05:59:39.222 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-21T05:59:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T05:59:39.222 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T05:59:39.223 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T05:59:39.224 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T05:59:39.225 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T05:59:39.226 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T05:59:39.227 INFO:teuthology.orchestra.run.smithi089.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T05:59:39.228 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T05:59:39.229 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T05:59:39.230 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T05:59:39.231 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T05:59:39.232 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T05:59:39.233 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-21T05:59:39.234 INFO:teuthology.orchestra.run.smithi089.stdout:Install 149 Packages 2024-09-21T05:59:39.235 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 8 Packages 2024-09-21T05:59:39.235 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:59:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:59:39.235 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 228 M 2024-09-21T05:59:39.236 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-21T05:59:39.400 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:59:39.540 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:59:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:59:39.741 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:59:39.975 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:59:40.093 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:59:40.121 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:59:40.155 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:59:40.228 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:59:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:59:40.292 INFO:teuthology.orchestra.run.smithi089.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-21T05:59:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:59:40.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:59:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:59:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:59:40.485 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:59:40.517 INFO:teuthology.orchestra.run.smithi089.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.8 MB/s | 873 kB 00:00 2024-09-21T05:59:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:59:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:59:40.618 INFO:teuthology.orchestra.run.smithi089.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.4 MB/s | 148 kB 00:00 2024-09-21T05:59:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:59:40.710 INFO:teuthology.orchestra.run.smithi089.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T05:59:40.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:59:40.758 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:59:40.794 INFO:teuthology.orchestra.run.smithi089.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-21T05:59:40.826 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:59:40.852 INFO:teuthology.orchestra.run.smithi089.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-21T05:59:40.855 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:59:40.924 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:59:40.970 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:59:41.043 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:59:41.111 INFO:teuthology.orchestra.run.smithi089.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.0 MB 00:00 2024-09-21T05:59:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:59:41.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:59:41.311 INFO:teuthology.orchestra.run.smithi089.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T05:59:41.353 INFO:teuthology.orchestra.run.smithi089.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T05:59:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-21T05:59:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:59:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:59:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:59:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:59:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:59:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:59:41.736 INFO:teuthology.orchestra.run.smithi089.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 17 MB/s | 10 MB 00:00 2024-09-21T05:59:41.748 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:59:41.787 INFO:teuthology.orchestra.run.smithi089.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T05:59:41.826 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:59:41.854 INFO:teuthology.orchestra.run.smithi089.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T05:59:41.855 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:59:41.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:59:41.929 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:59:41.937 INFO:teuthology.orchestra.run.smithi089.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 380 kB/s | 32 kB 00:00 2024-09-21T05:59:41.971 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:59:42.030 INFO:teuthology.orchestra.run.smithi089.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T05:59:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:59:42.105 INFO:teuthology.orchestra.run.smithi089.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T05:59:42.138 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:59:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:59:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:59:42.305 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:59:42.305 INFO:teuthology.orchestra.run.smithi089.stdout:(16/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T05:59:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:59:42.331 INFO:teuthology.orchestra.run.smithi089.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 562 kB/s | 127 kB 00:00 2024-09-21T05:59:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:59:42.365 INFO:teuthology.orchestra.run.smithi089.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T05:59:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:59:42.423 INFO:teuthology.orchestra.run.smithi089.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 775 kB/s | 45 kB 00:00 2024-09-21T05:59:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:59:42.451 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:59:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T05:59:42.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:59:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T05:59:42.515 INFO:teuthology.orchestra.run.smithi089.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T05:59:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:59:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:59:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:59:42.641 INFO:teuthology.orchestra.run.smithi089.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-21T05:59:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:59:42.666 INFO:teuthology.orchestra.run.smithi089.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.0 MB/s | 161 kB 00:00 2024-09-21T05:59:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T05:59:42.691 INFO:teuthology.orchestra.run.smithi089.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T05:59:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:59:42.725 INFO:teuthology.orchestra.run.smithi089.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T05:59:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T05:59:42.750 INFO:teuthology.orchestra.run.smithi089.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T05:59:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:59:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T05:59:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:59:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T05:59:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:59:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:59:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T05:59:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:59:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T05:59:43.159 INFO:teuthology.orchestra.run.smithi089.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 22 MB/s | 40 MB 00:01 2024-09-21T05:59:43.184 INFO:teuthology.orchestra.run.smithi089.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 416 kB/s | 170 kB 00:00 2024-09-21T05:59:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:59:43.210 INFO:teuthology.orchestra.run.smithi089.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 686 kB/s | 34 kB 00:00 2024-09-21T05:59:43.235 INFO:teuthology.orchestra.run.smithi089.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T05:59:43.302 INFO:teuthology.orchestra.run.smithi089.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.6 MB/s | 3.1 MB 00:00 2024-09-21T05:59:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:59:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:59:43.386 INFO:teuthology.orchestra.run.smithi089.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.4 MB/s | 292 kB 00:00 2024-09-21T05:59:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:59:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:59:43.452 INFO:teuthology.orchestra.run.smithi089.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 744 kB/s | 49 kB 00:00 2024-09-21T05:59:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:59:43.528 INFO:teuthology.orchestra.run.smithi089.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 219 kB/s | 16 kB 00:00 2024-09-21T05:59:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:59:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:59:43.612 INFO:teuthology.orchestra.run.smithi089.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.3 MB/s | 285 kB 00:00 2024-09-21T05:59:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:59:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T05:59:43.746 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:59:43.762 INFO:teuthology.orchestra.run.smithi089.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 26 MB/s | 14 MB 00:00 2024-09-21T05:59:43.774 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:59:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.0 MB/s | 784 kB 00:00 2024-09-21T05:59:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:59:43.829 INFO:teuthology.orchestra.run.smithi089.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T05:59:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T05:59:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:59:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:59:43.912 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:59:43.930 INFO:teuthology.orchestra.run.smithi089.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T05:59:43.946 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:59:43.955 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:59:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:59:44.013 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:59:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:59:44.047 INFO:teuthology.orchestra.run.smithi089.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-21T05:59:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:59:44.151 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:59:44.155 INFO:teuthology.orchestra.run.smithi089.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 849 kB/s | 191 kB 00:00 2024-09-21T05:59:44.180 INFO:teuthology.orchestra.run.smithi089.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-21T05:59:44.203 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:59:44.206 INFO:teuthology.orchestra.run.smithi089.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-21T05:59:44.232 INFO:teuthology.orchestra.run.smithi089.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T05:59:44.234 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:59:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T05:59:44.273 INFO:teuthology.orchestra.run.smithi089.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T05:59:44.299 INFO:teuthology.orchestra.run.smithi089.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-21T05:59:44.324 INFO:teuthology.orchestra.run.smithi089.stdout:(47/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-21T05:59:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:59:44.349 INFO:teuthology.orchestra.run.smithi089.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-21T05:59:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T05:59:44.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:59:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T05:59:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T05:59:44.458 INFO:teuthology.orchestra.run.smithi089.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-09-21T05:59:44.492 INFO:teuthology.orchestra.run.smithi089.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-21T05:59:44.503 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T05:59:44.508 INFO:teuthology.orchestra.run.smithi089.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T05:59:44.554 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T05:59:44.567 INFO:teuthology.orchestra.run.smithi089.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-21T05:59:44.592 INFO:teuthology.orchestra.run.smithi089.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-09-21T05:59:44.594 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T05:59:44.629 INFO:teuthology.orchestra.run.smithi089.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-21T05:59:44.637 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T05:59:44.652 INFO:teuthology.orchestra.run.smithi089.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 309 kB/s | 18 kB 00:00 2024-09-21T05:59:44.670 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T05:59:44.677 INFO:teuthology.orchestra.run.smithi089.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 236 kB/s | 11 kB 00:00 2024-09-21T05:59:44.698 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T05:59:44.702 INFO:teuthology.orchestra.run.smithi089.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T05:59:44.744 INFO:teuthology.orchestra.run.smithi089.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T05:59:44.770 INFO:teuthology.orchestra.run.smithi089.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-09-21T05:59:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T05:59:44.828 INFO:teuthology.orchestra.run.smithi089.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-21T05:59:44.838 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T05:59:44.862 INFO:teuthology.orchestra.run.smithi089.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T05:59:44.867 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T05:59:44.887 INFO:teuthology.orchestra.run.smithi089.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T05:59:44.908 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T05:59:44.912 INFO:teuthology.orchestra.run.smithi089.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 937 kB/s | 47 kB 00:00 2024-09-21T05:59:44.938 INFO:teuthology.orchestra.run.smithi089.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-21T05:59:44.963 INFO:teuthology.orchestra.run.smithi089.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T05:59:44.989 INFO:teuthology.orchestra.run.smithi089.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T05:59:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T05:59:45.014 INFO:teuthology.orchestra.run.smithi089.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-21T05:59:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T05:59:45.074 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T05:59:45.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T05:59:45.104 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:59:45.149 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:59:45.156 INFO:teuthology.orchestra.run.smithi089.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-21T05:59:45.174 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T05:59:45.183 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:59:45.189 INFO:teuthology.orchestra.run.smithi089.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-09-21T05:59:45.223 INFO:teuthology.orchestra.run.smithi089.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 13 MB/s | 910 kB 00:00 2024-09-21T05:59:45.225 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T05:59:45.257 INFO:teuthology.orchestra.run.smithi089.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T05:59:45.282 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:59:45.302 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T05:59:45.329 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:59:45.332 INFO:teuthology.orchestra.run.smithi089.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T05:59:45.366 INFO:teuthology.orchestra.run.smithi089.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T05:59:45.375 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:59:45.391 INFO:teuthology.orchestra.run.smithi089.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T05:59:45.447 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T05:59:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:59:45.475 INFO:teuthology.orchestra.run.smithi089.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-21T05:59:45.500 INFO:teuthology.orchestra.run.smithi089.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-21T05:59:45.503 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T05:59:45.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:59:45.525 INFO:teuthology.orchestra.run.smithi089.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-21T05:59:45.551 INFO:teuthology.orchestra.run.smithi089.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T05:59:45.576 INFO:teuthology.orchestra.run.smithi089.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-21T05:59:45.601 INFO:teuthology.orchestra.run.smithi089.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T05:59:45.627 INFO:teuthology.orchestra.run.smithi089.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T05:59:45.644 INFO:teuthology.orchestra.run.smithi089.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 826 kB/s | 35 kB 00:00 2024-09-21T05:59:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:59:45.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:59:45.744 INFO:teuthology.orchestra.run.smithi089.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T05:59:45.778 INFO:teuthology.orchestra.run.smithi089.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-21T05:59:45.803 INFO:teuthology.orchestra.run.smithi089.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T05:59:45.820 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:59:45.828 INFO:teuthology.orchestra.run.smithi089.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T05:59:45.853 INFO:teuthology.orchestra.run.smithi089.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-21T05:59:45.879 INFO:teuthology.orchestra.run.smithi089.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T05:59:45.921 INFO:teuthology.orchestra.run.smithi089.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T05:59:45.947 INFO:teuthology.orchestra.run.smithi089.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 279 kB 00:00 2024-09-21T05:59:45.972 INFO:teuthology.orchestra.run.smithi089.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T05:59:45.997 INFO:teuthology.orchestra.run.smithi089.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T05:59:46.059 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T05:59:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T05:59:46.098 INFO:teuthology.orchestra.run.smithi089.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-21T05:59:46.123 INFO:teuthology.orchestra.run.smithi089.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-21T05:59:46.148 INFO:teuthology.orchestra.run.smithi089.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T05:59:46.150 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T05:59:46.174 INFO:teuthology.orchestra.run.smithi089.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-21T05:59:46.194 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T05:59:46.199 INFO:teuthology.orchestra.run.smithi089.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T05:59:46.224 INFO:teuthology.orchestra.run.smithi089.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T05:59:46.245 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T05:59:46.250 INFO:teuthology.orchestra.run.smithi089.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T05:59:46.275 INFO:teuthology.orchestra.run.smithi089.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T05:59:46.284 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T05:59:46.300 INFO:teuthology.orchestra.run.smithi089.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T05:59:46.325 INFO:teuthology.orchestra.run.smithi089.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-21T05:59:46.327 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T05:59:46.401 INFO:teuthology.orchestra.run.smithi089.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-21T05:59:46.451 INFO:teuthology.orchestra.run.smithi089.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T05:59:46.454 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:59:46.481 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T05:59:46.485 INFO:teuthology.orchestra.run.smithi089.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T05:59:46.510 INFO:teuthology.orchestra.run.smithi089.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T05:59:46.528 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T05:59:46.544 INFO:teuthology.orchestra.run.smithi089.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-21T05:59:46.575 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:59:46.586 INFO:teuthology.orchestra.run.smithi089.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-09-21T05:59:46.611 INFO:teuthology.orchestra.run.smithi089.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T05:59:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T05:59:46.636 INFO:teuthology.orchestra.run.smithi089.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T05:59:46.803 INFO:teuthology.orchestra.run.smithi089.stdout:(112/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-21T05:59:46.829 INFO:teuthology.orchestra.run.smithi089.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 788 kB/s | 151 kB 00:00 2024-09-21T05:59:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T05:59:46.879 INFO:teuthology.orchestra.run.smithi089.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T05:59:46.904 INFO:teuthology.orchestra.run.smithi089.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T05:59:46.930 INFO:teuthology.orchestra.run.smithi089.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T05:59:46.955 INFO:teuthology.orchestra.run.smithi089.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-21T05:59:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T05:59:46.989 INFO:teuthology.orchestra.run.smithi089.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-21T05:59:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T05:59:47.022 INFO:teuthology.orchestra.run.smithi089.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-21T05:59:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T05:59:47.064 INFO:teuthology.orchestra.run.smithi089.stdout:(120/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-09-21T05:59:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T05:59:47.131 INFO:teuthology.orchestra.run.smithi089.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-21T05:59:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T05:59:47.157 INFO:teuthology.orchestra.run.smithi089.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-21T05:59:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T05:59:47.190 INFO:teuthology.orchestra.run.smithi089.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-21T05:59:47.215 INFO:teuthology.orchestra.run.smithi089.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T05:59:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T05:59:47.233 INFO:teuthology.orchestra.run.smithi089.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 254 kB/s | 11 kB 00:00 2024-09-21T05:59:47.250 INFO:teuthology.orchestra.run.smithi089.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 524 kB/s | 18 kB 00:00 2024-09-21T05:59:47.267 INFO:teuthology.orchestra.run.smithi089.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2024-09-21T05:59:47.283 INFO:teuthology.orchestra.run.smithi089.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-09-21T05:59:47.300 INFO:teuthology.orchestra.run.smithi089.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 590 kB/s | 20 kB 00:00 2024-09-21T05:59:47.326 INFO:teuthology.orchestra.run.smithi089.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T05:59:47.360 INFO:teuthology.orchestra.run.smithi089.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T05:59:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T05:59:47.385 INFO:teuthology.orchestra.run.smithi089.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T05:59:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T05:59:47.427 INFO:teuthology.orchestra.run.smithi089.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-21T05:59:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T05:59:47.460 INFO:teuthology.orchestra.run.smithi089.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T05:59:47.486 INFO:teuthology.orchestra.run.smithi089.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-21T05:59:47.511 INFO:teuthology.orchestra.run.smithi089.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T05:59:47.538 INFO:teuthology.orchestra.run.smithi089.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T05:59:47.562 INFO:teuthology.orchestra.run.smithi089.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T05:59:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T05:59:47.587 INFO:teuthology.orchestra.run.smithi089.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T05:59:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T05:59:47.621 INFO:teuthology.orchestra.run.smithi089.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-21T05:59:47.646 INFO:teuthology.orchestra.run.smithi089.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 606 kB/s | 36 kB 00:00 2024-09-21T05:59:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T05:59:47.672 INFO:teuthology.orchestra.run.smithi089.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T05:59:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T05:59:47.697 INFO:teuthology.orchestra.run.smithi089.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T05:59:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T05:59:47.731 INFO:teuthology.orchestra.run.smithi089.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T05:59:47.781 INFO:teuthology.orchestra.run.smithi089.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T05:59:47.806 INFO:teuthology.orchestra.run.smithi089.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-09-21T05:59:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:59:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T05:59:47.832 INFO:teuthology.orchestra.run.smithi089.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T05:59:47.857 INFO:teuthology.orchestra.run.smithi089.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-21T05:59:47.899 INFO:teuthology.orchestra.run.smithi089.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T05:59:47.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:59:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:59:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T05:59:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:59:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T05:59:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T05:59:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T05:59:48.091 INFO:teuthology.orchestra.run.smithi089.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T05:59:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T05:59:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T05:59:48.183 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T05:59:48.217 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T05:59:48.225 INFO:teuthology.orchestra.run.smithi089.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2024-09-21T05:59:48.251 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T05:59:48.283 INFO:teuthology.orchestra.run.smithi089.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.4 MB/s | 3.2 MB 00:00 2024-09-21T05:59:48.293 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T05:59:48.306 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:59:48.308 INFO:teuthology.orchestra.run.smithi089.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-21T05:59:48.336 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T05:59:48.356 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:59:48.401 INFO:teuthology.orchestra.run.smithi089.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-21T05:59:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T05:59:48.442 INFO:teuthology.orchestra.run.smithi089.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.2 MB/s | 1.8 MB 00:00 2024-09-21T05:59:48.447 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:59:48.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:59:48.492 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T05:59:48.501 INFO:teuthology.orchestra.run.smithi089.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-21T05:59:48.523 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T05:59:48.549 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:59:48.560 INFO:teuthology.orchestra.run.smithi089.stdout:(157/157): NetworkManager-tui-1.51.0-1.el9.x86_ 902 kB/s | 249 kB 00:00 2024-09-21T05:59:48.566 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:59:48.566 INFO:teuthology.orchestra.run.smithi089.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T05:59:48.630 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T05:59:48.683 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T05:59:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:59:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:59:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:59:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:59:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T05:59:49.496 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T05:59:49.530 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T05:59:49.635 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T05:59:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T05:59:49.731 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T05:59:49.784 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-21T05:59:49.821 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T05:59:49.885 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T05:59:49.936 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-21T05:59:49.936 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-21T05:59:50.077 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T05:59:50.107 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T05:59:50.187 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T05:59:50.887 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T05:59:51.009 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T05:59:51.960 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:59:51.991 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:59:52.149 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-21T05:59:52.149 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-21T05:59:52.346 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T05:59:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T05:59:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T05:59:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T05:59:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:59:52.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:59:52.693 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:59:52.693 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:59:52.693 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:59:52.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T05:59:52.729 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:59:52.867 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T05:59:52.920 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T05:59:53.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T05:59:53.062 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T05:59:53.589 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T05:59:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:59:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T05:59:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T05:59:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:59:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:59:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T05:59:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:59:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T05:59:56.904 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T05:59:56.904 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T05:59:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T05:59:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T05:59:58.656 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-21T05:59:58.789 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T05:59:58.831 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T05:59:58.896 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T05:59:58.946 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T05:59:58.980 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T05:59:59.174 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T05:59:59.547 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T05:59:59.690 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:59:59.817 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T05:59:59.850 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:59:59.941 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T05:59:59.980 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:00:00.010 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:00:00.181 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:00:00.236 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:00:00.264 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:00:00.377 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:00:00.407 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:00:00.470 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:00:00.492 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:00:00.535 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:00:00.688 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:00:00.870 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:00:00.999 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:00:01.106 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:00:01.184 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:00:01.408 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:00:01.519 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:00:01.555 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:00:01.590 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:00:01.663 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:00:01.716 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:00:01.748 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:00:01.791 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:00:01.825 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:00:01.853 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:00:01.920 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:00:01.974 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:00:02.006 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:00:02.058 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:00:02.146 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:00:02.177 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:00:02.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:00:02.249 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:00:02.317 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:00:02.364 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:00:02.437 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:00:02.570 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:00:02.616 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:00:03.145 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:00:03.229 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:00:03.258 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:00:03.302 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:00:03.348 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:00:03.399 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:00:03.553 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:00:03.610 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:00:03.700 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:00:03.765 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:00:03.838 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:00:03.879 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:00:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:00:03.969 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:00:04.006 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:00:04.049 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:00:04.091 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:00:04.226 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:00:04.260 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:00:04.302 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:00:04.404 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:00:04.445 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:00:04.485 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:00:04.560 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:00:04.660 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-21T06:00:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:04.760 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:00:04.886 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:00:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:00:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:00:04.916 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:04.916 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:00:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:04.926 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:00:04.958 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:00:04.992 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:00:05.031 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:00:05.063 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:00:05.093 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:00:05.128 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:00:05.162 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:00:05.203 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:00:05.237 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:00:05.324 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:00:05.376 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:00:05.408 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:00:05.509 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:00:05.559 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:00:06.274 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:00:06.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:00:06.365 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:00:06.462 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:00:06.520 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:00:06.520 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:00:06.546 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:00:06.546 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:06.546 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:00:06.547 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:00:06.547 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:00:06.547 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:06.565 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:00:06.652 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:00:06.693 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:00:06.779 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:00:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:00:06.802 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:06.802 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:00:06.802 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:00:06.802 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:00:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:06.886 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:00:06.916 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:00:06.994 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:00:07.271 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:00:07.294 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:00:07.294 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:07.294 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:00:07.294 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:00:07.295 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:00:07.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:07.393 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:00:07.441 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:00:07.504 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:00:07.651 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:00:07.698 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:00:07.747 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:00:07.762 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:00:07.824 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:00:07.922 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:00:08.070 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:00:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:00:08.154 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:00:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:00:08.616 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:00:08.647 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:00:08.679 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:00:08.745 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:00:08.770 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:00:08.998 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:00:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:00:09.109 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:00:09.142 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-21T06:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-21T06:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-21T06:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-21T06:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-21T06:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-21T06:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-21T06:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:00:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:00:09.422 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:09.422 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:00:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:09.466 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:00:09.514 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:00:09.596 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:00:09.685 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:00:09.906 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:00:10.402 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:00:10.434 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:00:10.488 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:00:10.511 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:00:11.084 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:00:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:00:11.120 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:11.120 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:00:11.120 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:00:11.120 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:00:11.120 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:11.361 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:00:11.386 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:00:11.387 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:11.387 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:00:11.387 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:00:11.387 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:00:11.387 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:11.878 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:00:11.904 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:00:11.904 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:11.904 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:00:11.904 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:00:11.904 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:00:11.904 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:00:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:00:12.009 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:00:12.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:00:12.147 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:00:12.350 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:00:12.396 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:00:12.477 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:00:12.568 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:00:12.708 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:00:12.745 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:00:12.746 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:00:12.778 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:00:12.782 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:00:12.805 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:00:12.965 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:00:12.993 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:00:13.106 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:00:13.208 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:00:13.238 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:00:13.270 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:00:13.302 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:00:13.337 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:00:13.339 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:00:13.358 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:00:13.360 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:00:13.360 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:13.360 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:00:13.360 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:00:13.360 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:00:13.360 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:13.369 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:00:13.403 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:00:13.404 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:00:13.416 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:00:13.495 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:00:13.495 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:00:13.495 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:00:13.495 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:00:13.538 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:00:13.573 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:00:14.536 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:00:14.565 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:00:14.588 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:00:14.588 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:14.588 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:00:14.588 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:00:14.588 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:00:14.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:00:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:00:14.655 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:14.655 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:00:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:00:14.722 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:00:14.722 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:14.722 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:00:14.722 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:00:14.723 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:00:14.723 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:15.058 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:00:15.081 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:00:15.081 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:15.082 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:00:15.082 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:00:15.082 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:00:15.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:16.752 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:00:16.809 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:00:17.824 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:00:17.851 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:00:17.973 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:00:18.151 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:00:18.186 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:00:18.212 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:00:18.212 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:18.212 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:00:18.212 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:00:18.212 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:00:18.212 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:18.262 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:00:18.274 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:00:18.376 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:00:18.434 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:00:19.105 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:00:19.146 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:00:19.186 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:00:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:00:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:00:19.456 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:00:19.481 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:00:19.489 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:00:19.514 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:00:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:00:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:00:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:00:19.515 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:19.526 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:00:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:00:19.565 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:00:19.585 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:00:19.589 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:00:19.590 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:19.590 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:00:19.590 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:19.640 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:00:19.649 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:00:19.674 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:00:19.674 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:19.674 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:00:19.674 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:00:19.674 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:00:19.674 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:00:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:00:20.042 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:20.042 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:00:20.042 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:00:20.042 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:00:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:20.265 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:20.305 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:21.142 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:00:21.253 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:00:21.307 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:00:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:00:21.429 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:00:21.454 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:00:21.480 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:00:21.480 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:00:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:00:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:00:21.640 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:00:21.665 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:00:21.670 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:21.670 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:00:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:00:22.016 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:00:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:00:24.512 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:00:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:00:24.571 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:00:24.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:00:24.859 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:00:24.897 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:00:24.927 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:00:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:00:25.443 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:00:25.443 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-21T06:00:25.443 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-21T06:00:25.443 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-21T06:00:25.444 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-21T06:00:25.444 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-21T06:00:25.444 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-21T06:00:25.444 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-21T06:00:25.444 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:25.621 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:00:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:00:25.640 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:25.640 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:00:25.640 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:26.623 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:00:26.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:00:26.769 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:00:26.869 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:00:26.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:00:26.939 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:00:26.973 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:00:26.973 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:00:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:00:27.058 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:00:27.150 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:00:27.174 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:00:27.180 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:27.181 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:27.241 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:00:27.268 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:00:27.268 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:27.268 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:00:27.268 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:00:27.268 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:00:27.269 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:27.369 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:27.369 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:00:27.453 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:00:27.492 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:00:27.515 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:00:27.516 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:27.516 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:00:27.516 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:00:27.516 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:00:27.516 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:27.521 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:27.984 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:00:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:00:28.008 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:28.008 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:00:28.008 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:00:28.008 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:00:28.008 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:28.115 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:00:28.171 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:00:28.236 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:00:28.420 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:00:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:00:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:00:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:00:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:00:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:00:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:00:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:00:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:00:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:00:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:00:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:00:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:00:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:00:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:00:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:00:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:00:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:00:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:00:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:00:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:00:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:00:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:00:28.491 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:00:28.564 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:00:28.660 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:00:28.791 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:00:28.836 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:00:28.877 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:00:28.905 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:00:29.348 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:00:29.379 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:00:29.411 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:00:29.477 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:00:29.511 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-21T06:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:00:31.298 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:00:31.299 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:00:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:00:31.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:00:31.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:00:31.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:00:31.306 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:00:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:00:31.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:00:31.307 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-21T06:00:31.745 DEBUG:teuthology.parallel:result is None 2024-09-21T06:00:32.667 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:00:32.726 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:00:33.683 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:00:33.710 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:00:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:00:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:00:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:00:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:00:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:00:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:00:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:00:33.800 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:00:33.801 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:00:33.802 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:00:33.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:00:33.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:00:33.805 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:00:33.806 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:00:33.807 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:00:33.808 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:00:33.809 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:00:33.810 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:00:33.824 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:00:33.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:00:34.021 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:00:34.045 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:00:34.045 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:34.045 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:00:34.045 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:00:34.045 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:00:34.045 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:34.096 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:00:34.108 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:00:34.206 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:00:34.257 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:00:35.221 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:00:35.265 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:00:35.289 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:00:35.289 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:35.289 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:00:35.289 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:00:35.289 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:00:35.289 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:35.333 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:00:35.356 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:00:35.356 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:35.356 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:00:35.356 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:35.409 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:00:35.432 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:00:35.432 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:35.432 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:00:35.432 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:00:35.432 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:00:35.432 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:35.751 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:00:35.775 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:00:35.775 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:00:35.775 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:00:35.775 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:00:35.775 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:00:35.775 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:36.494 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:36.494 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:36.494 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:00:36.495 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.496 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:36.497 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.498 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.499 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:00:36.500 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.501 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:00:36.502 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:00:36.503 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:00:36.504 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:00:36.505 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:00:36.506 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:00:36.507 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:00:36.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:00:36.507 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-21T06:00:36.938 DEBUG:teuthology.parallel:result is None 2024-09-21T06:00:39.792 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:00:39.831 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:00:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:00:39.937 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:00:39.964 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:00:40.170 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:00:40.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:00:40.250 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:00:40.280 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:00:40.326 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:00:40.904 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:40.942 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:40.962 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:00:41.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:00:41.881 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:00:41.927 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:00:42.012 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:00:42.043 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:00:42.069 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:00:42.095 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:00:42.095 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:00:42.179 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:00:42.179 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:00:42.272 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:00:42.297 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:00:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:42.302 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:00:42.482 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:00:42.566 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:00:42.631 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:49.074 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:49.074 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:00:49.074 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:00:49.074 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:00:49.075 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:00:49.076 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:00:49.077 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:00:49.077 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:00:49.077 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:00:49.089 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:00:49.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:00:49.091 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:00:49.092 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:00:49.093 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:00:49.094 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:00:49.095 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:00:49.096 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:00:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:00:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:00:49.099 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:00:51.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-21T06:00:51.569 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.570 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.571 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.572 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:00:51.573 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:00:51.574 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:00:51.575 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:00:51.576 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:00:51.577 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:00:51.578 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:00:51.579 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:00:51.580 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:00:51.580 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:00:51.580 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:00:51.580 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-21T06:00:52.031 DEBUG:teuthology.parallel:result is None 2024-09-21T06:00:52.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:00:52.179 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:00:52.207 INFO:teuthology.orchestra.run.smithi017.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:00:52.207 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:00:52.207 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:00:52.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:00:52.351 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:00:52.378 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:00:52.378 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:00:52.378 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:00:52.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:00:52.523 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:00:52.547 INFO:teuthology.orchestra.run.smithi089.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:00:52.547 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:00:52.548 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:00:52.549 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:00:52.549 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:00:52.550 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:00:52.583 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:00:52.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:00:52.616 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:00:52.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:00:52.645 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:00:52.645 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:00:52.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:00:52.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:00:52.744 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:00:52.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:00:52.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:00:52.841 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:00:52.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:00:52.868 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:00:52.933 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:00:52.933 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:00:52.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:00:52.959 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:00:53.025 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:00:53.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:00:53.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:00:53.116 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:00:53.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:00:53.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:00:53.208 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:00:53.208 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:00:53.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:00:53.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:00:53.303 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:00:53.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:00:53.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:00:53.393 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:00:53.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:00:53.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:00:53.484 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:00:53.598 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:00:53.598 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:00:53.599 INFO:tasks.cephadm:Cluster fsid is dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:00:53.599 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:00:53.599 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.81', 'mon.c': '172.21.15.89'} 2024-09-21T06:00:53.599 INFO:tasks.cephadm:First mon is mon.a on smithi017 2024-09-21T06:00:53.599 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:00:53.599 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:00:53.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-09-21T06:00:53.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-09-21T06:00:53.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-09-21T06:00:53.675 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:00:53.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:00:53.816 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:00:53.955 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:00:53.956 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:00:53.956 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:00:53.957 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:54.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:00 /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:54.510 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.051 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:00 /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.051 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.578 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:00 /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.578 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.599 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.619 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:00:55.654 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:00:55.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:00:55.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:00:55.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:00:57.239 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:00:57.247 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:00:57.331 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-09-21T06:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:01:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T06:01:30.054 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T06:01:30.488 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:01:33.604 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:01:33.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-09-21T06:01:33.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-09-21T06:01:33.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-09-21T06:01:33.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-09-21T06:01:33.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-09-21T06:01:33.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-09-21T06:01:33.816 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T06:01:33.817 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:01:33.818 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T06:01:33.819 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:01:33.819 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:01:33.836 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = dc6785ee-77de-11ef-baf5-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T06:01:33.836 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:01:33.879 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:01:33.921 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:01:33.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:01:34.134 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:01:34.134 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-09-21T06:01:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:01:34.135 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-09-21T06:01:34.159 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:01:34.159 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-09-21T06:01:34.159 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-09-21T06:01:34.167 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:01:34.167 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:01:34.174 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:01:34.174 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-21T06:01:34.181 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-21T06:01:34.187 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-21T06:01:34.187 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:01:34.188 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-09-21T06:01:34.209 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:01:34.209 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:01:34.210 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-09-21T06:01:34.210 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-09-21T06:01:34.216 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:01:34.216 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:01:34.223 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:01:34.223 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-21T06:01:34.230 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-21T06:01:34.237 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-21T06:01:34.237 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:01:34.237 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-09-21T06:01:34.237 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:01:34.237 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 139715672115568 on /run/cephadm/dc6785ee-77de-11ef-baf5-efdc52797490.lock 2024-09-21T06:01:34.237 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 139715672115568 acquired on /run/cephadm/dc6785ee-77de-11ef-baf5-efdc52797490.lock 2024-09-21T06:01:34.238 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-09-21T06:01:34.238 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-09-21T06:01:34.238 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-21T06:01:34.241 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-09-21T06:01:34.241 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-09-21T06:01:34.244 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:01:34.244 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T06:01:34.244 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-09-21T06:01:34.246 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:01:34.246 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:01:34.246 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:01:34.247 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T06:01:34.247 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-21T06:01:34.247 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:01:34.247 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-21T06:01:34.247 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-21T06:01:34.247 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:01:34.248 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:01:34.248 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:01:34.731 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:01:34.731 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:01:34.731 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:01:34.731 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:01:34.732 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:01:34.732 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:01:34.732 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:01:35.669 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:01:35.669 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:01:35.669 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:01:36.600 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-09-21T06:01:36.600 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-09-21T06:01:41.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBAYe5myCpmORAAyk725i7o4d5Vd4Pa3/kq6Q== 2024-09-21T06:01:50.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBHYe5mglESMBAAuS+HXjSlVWJoD4VxBsMiAw== 2024-09-21T06:01:51.625 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBPYe5m2aD1ARAAJ2Lo+1XcTUnHheElJqUNGA== 2024-09-21T06:01:51.626 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-09-21T06:01:52.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:01:52.555 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:01:52.556 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-09-21T06:01:53.528 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2024-09-21T06:01:53.715 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:01:53.864 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:01:54.061 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-dc6785ee-77de-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-dc6785ee-77de-11ef-baf5-efdc52797490.target. 2024-09-21T06:01:54.062 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-dc6785ee-77de-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-dc6785ee-77de-11ef-baf5-efdc52797490.target. 2024-09-21T06:01:54.315 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:01:54.315 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:01:54.487 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dc6785ee-77de-11ef-baf5-efdc52797490.target.wants/ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-dc6785ee-77de-11ef-baf5-efdc52797490@.service. 2024-09-21T06:01:54.987 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:54 smithi017 ceph-mon[30711]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:01:54.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:54 smithi017 bash[30693]: 48009763ebdbbb838799c32346d45f3a55028f00137a1a1f050b295ca6a13653 2024-09-21T06:01:55.001 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:01:55.001 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-21T06:01:55.009 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:01:55.009 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-21T06:01:55.009 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-21T06:01:55.009 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:01:55.009 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-09-21T06:01:55.009 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-09-21T06:01:55.238 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:54 smithi017 systemd[1]: Started Ceph mon.a for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: monmap epoch 1 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: last_changed 2024-09-21T06:01:51.971318+0000 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: min_mon_release 19 (squid) 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: election_strategy: 1 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: fsmap 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: mgrmap e1: no daemons active 2024-09-21T06:01:56.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:55 smithi017 ceph-mon[30711]: from='client.? 172.21.15.17:0/2389688966' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T06:01:57.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:01:57.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:01:57.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.53998s) 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:01:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:01:57.473 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-09-21T06:01:57.473 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:01:58.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:58 smithi017 ceph-mon[30711]: from='client.? 172.21.15.17:0/1523057947' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:01:58.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:58 smithi017 ceph-mon[30711]: from='client.? 172.21.15.17:0/1523057947' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:01:58.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:01:58.604 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-09-21T06:01:59.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:59 smithi017 ceph-mon[30711]: from='client.? 172.21.15.17:0/2813357786' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:01:59.633 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-09-21T06:01:59.891 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:59 smithi017 systemd[1]: Stopping Ceph mon.a for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:02:00.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a[30707]: 2024-09-21T06:01:59.915+0000 7f774c995640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:02:00.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:01:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a[30707]: 2024-09-21T06:01:59.915+0000 7f774c995640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:02:00.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 podman[30956]: 2024-09-21 06:02:00.027883158 +0000 UTC m=+0.216245285 container died 48009763ebdbbb838799c32346d45f3a55028f00137a1a1f050b295ca6a13653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:02:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 podman[30956]: 2024-09-21 06:02:00.37298456 +0000 UTC m=+0.561346691 container cleanup 48009763ebdbbb838799c32346d45f3a55028f00137a1a1f050b295ca6a13653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:02:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 bash[30956]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:02:01.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 podman[30967]: 2024-09-21 06:02:00.65805609 +0000 UTC m=+0.630426095 container remove 48009763ebdbbb838799c32346d45f3a55028f00137a1a1f050b295ca6a13653 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:02:01.018 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:02:01.018 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 systemd[1]: Stopped Ceph mon.a for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:02:01.018 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:00 smithi017 systemd[1]: Starting Ceph mon.a for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:02:01.378 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 podman[31061]: 2024-09-21 06:02:00.919210656 +0000 UTC m=+0.016373512 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:02:01.378 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 podman[31061]: 2024-09-21 06:02:01.25834067 +0000 UTC m=+0.355503517 container create 82321d5f106e85835f6bf0f9793190fa7bd52b4d39a62575a2a844cba963759e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T06:02:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 podman[31061]: 2024-09-21 06:02:01.468961316 +0000 UTC m=+0.566124167 container init 82321d5f106e85835f6bf0f9793190fa7bd52b4d39a62575a2a844cba963759e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 podman[31061]: 2024-09-21 06:02:01.472322263 +0000 UTC m=+0.569485108 container start 82321d5f106e85835f6bf0f9793190fa7bd52b4d39a62575a2a844cba963759e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: pidfile_write: ignore empty --pid-file 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: load: jerasure load: lrc 2024-09-21T06:02:01.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Git sha 0 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: DB SUMMARY 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: DB Session ID: MHCLKWMKRQGFTOUJIVKV 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94292 ; 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:02:01.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:02:01.640 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.env: 0x55929fa50d60 2024-09-21T06:02:01.640 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:02:01.640 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.info_log: 0x5592a5fdb360 2024-09-21T06:02:01.640 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.statistics: (nil) 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.use_fsync: 0 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:02:01.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.db_log_dir: 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.wal_dir: 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:02:01.642 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.write_buffer_manager: 0x5592a5fdfd60 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.unordered_write: 0 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:02:01.643 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.row_cache: None 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.wal_filter: None 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.wal_compression: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:02:01.644 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:02:01.645 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_open_files: -1 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Compression algorithms supported: 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kZSTD supported: 0 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:02:01.646 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.merge_operator: 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_filter: None 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:02:01.647 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5592a5fdafa0) 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x5592a1f9f610 2024-09-21T06:02:01.648 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2024-09-21T06:02:01.649 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression: NoCompression 2024-09-21T06:02:01.650 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.num_levels: 7 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:02:01.651 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:02:01.652 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:02:01.653 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:02:01.654 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:02:01.655 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.ttl: 2592000 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:02:01.656 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4d699f98-997e-4cda-a4e6-fa34f9e7a13a 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726898521511563, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726898521513521, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90596, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 281, "table_properties": {"data_size": 88637, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11462, "raw_average_key_size": 47, "raw_value_size": 82117, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726898521, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4d699f98-997e-4cda-a4e6-fa34f9e7a13a", "db_session_id": "MHCLKWMKRQGFTOUJIVKV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726898521513669, "job": 1, "event": "recovery_finished"} 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5592a5ffea80 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: DB pointer 0x5592a6da4000 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:02:01.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 90.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:02:01.658 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 90.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:02:01.659 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 15.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 15.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x5592a1f9f610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???) e1 preinit fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).mds e1 new map 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: btime 2024-09-21T06:01:54:962031+0000 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:02:01.660 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 ceph-mon[31080]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 bash[31061]: 82321d5f106e85835f6bf0f9793190fa7bd52b4d39a62575a2a844cba963759e 2024-09-21T06:02:01.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:01 smithi017 systemd[1]: Started Ceph mon.a for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:02:02.660 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: monmap epoch 1 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: last_changed 2024-09-21T06:01:51.971318+0000 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: min_mon_release 19 (squid) 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: election_strategy: 1 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: fsmap 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: mgrmap e1: no daemons active 2024-09-21T06:02:02.661 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:02 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1936847363' entity='client.admin' 2024-09-21T06:02:02.663 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:02:02.684 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:02:02.685 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-09-21T06:02:02.685 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:02:02.685 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:02:02.942 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:02:02.942 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:02:03.096 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-dc6785ee-77de-11ef-baf5-efdc52797490.target.wants/ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-dc6785ee-77de-11ef-baf5-efdc52797490@.service. 2024-09-21T06:02:03.320 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 systemd[1]: Starting Ceph mgr.x for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:02:03.581 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 podman[31292]: 2024-09-21 06:02:03.319328131 +0000 UTC m=+0.109022595 container create f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:02:03.581 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 podman[31292]: 2024-09-21 06:02:03.226664652 +0000 UTC m=+0.016359126 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:02:03.581 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 podman[31292]: 2024-09-21 06:02:03.504848327 +0000 UTC m=+0.294542801 container init f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:02:03.581 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 podman[31292]: 2024-09-21 06:02:03.507643955 +0000 UTC m=+0.297338417 container start f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:02:03.581 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 bash[31292]: f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b 2024-09-21T06:02:03.595 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:02:03.595 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-21T06:02:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:02:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-21T06:02:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-21T06:02:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:02:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:02:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-21T06:02:03.622 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:02:03.622 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-21T06:02:03.622 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-21T06:02:03.622 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:02:03.622 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-09-21T06:02:03.622 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-09-21T06:02:03.844 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:03 smithi017 systemd[1]: Started Ceph mgr.x for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:02:04.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:04 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3870260930' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:02:04.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:02:04.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:04.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:02:04.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:02:04.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:02:04.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:02:04.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:02:04.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:02:04.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:01:54:962031+0000", 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:02:04.765 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:01:54.962816+0000", 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:04.766 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:02:07.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:07 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2788447899' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:02:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:02:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:02:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:02:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:02:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:02:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:02:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:02:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:01:54:962031+0000", 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:02:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:01:54.962816+0000", 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:02:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: Activating manager daemon x 2024-09-21T06:02:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: mgrmap e2: x(active, starting, since 0.00372758s) 2024-09-21T06:02:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:02:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: Manager daemon x is now available 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' 2024-09-21T06:02:09.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:08 smithi017 ceph-mon[31080]: from='mgr.14100 172.21.15.17:0/1165660244' entity='mgr.x' 2024-09-21T06:02:11.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:10 smithi017 ceph-mon[31080]: mgrmap e3: x(active, since 1.00825s) 2024-09-21T06:02:11.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:10 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1320239073' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:02:11.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:02:11.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:11.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:02:11.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:02:11.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:02:11.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:02:11.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:01:54:962031+0000", 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:02:11.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:01:54.962816+0000", 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:11.136 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-09-21T06:02:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:11 smithi017 ceph-mon[31080]: mgrmap e4: x(active, since 2s) 2024-09-21T06:02:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:11 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3050147091' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:02:12.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:02:12.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:02:12.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:12.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:02:12.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:02:12.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:02:12.461 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-09-21T06:02:13.486 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:13 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1402412169' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:02:13.487 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:13 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: ignoring --setuser ceph since I am not root 2024-09-21T06:02:13.487 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:13 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: ignoring --setgroup ceph since I am not root 2024-09-21T06:02:14.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:14 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1402412169' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:02:14.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:14 smithi017 ceph-mon[31080]: mgrmap e5: x(active, since 4s) 2024-09-21T06:02:15.079 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:15.079 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:02:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:02:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:02:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:02:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-21T06:02:15.080 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-09-21T06:02:15.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:15 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/318606325' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:02:18.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: Active manager daemon x restarted 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: Activating manager daemon x 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: mgrmap e6: x(active, starting, since 0.00343906s) 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:02:18.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:18 smithi017 ceph-mon[31080]: Manager daemon x is now available 2024-09-21T06:02:20.118 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:20.118 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:02:20.118 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:02:20.118 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:20.118 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-09-21T06:02:20.118 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:02:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:02:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: mgrmap e7: x(active, since 1.00628s) 2024-09-21T06:02:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:20 smithi017 ceph-mon[31080]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:02:21.387 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:02:21.122+0000 7f45ade68640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:02:21] ENGINE Error in HTTPServer.serve 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: Traceback (most recent call last): 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self._connections.run(self.expiration_interval) 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self._run(expiration_interval) 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:02:21.388 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: s = self.context.wrap_socket( 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: return self.sslsocket_class._create( 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self.do_handshake() 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self._sslobj.do_handshake() 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:02:21.389 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1151494951' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:21] ENGINE Bus STARTING 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:21] ENGINE Serving on https://172.21.15.17:7150 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:21] ENGINE Error in HTTPServer.serve 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:02:21.790 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-21T06:02:21.791 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:02:21.792 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:21] ENGINE Serving on http://172.21.15.17:8765 2024-09-21T06:02:21.792 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:21] ENGINE Bus STARTED 2024-09-21T06:02:21.792 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:21 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:22.068 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:02:22.068 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:02:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:22 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1151494951' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:02:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:22 smithi017 ceph-mon[31080]: mgrmap e8: x(active, since 2s) 2024-09-21T06:02:23.970 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:23 smithi017 ceph-mon[31080]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:23 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:23.971 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:23 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:24.546 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:02:24.546 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-09-21T06:02:24.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:24 smithi017 ceph-mon[31080]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:25.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-mon[31080]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:25.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-mon[31080]: Generating ssh key... 2024-09-21T06:02:25.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:25.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:25.874 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: Generating public/private rsa key pair. 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: Your identification has been saved in /tmp/tmp8zs7if5v/key 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: Your public key has been saved in /tmp/tmp8zs7if5v/key.pub 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: The key fingerprint is: 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: SHA256:1eR0nkLoQBfkgslwLXLzYp7+AeoNq9oLGQ5NlTm1p6Q ceph-dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: The key's randomart image is: 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: +---[RSA 3072]----+ 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: | o+oo..+o+ . | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: | .=+++oo.* o . | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: | . +*+ooo + o | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: | o ooo.o. . | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: |o . EoooS | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: |oo .o. | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: |o. o. . | 2024-09-21T06:02:25.875 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: | o . +. . | 2024-09-21T06:02:25.876 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: |..+oo ... | 2024-09-21T06:02:25.876 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: +----[SHA256]-----+ 2024-09-21T06:02:27.224 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:27.225 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:02:27.225 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:02:27.236 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-09-21T06:02:27.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:27 smithi017 ceph-mon[31080]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:28.541 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:28 smithi017 ceph-mon[31080]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:29.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:29 smithi017 ceph-mon[31080]: Deploying cephadm binary to smithi017 2024-09-21T06:02:32.223 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-09-21T06:02:32.223 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2024-09-21T06:02:32.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:32 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:32.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:32 smithi017 ceph-mon[31080]: Added host smithi017 2024-09-21T06:02:32.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:32 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:02:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2024-09-21T06:02:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:33 smithi017 ceph-mon[31080]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:33 smithi017 ceph-mon[31080]: Saving service mon spec with placement count:5 2024-09-21T06:02:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:33 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:35.733 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:35 smithi017 ceph-mon[31080]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:35.733 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:35 smithi017 ceph-mon[31080]: Saving service mgr spec with placement count:2 2024-09-21T06:02:35.733 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:35 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:35.733 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:35 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:02:37.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:37 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:37.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:37 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1989859948' entity='client.admin' 2024-09-21T06:02:38.291 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-09-21T06:02:38.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:38 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2328258145' entity='client.admin' 2024-09-21T06:02:40.082 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: ignoring --setuser ceph since I am not root 2024-09-21T06:02:40.082 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: ignoring --setgroup ceph since I am not root 2024-09-21T06:02:40.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:39 smithi017 ceph-mon[31080]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:02:40.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:39 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:40.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:39 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1851846543' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:02:40.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:39 smithi017 ceph-mon[31080]: from='mgr.14118 172.21.15.17:0/161802455' entity='mgr.x' 2024-09-21T06:02:40.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:40 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1851846543' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:02:40.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:40 smithi017 ceph-mon[31080]: mgrmap e9: x(active, since 21s) 2024-09-21T06:02:42.315 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:42 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3213023797' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-21T06:02:42.603 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-09-21T06:02:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: Active manager daemon x restarted 2024-09-21T06:02:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: Activating manager daemon x 2024-09-21T06:02:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:02:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: mgrmap e10: x(active, starting, since 0.00433621s) 2024-09-21T06:02:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:02:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:02:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:02:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:02:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:02:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:45 smithi017 ceph-mon[31080]: Manager daemon x is now available 2024-09-21T06:02:46.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:46.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:02:46.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:02:46.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-mon[31080]: mgrmap e11: x(active, since 1.00698s) 2024-09-21T06:02:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:02:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T06:02:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:02:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:02:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-09-21T06:02:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:02:46.762+0000 7f4b9b810640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:02:46] ENGINE Error in HTTPServer.serve 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: Traceback (most recent call last): 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self._connections.run(self.expiration_interval) 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self._run(expiration_interval) 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:02:46.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: s = self.context.wrap_socket( 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: return self.sslsocket_class._create( 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self.do_handshake() 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: self._sslobj.do_handshake() 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:02:46.833 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:02:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:02:47.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:47 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:46] ENGINE Bus STARTING 2024-09-21T06:02:48.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:46] ENGINE Serving on https://172.21.15.17:7150 2024-09-21T06:02:48.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:46] ENGINE Error in HTTPServer.serve 2024-09-21T06:02:48.387 INFO:journalctl@ceph.mon.a.smithi017.stdout: Traceback (most recent call last): 2024-09-21T06:02:48.387 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:02:48.387 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._run(expiration_interval) 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: s = self.context.wrap_socket( 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: return self.sslsocket_class._create( 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: self.do_handshake() 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: self._sslobj.do_handshake() 2024-09-21T06:02:48.388 INFO:journalctl@ceph.mon.a.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:02:48.389 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:46] ENGINE Serving on http://172.21.15.17:8765 2024-09-21T06:02:48.389 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: [21/Sep/2024:06:02:46] ENGINE Bus STARTED 2024-09-21T06:02:48.389 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: mgrmap e12: x(active, since 2s) 2024-09-21T06:02:48.389 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:48.389 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:48.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUcp/5rCyZut5CWj4xk6EpBS/Cg5swDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2MDI0OFoXDTM0\nMDkyMjA2MDI0OFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjE3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA3ybtRMCsVr4Op3zscyhCt7b9mZlqlgIrBk9k\nz5ZUtRNvmAhedfvUGHKFx3ZZU0Zv1WpbcFCQ/s9oSnwLFux1uni+q+E6WQf10ftt\nIHElPdq5qlbnmPyf/KPdMzMRM0aV5SVVIMKWLbHPvzoXG5KgSXU9p6L7Tff3/XPl\niLJo1rHCOIUi+H3jzauu42dMy7OleV32dZcm2JZvMuHHcnSbBvJ5N+MSAExgKIGP\nrhDnDRsZNStlD9Iq9gZPbXv8zOaAqN32gzxStsvEwCOETT1wcs3WHSTzDmK4CaG4\nSognMkeDrqGu/Cm8+tUbFaSZ/1Ouwsd50UY1wXUn/6UBXKtUezlUFF8VFmys16cA\nAhE13WsIfASSCW41GC8x2+veWfeR/AC/v9qCQW7tbEbSEaZ5BE41bIsnpXDhvFZQ\nsTVackoVn273Qw3qXOCIgZIB1CSDW6fW/9oor+BCvVeOGdW3IosSUjtlRIzkny3g\n2toMaQeGN+BrMQJ/UaJ8NCnq3z1gT10mBv0SqSJFGqWuM2jOmulBTuer2p5dycY4\nn13ZMPmdSxkWRhmIVxdOfQ3ktt+x9B2h7QOXeIuvgSGvwMb7dP6EVRCzIPMF3/32\n34E1DeMRUog7BieapDdYcrDqRQ7LPnmXo0iQ5yYjjcBTLNKk3xaXoVU9NMfBF7Z8\ntsCbgOkCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDE3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPETAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAZ\nzGo3aUu/2iiGR/+cYCHSNuEwKBl+Mh1xfABDxeI4CfnHvN+v9Qn2sWF5mepDUSvX\noZPAub7LmCVBi9vguagGSGqYOHgQ+eZ2HyT2M+P9mAg+KEFfpQGkCx++MtByR49d\nvEIcgnYA3GSZh6md/4YCoK9Ls9Pu40wEydsR3C7Y9t2YV5XFcaIchX/CZgadZ/xy\nkeeOerPdJlusMz8ibgBLFaBOBlCxbbgVyWNIdlO8fl42H0eCEquyiWpgmvB3Yt+f\nyMYbz0aLDqfR7dV3AxP7mcdVubU90LIcyMrQoCYNhu3wMOLvisxWv8mGwH1pAvG8\nu4bimzfE8HdPQSxzra/q9jc03x49NQy6pjdpTF05GBDx/xKYh8tHMSKoZPUNPdDR\nK66rCCyEViGwrzIVX4qI6UWkDmR1eQdzCFxkjgQMUBjaq9w8G5HLYD9Qv4O0KUAH\nonftmM+dL5GBSy3p/moyTmtf+l8CNHOJ58wTB9NnaUlJhHuNWdIToXssgijFuTK9\nJ+Nbu7wFmeYHlqbo86LvVS2uHPIJ2JwAJz7aBhsScOiQiFcJxITv/6bpIVtwD7CC\nLYRQiKj1u7Qj9TQ5LILA9k8At9oaWIjxboGEMHUAqWQ19WZyqq/Bnaq8969JojqL\nQc0rn1MEWLYNxVWsDgDJX1Ji+FDUOFY8Pddh6IjfVw==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA3ybtRMCsVr4Op3zscyhCt7b9mZlqlgIrBk9kz5ZUtRNvmAhe\ndfvUGHKFx3ZZU0Zv1WpbcFCQ/s9oSnwLFux1uni+q+E6WQf10fttIHElPdq5qlbn\nmPyf/KPdMzMRM0aV5SVVIMKWLbHPvzoXG5KgSXU9p6L7Tff3/XPliLJo1rHCOIUi\n+H3jzauu42dMy7OleV32dZcm2JZvMuHHcnSbBvJ5N+MSAExgKIGPrhDnDRsZNStl\nD9Iq9gZPbXv8zOaAqN32gzxStsvEwCOETT1wcs3WHSTzDmK4CaG4SognMkeDrqGu\n/Cm8+tUbFaSZ/1Ouwsd50UY1wXUn/6UBXKtUezlUFF8VFmys16cAAhE13WsIfASS\nCW41GC8x2+veWfeR/AC/v9qCQW7tbEbSEaZ5BE41bIsnpXDhvFZQsTVackoVn273\nQw3qXOCIgZIB1CSDW6fW/9oor+BCvVeOGdW3IosSUjtlRIzkny3g2toMaQeGN+Br\nMQJ/UaJ8NCnq3z1gT10mBv0SqSJFGqWuM2jOmulBTuer2p5dycY4n13ZMPmdSxkW\nRhmIVxdOfQ3ktt+x9B2h7QOXeIuvgSGvwMb7dP6EVRCzIPMF3/3234E1DeMRUog7\nBieapDdYcrDqRQ7LPnmXo0iQ5yYjjcBTLNKk3xaXoVU9NMfBF7Z8tsCbgOkCAwEA\nAQKCAf8w7DfYeuVNnx1XWuv70zfNTzEKG7hiatdD6uQPHsYzbK9qhWswMqWtNm5d\n7HRo7WhXQZoKZZ9kPdR/f/JudCjbWN10kUxZeIVMI/MoyaWAihNqZOMhh0EMAmDc\neLWsqCz0r9qZ9A84tWL2aaXnRZ4efLWnqvOthE+6IU6RSYvyhcYu3gFsuSzYSmtt\nL5iGkDwW/6Ko5Rp/IXv/i8BON4JFY6NvvTiVGCl8t+roHoyJMwezwG/HqCwDBB8l\nwakKwv4yB3ekDfWUXdgkx6SZyn58rOPkP9WJsdrnQa1FqdPuEf+sqYXTgtMLquzl\nMdERSSdnTJRIbTwbzbOXOHWz+1vpvyy7qSHOe6HaF+iqt3MqU4h70leajJVgACzT\nNCTNCMFyANQ073lid1WHUsid23u/efZ6Tbam+LUF3Bm31AxjQ5lyhVhgjjddDR0U\nUwioMac3pihIAHvBT0NzkZibW16nkRAnqkCpW6mkCBxbBq0cGhGGRZoZdAYRSTbk\ndbEpIOIbMftzC8yKmamKOplfYWF1qflz5v9qxkoFbpJRUwoI/mHEtQQlOO3KSAr6\nl3lqpv8dDfjI5uAocSZ8h+WqKue1Prwasr5Cd87Y43LRcHehMDbMyG9QYE7Zcwj8\nR+xyV8yrtC2dmf3JayECVLEIpHw5t8CMCogS/KgGYh7Hox/xAoIBAQD2125MAmzo\nkwLxl4bs4J0KZxbYf1s/AC8ngsEssBNBSyjyRsJclEQ2CsRfvoBplrtgFsRsMUl9\nTOZhPkgK/poe4xkp33Jk6Hh7oDipboKqM2RZn0tMlpktj49eBXTZCwnik7g+Icy4\nNbHT8H555rAYn0a+iwyRbkg3QF5IF7iKePneimq4c7NpCTgs4hVEgTeWUlmG5U71\nJo9QOzZhpc/y/6dd99jQIpOkAsvnZjSVQcxjg5A8elIfmWrRazzvumMFTWg1r+es\nyDfqr0XhBpOb35+ndXyIa3sZgt2KOObwhIS2fHQR65sK5ny7c2SZWpsCom0gy44p\nknZNpbLr47lRAoIBAQDnbnyiOib+9qoO35jJt0lhb4Sfd/A/dR0Zs1II35LfEeSw\n2z1IpmZnNewsWfhc7TUodGOgp+EYJIpkQoTbmiVs0uoRlbbivLPZ5NaXGNHdPrIU\nEBy8QaosDuyaGc2uqudYQAORWxCytKJYOLb58cno9TCT5m5Pb5aLlj8jAezKpmfz\nqBBzYY3YO9C5KSkReOEf65NNnb9xikMlLLwh6eZK172NWUFv1FEHukFbKYSQZK4M\n+OUNFOUdtXyvcc48bGY95PCVAkaQn20F9SAfvCHDoYC3yjoXgDvl6mfOu7uMVXy9\nhg6UO8H4RfL7+g6KKl6E820F5yWtqkzYf5t1XegZAoIBAQDYGJWo2V665Sjok/09\nFw6kcsefVS9uohyl/GRdWPAic0gvgh7ZqbtljFuKbl5BEgKMBqKDDUsG9PGjJEEx\nzt7iN3JqJAIjsRj5MbUpL2QY2ND7XOcw746+QjYC28gF0xIeV7AuRKzSf79kieBP\nm9OCWr42RckE8IUsSZ/AgXO/VlV5q7fuLuxcAgQ51ttDk9Q0N3fFDq7nE5DXbl8X\ncW/xjjrZmwcmf369UO1tcR6LpITogd8d8wA+RbMsDzPTs1rI45Fdnte1fbrmK/eD\nHpzPEyDUG5igXWfxV43XWiVjXsBIef+rSJX9HvcHq+fgEWAvGD9tPIcCggQryeov\ndLdhAoIBAQCT/X8NbgpJuAn/ANR/CQmPmPRB1Tx4F7fIG3c13WHZ62NGBKwnrOCG\n12By7AV5xuXbPLIIpdG20ob8ndy/YM7Vy/mJzSbpzqljiIYAkQqCY/kUA0mcyJC9\nI74AvMdeDkNpl2WwqX8AB6pYp8u6APeQVFn/+bZIbZ7jG+y7whtdaxPGJ459ecBu\nqbFK9hsg5R9wff/v/hPR0wwk1XpoZV2yNksr/AtwK2C1hFEOrnnqq7bw7KfruZTZ\nbpiQyEGNOfQXWDLP1mixSoE48grcwD0HEFtzK4oCRSoIV+CRvlKr5m6h8vuXpq7e\nyDwdDUYG7BkNA2yP/cOGTgRd3RvX7XjhAoIBAH2ctiwRxPhArEhEobWrfcBrXJDZ\nsiuPcsDbLa6VGy36RUvYEyvVxqL9ukGAdnYYjKKnKaUXEMN8jv0vuewu5OVMvdY2\nAWCj2mJq6huqtuqguIu+0cJU34ml1BlrRzAs3sVLSX8WWpDTYUP69Fmop8A4Yd8x\n21Ovgu0jV2qym5aFlPznqVsKtz9YGxF0jV8rxPVP+AAGec4Y4ywBZ2TP69TZGb+2\neCzqaI8iXv0pXg4lqsC9y5ECVCu6wqiKZl5h4ipNFPgMKa9FIleogxqteE8VtMIv\nBBEaq3cAhvrjqg3qa/D/8GOD3flbeC998nilMvS3aY5APBw407AIIM+csvA=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T06:02:49.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:50.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T06:02:51.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:50 smithi017 ceph-mon[31080]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:51.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:51.987 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T06:02:51.988 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-09-21T06:02:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:52 smithi017 ceph-mon[31080]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:52 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:53.410 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$AB6K3Hmuw5DOazcaDNfDZ.UxWVmHNq.3XlpTg60V2peqJCr43pyZ.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726898572, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T06:02:53.410 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-09-21T06:02:53.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:53 smithi017 ceph-mon[31080]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:02:53.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:54.588 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1569158187' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T06:02:54.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T06:02:54.601 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:02:54.601 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-21T06:02:54.608 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:02:54.609 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-21T06:02:54.609 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-21T06:02:54.609 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: Password: jvdtf4kjq3 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config directory 2024-09-21T06:02:55.947 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-09-21T06:02:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.949 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-09-21T06:02:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T06:02:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:02:55.949 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-09-21T06:02:55.990 INFO:tasks.cephadm:Fetching config... 2024-09-21T06:02:55.990 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:02:55.990 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T06:02:56.007 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T06:02:56.007 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:02:56.007 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T06:02:56.063 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T06:02:56.063 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:02:56.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T06:02:56.128 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T06:02:56.128 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:02:56.129 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T06:02:56.185 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T06:02:56.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:02:56.267 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:56.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:02:56.377 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:56 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1329972458' entity='client.admin' 2024-09-21T06:02:56.378 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:56.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:02:56.538 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Njn5t1CJL7y4x87gZ5nBDiPl+SXphVQ4MSUy9bcs22r1v4gkGOGwlFoAIbZRQ1iPtSFkGccdgQ1dzVQtEqusfxWSBV+iDjIuDdoLE1U29A1jDDldkHxyE4EeMTmTjFFEciGknZrEcEch9A15mERIa1MhH1b/wDi56AZf8AY8QPFLKwz0kqAAab3I0ETHIRZbJ6MN/h3WzbgEhFqrcJZ8ejUJL3sQiRkVehQg6TmP9XgQIdeK0TTGzmDwo4jTA/n6J2eXzlt7WoE/AOfvwNZWz6KYcsPRDeDOWo1PU5CrM1kCTSabRHtwx7hLF0Ewt5VkAETIT8/jRauoC/TGLRvxFB3PCtN1IbWAMZmORnH+jWvmU7q2YwZ7W6WTjOmlQ38/2mn4x3cUPAmy0d7iR3ArXYJnckQO3jwykCuj3HkCtwNlJpAswrKP8x0wAEKBrbJlDNg9Owo2CHe378UwhkzPLbGDuWCTUlUqCA/iBSblXAPE9AKWGN3Dy+ss1x9zOT8= ceph-dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:02:56.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T06:02:56.835 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:02:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: mgrmap e13: x(active, since 12s) 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2808591402' entity='client.admin' 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"} : dispatch 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:02:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:02:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:02:58.864 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T06:02:58.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T06:02:59.173 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:00.507 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi081 2024-09-21T06:03:00.507 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:03:00.507 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:03:00.528 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:03:00.528 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:00.587 INFO:tasks.cephadm:Adding host smithi081 to orchestrator... 2024-09-21T06:03:00.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch host add smithi081 2024-09-21T06:03:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:01.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: Updating smithi017:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: Updating smithi017:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:01.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:01 smithi017 ceph-mon[31080]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:02 smithi017 ceph-mon[31080]: Deploying cephadm binary to smithi081 2024-09-21T06:03:05.347 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi081' with addr '172.21.15.81' 2024-09-21T06:03:05.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:03:06.172 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:06.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:06 smithi017 ceph-mon[31080]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:06.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:06 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:06.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:06 smithi017 ceph-mon[31080]: Added host smithi081 2024-09-21T06:03:06.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:06 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:06.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:06 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:06.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:06 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:06.963 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:03:06.963 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}] 2024-09-21T06:03:07.712 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:07.747 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi089 2024-09-21T06:03:07.747 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:03:07.747 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:03:07.764 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:03:07.764 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:07.819 INFO:tasks.cephadm:Adding host smithi089 to orchestrator... 2024-09-21T06:03:07.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch host add smithi089 2024-09-21T06:03:08.078 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:08.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:08 smithi017 ceph-mon[31080]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:03:08.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:08 smithi017 ceph-mon[31080]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:10.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"} : dispatch 2024-09-21T06:03:10.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:10.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:10 smithi017 ceph-mon[31080]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:10 smithi017 ceph-mon[31080]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T06:03:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:10 smithi017 ceph-mon[31080]: Updating smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:11.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:11 smithi017 ceph-mon[31080]: Deploying cephadm binary to smithi089 2024-09-21T06:03:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:11 smithi017 ceph-mon[31080]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:11 smithi017 ceph-mon[31080]: Updating smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:03:12.430 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi089' with addr '172.21.15.89' 2024-09-21T06:03:12.751 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:12 smithi017 ceph-mon[31080]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:12.751 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:12.751 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:12.751 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:13.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:03:13.326 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:13.713 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:13 smithi017 ceph-mon[31080]: Added host smithi089 2024-09-21T06:03:13.713 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:14.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:03:14.012 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}] 2024-09-21T06:03:14.808 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T06:03:14.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T06:03:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:14 smithi017 ceph-mon[31080]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:14 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:15.741 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-21T06:03:15.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:15 smithi017 ceph-mon[31080]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:03:15.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:15 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/752601888' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:03:16.310 INFO:tasks.cephadm:Adding mon.a on smithi017 2024-09-21T06:03:16.310 INFO:tasks.cephadm:Adding mon.b on smithi081 2024-09-21T06:03:16.311 INFO:tasks.cephadm:Adding mon.c on smithi089 2024-09-21T06:03:16.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi081:172.21.15.81=b;smithi089:172.21.15.89=c' 2024-09-21T06:03:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/752601888' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"} : dispatch 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:17.211 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mon update... 2024-09-21T06:03:17.723 DEBUG:teuthology.orchestra.run.smithi081:mon.b> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T06:03:17.726 DEBUG:teuthology.orchestra.run.smithi089:mon.c> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T06:03:17.728 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:03:17.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:03:18.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:18.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:18 smithi017 ceph-mon[31080]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:18 smithi017 ceph-mon[31080]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi081:172.21.15.81=b;smithi089:172.21.15.89=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:18 smithi017 ceph-mon[31080]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi081:172.21.15.81=b;smithi089:172.21.15.89=c;count:3 2024-09-21T06:03:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:18 smithi017 ceph-mon[31080]: Deploying daemon mon.c on smithi089 2024-09-21T06:03:19.728 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:03:20.571 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:03:20.571 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":1,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","modified":"2024-09-21T06:01:51.971318Z","created":"2024-09-21T06:01:51.971318Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:03:20.571 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 1 2024-09-21T06:03:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:20 smithi017 ceph-mon[31080]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:20 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/1295546227' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:21.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:21 smithi089 systemd[1]: Started Ceph mon.c for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:03:22.368 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:03:22.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:03:22.627 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:03:27.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:03:27.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: mon.a calling monitor election 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: mon.c calling monitor election 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: monmap epoch 2 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: last_changed 2024-09-21T06:03:21.767455+0000 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:03:27.119 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: min_mon_release 19 (squid) 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: election_strategy: 1 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.c 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: fsmap 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: mgrmap e13: x(active, since 41s) 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: overall HEALTH_OK 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:27.120 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:27.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:03:27.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: mon.a calling monitor election 2024-09-21T06:03:27.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: mon.c calling monitor election 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: monmap epoch 2 2024-09-21T06:03:27.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: last_changed 2024-09-21T06:03:21.767455+0000 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: min_mon_release 19 (squid) 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: election_strategy: 1 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.c 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: fsmap 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:27.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: mgrmap e13: x(active, since 41s) 2024-09-21T06:03:27.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: overall HEALTH_OK 2024-09-21T06:03:27.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:27.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:27.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:27.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:27.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:27.706 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:03:27.706 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","modified":"2024-09-21T06:03:21.767455Z","created":"2024-09-21T06:01:51.971318Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:03:27.706 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 2 2024-09-21T06:03:28.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:27 smithi089 ceph-mon[33879]: Deploying daemon mon.b on smithi081 2024-09-21T06:03:28.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:27 smithi089 ceph-mon[33879]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:28.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:27 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/3188575066' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:28.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:28.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:27 smithi017 ceph-mon[31080]: Deploying daemon mon.b on smithi081 2024-09-21T06:03:28.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:27 smithi017 ceph-mon[31080]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:28.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:27 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/3188575066' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:28.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:29.339 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:03:29.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:03:29.591 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:03:30.281 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:03:30.281 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","modified":"2024-09-21T06:03:21.767455Z","created":"2024-09-21T06:01:51.971318Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:03:30.281 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 2 2024-09-21T06:03:30.282 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:30 smithi089 ceph-mon[33879]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:30.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:30 smithi017 ceph-mon[31080]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:30.620 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T06:03:30.620 INFO:journalctl@ceph.mon.b.smithi081.stdout: e1 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout: btime 2024-09-21T06:01:54:962031+0000 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout: legacy client fscid: -1 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout: 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout: No filesystems configured 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:03:30.621 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Deploying cephadm binary to smithi089 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Updating smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Added host smithi089 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:30.622 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:30.623 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:03:30.623 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/752601888' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:03:30.623 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:30.623 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/752601888' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:03:30.623 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:30.623 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"} : dispatch 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi081:172.21.15.81=b;smithi089:172.21.15.89=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:31.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi081:172.21.15.81=b;smithi089:172.21.15.89=c;count:3 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Deploying daemon mon.c on smithi089 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/1295546227' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.a calling monitor election 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.c calling monitor election 2024-09-21T06:03:31.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: monmap epoch 2 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: last_changed 2024-09-21T06:03:21.767455+0000 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: min_mon_release 19 (squid) 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: election_strategy: 1 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.c 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: fsmap 2024-09-21T06:03:31.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mgrmap e13: x(active, since 41s) 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: overall HEALTH_OK 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: Deploying daemon mon.b on smithi081 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/3188575066' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 ceph-mon[33870]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 bash[33851]: 12b0bdb4e82101577e07f02b031ce3ec871291dd3493110a5ee102c874b2f3e0 2024-09-21T06:03:31.012 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:30 smithi081 systemd[1]: Started Ceph mon.b for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:03:31.919 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:03:31.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:03:32.170 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: mon.a calling monitor election 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: mon.c calling monitor election 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: mon.b calling monitor election 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: monmap epoch 3 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: last_changed 2024-09-21T06:03:30.624804+0000 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: min_mon_release 19 (squid) 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: election_strategy: 1 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.c 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: 2: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: fsmap 2024-09-21T06:03:36.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:36.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: mgrmap e13: x(active, since 50s) 2024-09-21T06:03:36.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: overall HEALTH_OK 2024-09-21T06:03:36.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: mon.a calling monitor election 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: mon.c calling monitor election 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: mon.b calling monitor election 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: monmap epoch 3 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: last_changed 2024-09-21T06:03:30.624804+0000 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: min_mon_release 19 (squid) 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: election_strategy: 1 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.c 2024-09-21T06:03:36.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: 2: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: fsmap 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: mgrmap e13: x(active, since 50s) 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: overall HEALTH_OK 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.095 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:03:36.095 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":3,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","modified":"2024-09-21T06:03:30.624804Z","created":"2024-09-21T06:01:51.971318Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T06:03:36.096 INFO:teuthology.orchestra.run.smithi089.stderr:dumped monmap epoch 3 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: mon.a calling monitor election 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: mon.c calling monitor election 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: mon.b calling monitor election 2024-09-21T06:03:36.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: monmap epoch 3 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: last_changed 2024-09-21T06:03:30.624804+0000 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: created 2024-09-21T06:01:51.971318+0000 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: min_mon_release 19 (squid) 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: election_strategy: 1 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: 1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.c 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: 2: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: fsmap 2024-09-21T06:03:36.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:03:36.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: mgrmap e13: x(active, since 50s) 2024-09-21T06:03:36.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: overall HEALTH_OK 2024-09-21T06:03:36.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:36 smithi089 ceph-mon[33879]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:36.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:36.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:36 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/4044937903' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:36.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:36.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:36.822 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T06:03:36.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T06:03:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:36 smithi081 ceph-mon[33870]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:36 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/4044937903' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:37.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:36 smithi017 ceph-mon[31080]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:37.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:37.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:36 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/4044937903' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:03:37.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:03:37.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:37.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:37.753 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:37.753 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-21T06:03:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:03:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] 2024-09-21T06:03:38.357 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T06:03:38.357 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:03:38.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:03:38.385 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:03:38.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:38.453 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:03:38.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:03:38.481 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:03:38.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:38.547 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:03:38.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:03:38.577 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:03:38.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:03:38.646 INFO:tasks.cephadm:Adding mgr.x on smithi017 2024-09-21T06:03:38.646 INFO:tasks.cephadm:Adding mgr.y on smithi081 2024-09-21T06:03:38.646 INFO:tasks.cephadm:Adding mgr.z on smithi089 2024-09-21T06:03:38.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi017=x;smithi081=y;smithi089=z' 2024-09-21T06:03:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: Updating smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: Updating smithi017:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3105866985' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:38.760 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:38.773 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: Updating smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: Updating smithi017:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3105866985' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:38.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: Updating smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: Updating smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: Updating smithi017:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3105866985' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:38.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:38.926 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:03:39.571 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mgr update... 2024-09-21T06:03:39.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:03:39.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: Reconfiguring daemon mon.a on smithi017 2024-09-21T06:03:39.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:39.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:39.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:39.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:39.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:39 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:39.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:03:39.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: Reconfiguring daemon mon.a on smithi017 2024-09-21T06:03:39.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:39.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:39.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:39.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:39.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:39 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:03:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: Reconfiguring daemon mon.a on smithi017 2024-09-21T06:03:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:39.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:39.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:39 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:40.123 DEBUG:teuthology.orchestra.run.smithi081:mgr.y> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T06:03:40.126 DEBUG:teuthology.orchestra.run.smithi089:mgr.z> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T06:03:40.128 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T06:03:40.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T06:03:40.131 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T06:03:40.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T06:03:40.174 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T06:03:40.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T06:03:40.217 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:03:40.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T06:03:40.260 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:03:40.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T06:03:40.304 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T06:03:40.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T06:03:40.346 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:03:40.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T06:03:40.389 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T06:03:40.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T06:03:40.431 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:40.433 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T06:03:40.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T06:03:40.478 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T06:03:40.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T06:03:40.521 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T06:03:40.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T06:03:40.565 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T06:03:40.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T06:03:40.612 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T06:03:40.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T06:03:40.656 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:03:40.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T06:03:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:40.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:03:40.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: Reconfiguring daemon mon.b on smithi081 2024-09-21T06:03:40.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi081=y;smithi089=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:40.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: Saving service mgr spec with placement smithi017=x;smithi081=y;smithi089=z;count:3 2024-09-21T06:03:40.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:40.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:40 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:40.690 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:03:40.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T06:03:40.741 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T06:03:40.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T06:03:40.791 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:03:40.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T06:03:40.836 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:03:40.836 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:03:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:03:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: Reconfiguring daemon mon.b on smithi081 2024-09-21T06:03:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi081=y;smithi089=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:40.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: Saving service mgr spec with placement smithi017=x;smithi081=y;smithi089=z;count:3 2024-09-21T06:03:40.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:40.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:40 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:40.880 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:03:40.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:03:40.934 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:03:40.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T06:03:40.988 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T06:03:40.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T06:03:41.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:41.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:03:41.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: Reconfiguring daemon mon.b on smithi081 2024-09-21T06:03:41.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi081=y;smithi089=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:03:41.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: Saving service mgr spec with placement smithi017=x;smithi081=y;smithi089=z;count:3 2024-09-21T06:03:41.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:41.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:40 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:41.035 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T06:03:41.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T06:03:41.079 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T06:03:41.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T06:03:41.124 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:03:41.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:03:41.203 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:03:41.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T06:03:41.254 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:03:41.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T06:03:41.271 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:41.279 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T06:03:41.279 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi017') 2024-09-21T06:03:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:41.475 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:41.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:41.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:41.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:03:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: Reconfiguring daemon mon.c on smithi089 2024-09-21T06:03:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:41 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2728676459' entity='client.admin' 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: Reconfiguring daemon mon.c on smithi089 2024-09-21T06:03:42.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:41 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2728676459' entity='client.admin' 2024-09-21T06:03:42.082 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:42.082 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:42.082 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:03:42.082 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:03:42.082 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:03:42.082 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:42.083 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: Reconfiguring daemon mon.c on smithi089 2024-09-21T06:03:42.083 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:41 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2728676459' entity='client.admin' 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:43.040 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:43.040 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:43.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:43.057 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:43.058 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:43.617 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:43 smithi089 systemd[1]: Starting Ceph mgr.z for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:03:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:43.701 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:43.702 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:43.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:43 smithi017 ceph-mon[31080]: Deploying daemon mgr.z on smithi089 2024-09-21T06:03:43.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:43 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3520422030' entity='client.admin' 2024-09-21T06:03:43.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:43 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2037419286' entity='client.admin' 2024-09-21T06:03:43.956 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:43 smithi089 ceph-mon[33879]: Deploying daemon mgr.z on smithi089 2024-09-21T06:03:43.956 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:43 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3520422030' entity='client.admin' 2024-09-21T06:03:43.956 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:43 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2037419286' entity='client.admin' 2024-09-21T06:03:43.956 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:43 smithi089 podman[35117]: 2024-09-21 06:03:43.578006297 +0000 UTC m=+0.015910170 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:03:43.957 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:43 smithi089 podman[35117]: 2024-09-21 06:03:43.691547828 +0000 UTC m=+0.129451690 container create b145c045349aa45d4812fbfd72ad358f054fa6eb3a3b68ffe5e20952207472e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:03:43.957 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:43 smithi089 podman[35117]: 2024-09-21 06:03:43.918836925 +0000 UTC m=+0.356740797 container init b145c045349aa45d4812fbfd72ad358f054fa6eb3a3b68ffe5e20952207472e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:03:43.957 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:43 smithi089 podman[35117]: 2024-09-21 06:03:43.92177958 +0000 UTC m=+0.359683447 container start b145c045349aa45d4812fbfd72ad358f054fa6eb3a3b68ffe5e20952207472e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:03:43.957 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:43 smithi089 ceph-mgr[35136]: -- 172.21.15.89:0/3789631745 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d78dbd0e0 con 0x563d78ddba80 2024-09-21T06:03:44.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:43 smithi081 ceph-mon[33870]: Deploying daemon mgr.z on smithi089 2024-09-21T06:03:44.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:43 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3520422030' entity='client.admin' 2024-09-21T06:03:44.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:43 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2037419286' entity='client.admin' 2024-09-21T06:03:44.366 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:44 smithi089 bash[35117]: b145c045349aa45d4812fbfd72ad358f054fa6eb3a3b68ffe5e20952207472e8 2024-09-21T06:03:44.366 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:03:44 smithi089 systemd[1]: Started Ceph mgr.z for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:03:44.637 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:44.637 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:44.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:44.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:03:44.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:44.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:03:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:45.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:45 smithi017 ceph-mon[31080]: Deploying daemon mgr.y on smithi081 2024-09-21T06:03:45.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:45 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/81550332' entity='client.admin' 2024-09-21T06:03:45.929 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:45 smithi081 ceph-mon[33870]: Deploying daemon mgr.y on smithi081 2024-09-21T06:03:45.929 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:45 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/81550332' entity='client.admin' 2024-09-21T06:03:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:45 smithi089 ceph-mon[33879]: Deploying daemon mgr.y on smithi081 2024-09-21T06:03:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:45 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/81550332' entity='client.admin' 2024-09-21T06:03:46.183 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:03:46 smithi081 podman[34672]: 2024-09-21 06:03:46.147251532 +0000 UTC m=+0.332404467 container start ec8a87428cd0b78a68e2bb1ecc585b529d51ab4dc956912f25c5688022850dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T06:03:46.183 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mgr[34691]: -- 172.21.15.81:0/3667454010 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616e340b0e0 con 0x5616e81ae480 2024-09-21T06:03:46.507 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:03:46 smithi081 bash[34672]: ec8a87428cd0b78a68e2bb1ecc585b529d51ab4dc956912f25c5688022850dd3 2024-09-21T06:03:46.508 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:03:46 smithi081 systemd[1]: Started Ceph mgr.y for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:03:46.861 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:46.861 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1623122696' entity='client.admin' 2024-09-21T06:03:46.861 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' 2024-09-21T06:03:46.861 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:46.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:46.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:46.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:46.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:46.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:46 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1020536350' entity='client.admin' 2024-09-21T06:03:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1623122696' entity='client.admin' 2024-09-21T06:03:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' 2024-09-21T06:03:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:47.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:46 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1020536350' entity='client.admin' 2024-09-21T06:03:47.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:47.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1623122696' entity='client.admin' 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:47.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:46 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1020536350' entity='client.admin' 2024-09-21T06:03:47.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi017') 2024-09-21T06:03:47.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi017') 2024-09-21T06:03:48.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:48.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:48.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:48 smithi017 ceph-mon[31080]: Reconfiguring daemon mgr.x on smithi017 2024-09-21T06:03:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:48 smithi081 ceph-mon[33870]: Reconfiguring daemon mgr.x on smithi017 2024-09-21T06:03:48.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:48.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:48 smithi089 ceph-mon[33879]: Reconfiguring daemon mgr.x on smithi017 2024-09-21T06:03:48.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 -- 172.21.15.17:0/3652819121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f443803fb20 msgr2=0x7f4438042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 --2- 172.21.15.17:0/3652819121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f443803fb20 0x7f4438042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4434000c00 tx=0x7f4434005ec0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 -- 172.21.15.17:0/3652819121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f444c1094b0 msgr2=0x7f444c19b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:48.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 --2- 172.21.15.17:0/3652819121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f444c1094b0 0x7f444c19b080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f444400d950 tx=0x7f444400de10 comp rx=0 tx=0).stop 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 -- 172.21.15.17:0/3652819121 shutdown_connections 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 --2- 172.21.15.17:0/3652819121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f443803fb20 0x7f4438042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 --2- 172.21.15.17:0/3652819121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f444c1094b0 0x7f444c19b080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 --2- 172.21.15.17:0/3652819121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f444c106970 0x7f444c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 --2- 172.21.15.17:0/3652819121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c06c640 0x7f444c199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 -- 172.21.15.17:0/3652819121 >> 172.21.15.17:0/3652819121 conn(0x7f444c0fdff0 msgr2=0x7f444c104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 -- 172.21.15.17:0/3652819121 shutdown_connections 2024-09-21T06:03:48.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:48.914+0000 7f4452c75640 1 -- 172.21.15.17:0/3652819121 wait complete. 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/3446665350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 msgr2=0x7f6fd8103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/3446665350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8103330 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00aa10 tx=0x7f6fcc02b7b0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/3446665350 shutdown_connections 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/3446665350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd81038c0 0x7f6fd810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/3446665350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8103330 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/3446665350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fd8101e90 0x7f6fd8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/3446665350 >> 172.21.15.17:0/3446665350 conn(0x7f6fd80fd800 msgr2=0x7f6fd80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/3446665350 shutdown_connections 2024-09-21T06:03:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.375+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/3446665350 wait complete. 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.376+0000 7f6fdd6d7640 1 Processor -- start 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.376+0000 7f6fdd6d7640 1 -- start start 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fdd6d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8101e90 0x7f6fd8197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fdd6d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fdd6d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fd81038c0 0x7f6fd8198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fdd6d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd810d070 con 0x7f6fd81038c0 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fdd6d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd810cef0 con 0x7f6fd8102f20 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fdd6d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd810d1f0 con 0x7f6fd8101e90 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fd81038c0 0x7f6fd8198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:49198/0 (socket says 172.21.15.17:49198) 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2138828678 learned_addr learned my addr 172.21.15.17:0/2138828678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8101e90 0x7f6fd8197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2138828678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8101e90 msgr2=0x7f6fd8197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8101e90 0x7f6fd8197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fd81038c0 msgr2=0x7f6fd8198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fd81038c0 0x7f6fd8198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 -- 172.21.15.17:0/2138828678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd81996d0 con 0x7f6fd8102f20 2024-09-21T06:03:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd6ffd640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8101e90 0x7f6fd8197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.377+0000 7f6fd67fc640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8198310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00a340 tx=0x7f6fcc0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.378+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc03f070 con 0x7f6fd8102f20 2024-09-21T06:03:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.378+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fcc030980 con 0x7f6fd8102f20 2024-09-21T06:03:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.378+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd8199960 con 0x7f6fd8102f20 2024-09-21T06:03:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.378+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc036040 con 0x7f6fd8102f20 2024-09-21T06:03:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.378+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd819fef0 con 0x7f6fd8102f20 2024-09-21T06:03:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.379+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f6fcc042070 con 0x7f6fd8102f20 2024-09-21T06:03:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.379+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd8109070 con 0x7f6fd8102f20 2024-09-21T06:03:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.379+0000 7f6fbffff640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6fc003fb20 0x7f6fc0042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.379+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6fcc074ca0 con 0x7f6fd8102f20 2024-09-21T06:03:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.379+0000 7f6fd6ffd640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6fc003fb20 0x7f6fc0042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.379+0000 7f6fd6ffd640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6fc003fb20 0x7f6fc0042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009fc0 tx=0x7f6fc8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.384+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6fcc04c350 con 0x7f6fd8102f20 2024-09-21T06:03:49.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.406+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f6fcc03ad80 con 0x7f6fd8102f20 2024-09-21T06:03:49.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:49 smithi017 ceph-mon[31080]: Standby manager daemon z started 2024-09-21T06:03:49.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:49 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:03:49.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:49 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:03:49.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:49 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:03:49.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:49 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:03:49.575 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:49 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3652819121' entity='client.admin' 2024-09-21T06:03:49.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.597+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f6fd802e640 con 0x7f6fd8102f20 2024-09-21T06:03:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.602+0000 7f6fbffff640 1 -- 172.21.15.17:0/2138828678 <== mon.2 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) ==== 127+0+0 (secure 0 0 0) 0x7f6fcc059a80 con 0x7f6fd8102f20 2024-09-21T06:03:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6fc003fb20 msgr2=0x7f6fc0042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6fc003fb20 0x7f6fc0042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009fc0 tx=0x7f6fc8005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 msgr2=0x7f6fd8198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8198310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00a340 tx=0x7f6fcc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 shutdown_connections 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6fc003fb20 0x7f6fc0042030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fd81038c0 0x7f6fd8198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd8102f20 0x7f6fd8198310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 --2- 172.21.15.17:0/2138828678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd8101e90 0x7f6fd8197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.604+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 >> 172.21.15.17:0/2138828678 conn(0x7f6fd80fd800 msgr2=0x7f6fd8106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.605+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 shutdown_connections 2024-09-21T06:03:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:49.605+0000 7f6fdd6d7640 1 -- 172.21.15.17:0/2138828678 wait complete. 2024-09-21T06:03:49.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:49 smithi081 ceph-mon[33870]: Standby manager daemon z started 2024-09-21T06:03:49.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:49 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:03:49.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:49 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:03:49.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:49 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:03:49.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:49 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:03:49.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:49 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3652819121' entity='client.admin' 2024-09-21T06:03:49.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:49 smithi089 ceph-mon[33879]: Standby manager daemon z started 2024-09-21T06:03:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:49 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:03:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:49 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:03:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:49 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:03:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:49 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.89:0/2941177415' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:03:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:49 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3652819121' entity='client.admin' 2024-09-21T06:03:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:50 smithi017 ceph-mon[31080]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:50 smithi017 ceph-mon[31080]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T06:03:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:03:50.522 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:50 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' 2024-09-21T06:03:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 -- 172.21.15.17:0/1115095537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 msgr2=0x7f8a2c10aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 --2- 172.21.15.17:0/1115095537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c10aa10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009ca0 tx=0x7f8a2402a950 comp rx=0 tx=0).stop 2024-09-21T06:03:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 -- 172.21.15.17:0/1115095537 shutdown_connections 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 --2- 172.21.15.17:0/1115095537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c10aa10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 --2- 172.21.15.17:0/1115095537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c1036d0 0x7f8a2c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 --2- 172.21.15.17:0/1115095537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 0x7f8a2c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 -- 172.21.15.17:0/1115095537 >> 172.21.15.17:0/1115095537 conn(0x7f8a2c0fdfb0 msgr2=0x7f8a2c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 -- 172.21.15.17:0/1115095537 shutdown_connections 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.520+0000 7f8a34095640 1 -- 172.21.15.17:0/1115095537 wait complete. 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.521+0000 7f8a34095640 1 Processor -- start 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.521+0000 7f8a34095640 1 -- start start 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.521+0000 7f8a34095640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 0x7f8a2c19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a34095640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c1036d0 0x7f8a2c19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a34095640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c19d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a34095640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10e190 con 0x7f8a2c104070 2024-09-21T06:03:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a34095640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10e010 con 0x7f8a2c102640 2024-09-21T06:03:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a34095640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2c10e310 con 0x7f8a2c1036d0 2024-09-21T06:03:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a32632640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c19d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a32632640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c19d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55838/0 (socket says 172.21.15.17:55838) 2024-09-21T06:03:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 0x7f8a2c19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a32632640 1 -- 172.21.15.17:0/2676436001 learned_addr learned my addr 172.21.15.17:0/2676436001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:50.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31630640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c1036d0 0x7f8a2c19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 -- 172.21.15.17:0/2676436001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c1036d0 msgr2=0x7f8a2c19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c1036d0 0x7f8a2c19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 -- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 msgr2=0x7f8a2c19d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c19d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 -- 172.21.15.17:0/2676436001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2c19dae0 con 0x7f8a2c102640 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a32632640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c19d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.522+0000 7f8a31e31640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 0x7f8a2c19c0b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800e9f0 tx=0x7f8a2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.523+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2800ccc0 con 0x7f8a2c102640 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.523+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a280108c0 con 0x7f8a2c102640 2024-09-21T06:03:50.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.523+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2c19ddd0 con 0x7f8a2c102640 2024-09-21T06:03:50.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.523+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a280187e0 con 0x7f8a2c102640 2024-09-21T06:03:50.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.523+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2c1a44d0 con 0x7f8a2c102640 2024-09-21T06:03:50.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.524+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2c1a46a0 con 0x7f8a2c102640 2024-09-21T06:03:50.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.525+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f8a28018980 con 0x7f8a2c102640 2024-09-21T06:03:50.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.525+0000 7f8a22ffd640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8a1807afd0 0x7f8a1807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.525+0000 7f8a31630640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8a1807afd0 0x7f8a1807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.525+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8a2809d0c0 con 0x7f8a2c102640 2024-09-21T06:03:50.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.526+0000 7f8a31630640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8a1807afd0 0x7f8a1807d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005fd0 tx=0x7f8a1c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:50.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.530+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a28069b00 con 0x7f8a2c102640 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 -- 172.21.15.17:0/1192113276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff10102640 msgr2=0x7eff10102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 --2- 172.21.15.17:0/1192113276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff10102640 0x7eff10102ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff00009900 tx=0x7eff0002a480 comp rx=0 tx=0).stop 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 -- 172.21.15.17:0/1192113276 shutdown_connections 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 --2- 172.21.15.17:0/1192113276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff10104070 0x7eff1010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 --2- 172.21.15.17:0/1192113276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff101036d0 0x7eff10103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 --2- 172.21.15.17:0/1192113276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff10102640 0x7eff10102ab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 -- 172.21.15.17:0/1192113276 >> 172.21.15.17:0/1192113276 conn(0x7eff100fdfb0 msgr2=0x7eff10100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 -- 172.21.15.17:0/1192113276 shutdown_connections 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.447+0000 7eff161e5640 1 -- 172.21.15.17:0/1192113276 wait complete. 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.448+0000 7eff161e5640 1 Processor -- start 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.448+0000 7eff161e5640 1 -- start start 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff161e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff10102640 0x7eff10199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff161e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 0x7eff1019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff161e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff10104070 0x7eff1019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff161e5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff1010e110 con 0x7eff101036d0 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff161e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff1010df90 con 0x7eff10102640 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff161e5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7eff1010e290 con 0x7eff10104070 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 0x7eff1019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff10102640 0x7eff10199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 0x7eff1019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55812/0 (socket says 172.21.15.17:55812) 2024-09-21T06:03:50.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0effd640 1 -- 172.21.15.17:0/391029682 learned_addr learned my addr 172.21.15.17:0/391029682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0ffff640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff10104070 0x7eff1019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 -- 172.21.15.17:0/391029682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff10104070 msgr2=0x7eff1019b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff10104070 0x7eff1019b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 -- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 msgr2=0x7eff1019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 0x7eff1019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 -- 172.21.15.17:0/391029682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1019b970 con 0x7eff10102640 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0effd640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 0x7eff1019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.449+0000 7eff0f7fe640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff10102640 0x7eff10199f40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff00005760 tx=0x7eff00004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.450+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0003f070 con 0x7eff10102640 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.450+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff00003a80 con 0x7eff10102640 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.450+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1019bc00 con 0x7eff10102640 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.450+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00035070 con 0x7eff10102640 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.450+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff101a2360 con 0x7eff10102640 2024-09-21T06:03:50.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.451+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10102ab0 con 0x7eff10102640 2024-09-21T06:03:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.451+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7eff00043400 con 0x7eff10102640 2024-09-21T06:03:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.452+0000 7eff0cff9640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efef807afd0 0x7efef807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.452+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7eff000bcee0 con 0x7eff10102640 2024-09-21T06:03:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.452+0000 7eff0effd640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efef807afd0 0x7efef807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.452+0000 7eff0effd640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efef807afd0 0x7efef807d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff04011550 tx=0x7eff04005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.457+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff0008e8c0 con 0x7eff10102640 2024-09-21T06:03:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.652+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7eff101a29d0 con 0x7eff10102640 2024-09-21T06:03:50.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.658+0000 7eff0cff9640 1 -- 172.21.15.17:0/391029682 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7eff000bc750 con 0x7eff10102640 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efef807afd0 msgr2=0x7efef807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efef807afd0 0x7efef807d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff04011550 tx=0x7eff04005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff10102640 msgr2=0x7eff10199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff10102640 0x7eff10199f40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff00005760 tx=0x7eff00004040 comp rx=0 tx=0).stop 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 shutdown_connections 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efef807afd0 0x7efef807d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff101036d0 0x7eff1019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff10104070 0x7eff1019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 --2- 172.21.15.17:0/391029682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff10102640 0x7eff10199f40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 >> 172.21.15.17:0/391029682 conn(0x7eff100fdfb0 msgr2=0x7eff100ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 shutdown_connections 2024-09-21T06:03:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.661+0000 7eff161e5640 1 -- 172.21.15.17:0/391029682 wait complete. 2024-09-21T06:03:50.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.730+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f8a2c1a4c50 con 0x7f8a2c102640 2024-09-21T06:03:50.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.736+0000 7f8a22ffd640 1 -- 172.21.15.17:0/2676436001 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f8a2806e9b0 con 0x7f8a2c102640 2024-09-21T06:03:50.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8a1807afd0 msgr2=0x7f8a1807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8a1807afd0 0x7f8a1807d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005fd0 tx=0x7f8a1c00b390 comp rx=0 tx=0).stop 2024-09-21T06:03:50.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 msgr2=0x7f8a2c19c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:50.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 0x7f8a2c19c0b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800e9f0 tx=0x7f8a2800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 shutdown_connections 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8a1807afd0 0x7f8a1807d4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a2c104070 0x7f8a2c19d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c1036d0 0x7f8a2c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 --2- 172.21.15.17:0/2676436001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2c102640 0x7f8a2c19c0b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 >> 172.21.15.17:0/2676436001 conn(0x7f8a2c0fdfb0 msgr2=0x7f8a2c06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 shutdown_connections 2024-09-21T06:03:50.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:50.738+0000 7f8a34095640 1 -- 172.21.15.17:0/2676436001 wait complete. 2024-09-21T06:03:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:50 smithi081 ceph-mon[33870]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:50 smithi081 ceph-mon[33870]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T06:03:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:03:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:50 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' 2024-09-21T06:03:50.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:50 smithi089 ceph-mon[33879]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:50.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:50 smithi089 ceph-mon[33879]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-21T06:03:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:03:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:50 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:51.654 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:51.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:51.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: Standby manager daemon y started 2024-09-21T06:03:51.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:03:51.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:03:51.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:03:51.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:51 smithi017 ceph-mon[31080]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:03:51.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: Standby manager daemon y started 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:03:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:51 smithi081 ceph-mon[33870]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:03:51.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: Standby manager daemon y started 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:03:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:51 smithi089 ceph-mon[33879]: from='mgr.? 172.21.15.81:0/242264257' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:03:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.514+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/3405550348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24103760 msgr2=0x7f3b24103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.514+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/3405550348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24103760 0x7f3b24103bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009900 tx=0x7f3b2002a480 comp rx=0 tx=0).stop 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/3405550348 shutdown_connections 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/3405550348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b24105190 0x7f3b2410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/3405550348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b241047f0 0x7f3b24104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/3405550348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24103760 0x7f3b24103bd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/3405550348 >> 172.21.15.17:0/3405550348 conn(0x7f3b240ff0b0 msgr2=0x7f3b24101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/3405550348 shutdown_connections 2024-09-21T06:03:52.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.515+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/3405550348 wait complete. 2024-09-21T06:03:52.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 Processor -- start 2024-09-21T06:03:52.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 -- start start 2024-09-21T06:03:52.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b24103760 0x7f3b24199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b241047f0 0x7f3b2419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 0x7f3b2419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410f230 con 0x7f3b24105190 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410f0b0 con 0x7f3b241047f0 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2c6c0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410f3b0 con 0x7f3b24103760 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2ac5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 0x7f3b2419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2ac5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 0x7f3b2419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55844/0 (socket says 172.21.15.17:55844) 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2ac5d640 1 -- 172.21.15.17:0/2520522601 learned_addr learned my addr 172.21.15.17:0/2520522601 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b29c5b640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b241047f0 0x7f3b2419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.516+0000 7f3b2a45c640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b24103760 0x7f3b24199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2ac5d640 1 -- 172.21.15.17:0/2520522601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b24103760 msgr2=0x7f3b24199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2ac5d640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b24103760 0x7f3b24199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2ac5d640 1 -- 172.21.15.17:0/2520522601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b241047f0 msgr2=0x7f3b2419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2ac5d640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b241047f0 0x7f3b2419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2ac5d640 1 -- 172.21.15.17:0/2520522601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2419b940 con 0x7f3b24105190 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2ac5d640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 0x7f3b2419b120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00eaa0 tx=0x7f3b1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00cdb0 con 0x7f3b24105190 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b1c005020 con 0x7f3b24105190 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2419bc30 con 0x7f3b24105190 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0116d0 con 0x7f3b24105190 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.517+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b240757c0 con 0x7f3b24105190 2024-09-21T06:03:52.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.518+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2410a940 con 0x7f3b24105190 2024-09-21T06:03:52.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.520+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3b1c0051d0 con 0x7f3b24105190 2024-09-21T06:03:52.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.521+0000 7f3b1b7fe640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3b100b6480 0x7f3b100b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:52.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.521+0000 7f3b2a45c640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3b100b6480 0x7f3b100b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:52.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.521+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3b1c0e5a20 con 0x7f3b24105190 2024-09-21T06:03:52.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.522+0000 7f3b2a45c640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3b100b6480 0x7f3b100b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b200057c0 tx=0x7f3b20000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:52.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.524+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b1c016030 con 0x7f3b24105190 2024-09-21T06:03:52.715 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.718+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f3b2419be60 con 0x7f3b24105190 2024-09-21T06:03:52.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.722+0000 7f3b1b7fe640 1 -- 172.21.15.17:0/2520522601 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f3b1c0b2360 con 0x7f3b24105190 2024-09-21T06:03:52.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3b100b6480 msgr2=0x7f3b100b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3b100b6480 0x7f3b100b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b200057c0 tx=0x7f3b20000bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 msgr2=0x7f3b2419b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:52.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 0x7f3b2419b120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00eaa0 tx=0x7f3b1c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 shutdown_connections 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3b100b6480 0x7f3b100b8990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b24105190 0x7f3b2419b120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b241047f0 0x7f3b2419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 --2- 172.21.15.17:0/2520522601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b24103760 0x7f3b24199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 >> 172.21.15.17:0/2520522601 conn(0x7f3b240ff0b0 msgr2=0x7f3b24107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 shutdown_connections 2024-09-21T06:03:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:52.725+0000 7f3b2c6c0640 1 -- 172.21.15.17:0/2520522601 wait complete. 2024-09-21T06:03:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:52 smithi017 ceph-mon[31080]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:52 smithi017 ceph-mon[31080]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T06:03:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:52 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:03:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:52 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2520522601' entity='client.admin' 2024-09-21T06:03:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:52.945 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:53.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:52 smithi081 ceph-mon[33870]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:53.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:52 smithi081 ceph-mon[33870]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T06:03:53.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:52 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:03:53.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:52 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2520522601' entity='client.admin' 2024-09-21T06:03:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:52 smithi089 ceph-mon[33879]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:53.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:52 smithi089 ceph-mon[33879]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-21T06:03:53.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:52 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:03:53.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:52 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2520522601' entity='client.admin' 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 -- 172.21.15.17:0/59285028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8448105180 msgr2=0x7f844810bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 --2- 172.21.15.17:0/59285028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8448105180 0x7f844810bb20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ca0 tx=0x7f844002a950 comp rx=0 tx=0).stop 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 -- 172.21.15.17:0/59285028 shutdown_connections 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 --2- 172.21.15.17:0/59285028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8448105180 0x7f844810bb20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 --2- 172.21.15.17:0/59285028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84481047e0 0x7f8448104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 --2- 172.21.15.17:0/59285028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 0x7f8448103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 -- 172.21.15.17:0/59285028 >> 172.21.15.17:0/59285028 conn(0x7f84480ff0e0 msgr2=0x7f8448101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 -- 172.21.15.17:0/59285028 shutdown_connections 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 -- 172.21.15.17:0/59285028 wait complete. 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.148+0000 7f844e763640 1 Processor -- start 2024-09-21T06:03:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 -- start start 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 0x7f8448199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 0x7f844819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8448105180 0x7f844819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f844810f230 con 0x7f84481047e0 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f844810f0b0 con 0x7f8448103750 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844e763640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f844810f3b0 con 0x7f8448105180 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 0x7f844819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 0x7f844819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55856/0 (socket says 172.21.15.17:55856) 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 -- 172.21.15.17:0/1895870869 learned_addr learned my addr 172.21.15.17:0/1895870869 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f844cd00640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8448105180 0x7f844819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f8447fff640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 0x7f8448199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 -- 172.21.15.17:0/1895870869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8448105180 msgr2=0x7f844819b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8448105180 0x7f844819b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 -- 172.21.15.17:0/1895870869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 msgr2=0x7f8448199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 0x7f8448199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f84477fe640 1 -- 172.21.15.17:0/1895870869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844819b8e0 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.149+0000 7f8447fff640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 0x7f8448199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.150+0000 7f84477fe640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 0x7f844819a520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f843c00d950 tx=0x7f843c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.150+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c017030 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.150+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f843c004020 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.150+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844819bbd0 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.150+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0055d0 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.150+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84481a22d0 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.151+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844810a910 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.152+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f843c009a30 con 0x7f84481047e0 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.153+0000 7f84457fa640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f84300b6500 0x7f84300b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.153+0000 7f8447fff640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f84300b6500 0x7f84300b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.153+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f843c0e5650 con 0x7f84481047e0 2024-09-21T06:03:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.154+0000 7f8447fff640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f84300b6500 0x7f84300b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8438009b50 tx=0x7f8438005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.156+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f843c0adc30 con 0x7f84481047e0 2024-09-21T06:03:53.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.346+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f844802e640 con 0x7f84481047e0 2024-09-21T06:03:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.350+0000 7f84457fa640 1 -- 172.21.15.17:0/1895870869 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f843c0b2010 con 0x7f84481047e0 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f84300b6500 msgr2=0x7f84300b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f84300b6500 0x7f84300b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8438009b50 tx=0x7f8438005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 msgr2=0x7f844819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 0x7f844819a520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f843c00d950 tx=0x7f843c00de10 comp rx=0 tx=0).stop 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 shutdown_connections 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f84300b6500 0x7f84300b8a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84481047e0 0x7f844819a520 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8448105180 0x7f844819b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 --2- 172.21.15.17:0/1895870869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8448103750 0x7f8448199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 >> 172.21.15.17:0/1895870869 conn(0x7f84480ff0e0 msgr2=0x7f8448107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 shutdown_connections 2024-09-21T06:03:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:53.353+0000 7f844e763640 1 -- 172.21.15.17:0/1895870869 wait complete. 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 -- 172.21.15.17:0/3089713022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d0106930 msgr2=0x7f33d0108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/3089713022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d0106930 0x7f33d0108d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009900 tx=0x7f33c402a410 comp rx=0 tx=0).stop 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 -- 172.21.15.17:0/3089713022 shutdown_connections 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/3089713022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d0106930 0x7f33d0108d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/3089713022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d0109470 0x7f33d010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/3089713022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d006b920 0x7f33d01063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 -- 172.21.15.17:0/3089713022 >> 172.21.15.17:0/3089713022 conn(0x7f33d00fdfb0 msgr2=0x7f33d0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 -- 172.21.15.17:0/3089713022 shutdown_connections 2024-09-21T06:03:54.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.122+0000 7f33d7b4b640 1 -- 172.21.15.17:0/3089713022 wait complete. 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 Processor -- start 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 -- start start 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 0x7f33d0103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d0106930 0x7f33d01022f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0109470 0x7f33d0102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33d010f280 con 0x7f33d006b920 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33d010f100 con 0x7f33d0109470 2024-09-21T06:03:54.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d7b4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f33d010f400 con 0x7f33d0106930 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 0x7f33d0103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 0x7f33d0103a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55862/0 (socket says 172.21.15.17:55862) 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 -- 172.21.15.17:0/1932789574 learned_addr learned my addr 172.21.15.17:0/1932789574 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d50e6640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d0106930 0x7f33d01022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d60e8640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0109470 0x7f33d0102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 -- 172.21.15.17:0/1932789574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d0106930 msgr2=0x7f33d01022f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d0106930 0x7f33d01022f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 -- 172.21.15.17:0/1932789574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0109470 msgr2=0x7f33d0102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0109470 0x7f33d0102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.123+0000 7f33d58e7640 1 -- 172.21.15.17:0/1932789574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d0102f30 con 0x7f33d006b920 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.124+0000 7f33d58e7640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 0x7f33d0103a20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33c800d950 tx=0x7f33c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.124+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8017070 con 0x7f33d006b920 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.124+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33c8009c30 con 0x7f33d006b920 2024-09-21T06:03:54.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.124+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d01a3f60 con 0x7f33d006b920 2024-09-21T06:03:54.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.124+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c800f620 con 0x7f33d006b920 2024-09-21T06:03:54.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.124+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d01a4300 con 0x7f33d006b920 2024-09-21T06:03:54.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.125+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d0106d40 con 0x7f33d006b920 2024-09-21T06:03:54.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.127+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f33c8010460 con 0x7f33d006b920 2024-09-21T06:03:54.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.128+0000 7f33ceffd640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33b80b6480 0x7f33b80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.128+0000 7f33d50e6640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33b80b6480 0x7f33b80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.128+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f33c80e5170 con 0x7f33d006b920 2024-09-21T06:03:54.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.129+0000 7f33d50e6640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33b80b6480 0x7f33b80b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33c4005760 tx=0x7f33c4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:54.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.131+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33c8009de0 con 0x7f33d006b920 2024-09-21T06:03:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 -- 172.21.15.17:0/3440918059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628102e90 msgr2=0x7f46281032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3440918059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628102e90 0x7f46281032a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4624009900 tx=0x7f462402a480 comp rx=0 tx=0).stop 2024-09-21T06:03:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 -- 172.21.15.17:0/3440918059 shutdown_connections 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3440918059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628102e90 0x7f46281032a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3440918059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4628103830 0x7f462810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3440918059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628101e00 0x7f4628102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 -- 172.21.15.17:0/3440918059 >> 172.21.15.17:0/3440918059 conn(0x7f46280fd770 msgr2=0x7f46280ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 -- 172.21.15.17:0/3440918059 shutdown_connections 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.315+0000 7f462fd6e640 1 -- 172.21.15.17:0/3440918059 wait complete. 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 Processor -- start 2024-09-21T06:03:54.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 -- start start 2024-09-21T06:03:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 0x7f46281059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4628102e90 0x7f46281042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628103830 0x7f46281047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f462810e160 con 0x7f4628101e00 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f462810dfe0 con 0x7f4628103830 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462fd6e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f462810e2e0 con 0x7f4628102e90 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462db0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 0x7f46281059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462db0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 0x7f46281059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55870/0 (socket says 172.21.15.17:55870) 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462db0a640 1 -- 172.21.15.17:0/3280749847 learned_addr learned my addr 172.21.15.17:0/3280749847 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462e30b640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628103830 0x7f46281047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.316+0000 7f462d309640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4628102e90 0x7f46281042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462db0a640 1 -- 172.21.15.17:0/3280749847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4628102e90 msgr2=0x7f46281042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462db0a640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4628102e90 0x7f46281042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462db0a640 1 -- 172.21.15.17:0/3280749847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628103830 msgr2=0x7f46281047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462db0a640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628103830 0x7f46281047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462db0a640 1 -- 172.21.15.17:0/3280749847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4628104ee0 con 0x7f4628101e00 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462db0a640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 0x7f46281059d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f461c00d950 tx=0x7f461c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c017070 con 0x7f4628101e00 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f461c009c30 con 0x7f4628101e00 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46281a3f90 con 0x7f4628101e00 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46281a4330 con 0x7f4628101e00 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.317+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c00f620 con 0x7f4628101e00 2024-09-21T06:03:54.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.319+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4628102270 con 0x7f4628101e00 2024-09-21T06:03:54.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.321+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f461c010460 con 0x7f4628101e00 2024-09-21T06:03:54.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.322+0000 7f461affd640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46140b6480 0x7f46140b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:54.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.322+0000 7f462d309640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46140b6480 0x7f46140b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:54.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.322+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f461c0e5230 con 0x7f4628101e00 2024-09-21T06:03:54.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.323+0000 7f462d309640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46140b6480 0x7f46140b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46240057c0 tx=0x7f4624000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:54.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.327+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f461c009de0 con 0x7f4628101e00 2024-09-21T06:03:54.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.327+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f33d00ffad0 con 0x7f33d006b920 2024-09-21T06:03:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.331+0000 7f33ceffd640 1 -- 172.21.15.17:0/1932789574 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f33d00ffad0 con 0x7f33d006b920 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33b80b6480 msgr2=0x7f33b80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33b80b6480 0x7f33b80b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f33c4005760 tx=0x7f33c4031400 comp rx=0 tx=0).stop 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 msgr2=0x7f33d0103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 0x7f33d0103a20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33c800d950 tx=0x7f33c800de10 comp rx=0 tx=0).stop 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 shutdown_connections 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33b80b6480 0x7f33b80b8990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33d0109470 0x7f33d0102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33d0106930 0x7f33d01022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 --2- 172.21.15.17:0/1932789574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d006b920 0x7f33d0103a20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 >> 172.21.15.17:0/1932789574 conn(0x7f33d00fdfb0 msgr2=0x7f33d0104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 shutdown_connections 2024-09-21T06:03:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.334+0000 7f33d7b4b640 1 -- 172.21.15.17:0/1932789574 wait complete. 2024-09-21T06:03:54.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.519+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f46281a47a0 con 0x7f4628101e00 2024-09-21T06:03:54.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.520+0000 7f461affd640 1 -- 172.21.15.17:0/3280749847 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v23)=0 v23) ==== 108+0+0 (secure 0 0 0) 0x7f461c0b1ad0 con 0x7f4628101e00 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46140b6480 msgr2=0x7f46140b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46140b6480 0x7f46140b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46240057c0 tx=0x7f4624000bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 msgr2=0x7f46281059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 0x7f46281059d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f461c00d950 tx=0x7f461c00de10 comp rx=0 tx=0).stop 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 shutdown_connections 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46140b6480 0x7f46140b8990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628103830 0x7f46281047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4628102e90 0x7f46281042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 --2- 172.21.15.17:0/3280749847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4628101e00 0x7f46281059d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 >> 172.21.15.17:0/3280749847 conn(0x7f46280fd770 msgr2=0x7f46280ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:54.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 shutdown_connections 2024-09-21T06:03:54.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:54.522+0000 7f462fd6e640 1 -- 172.21.15.17:0/3280749847 wait complete. 2024-09-21T06:03:54.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:54 smithi017 ceph-mon[31080]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:54.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1895870869' entity='client.admin' 2024-09-21T06:03:54.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1932789574' entity='client.admin' 2024-09-21T06:03:54.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:54 smithi089 ceph-mon[33879]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:54.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:54 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1895870869' entity='client.admin' 2024-09-21T06:03:54.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:54 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1932789574' entity='client.admin' 2024-09-21T06:03:54.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:54 smithi081 ceph-mon[33870]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:54.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:54 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1895870869' entity='client.admin' 2024-09-21T06:03:54.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:54 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1932789574' entity='client.admin' 2024-09-21T06:03:56.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:56 smithi017 ceph-mon[31080]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:56.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:56.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:56.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:56 smithi089 ceph-mon[33879]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:56.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 -- 172.21.15.17:0/334212036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594102e90 msgr2=0x7f75941032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 --2- 172.21.15.17:0/334212036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594102e90 0x7f75941032a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7584009900 tx=0x7f758402a480 comp rx=0 tx=0).stop 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 -- 172.21.15.17:0/334212036 shutdown_connections 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 --2- 172.21.15.17:0/334212036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594102e90 0x7f75941032a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 --2- 172.21.15.17:0/334212036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594103830 0x7f759410a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 --2- 172.21.15.17:0/334212036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7594101e00 0x7f7594102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 -- 172.21.15.17:0/334212036 >> 172.21.15.17:0/334212036 conn(0x7f75940fd770 msgr2=0x7f75940ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 -- 172.21.15.17:0/334212036 shutdown_connections 2024-09-21T06:03:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 -- 172.21.15.17:0/334212036 wait complete. 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.942+0000 7f759c12a640 1 Processor -- start 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 -- start start 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 0x7f7594199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7594102e90 0x7f759419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594103830 0x7f759419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f759410e180 con 0x7f7594103830 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f759410e000 con 0x7f7594102e90 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759c12a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f759410e300 con 0x7f7594101e00 2024-09-21T06:03:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 0x7f7594199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759a6c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594103830 0x7f759419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 0x7f7594199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:35748/0 (socket says 172.21.15.17:35748) 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 -- 172.21.15.17:0/578052865 learned_addr learned my addr 172.21.15.17:0/578052865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f75996c5640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7594102e90 0x7f759419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 -- 172.21.15.17:0/578052865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7594102e90 msgr2=0x7f759419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7594102e90 0x7f759419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 -- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594103830 msgr2=0x7f759419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594103830 0x7f759419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f7599ec6640 1 -- 172.21.15.17:0/578052865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759419b950 con 0x7f7594101e00 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.943+0000 7f759a6c7640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594103830 0x7f759419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.944+0000 7f7599ec6640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 0x7f7594199f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f759000d950 tx=0x7f759000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.944+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590017030 con 0x7f7594101e00 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.944+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7590004020 con 0x7f7594101e00 2024-09-21T06:03:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.944+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759419bc40 con 0x7f7594101e00 2024-09-21T06:03:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.944+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75900055d0 con 0x7f7594101e00 2024-09-21T06:03:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.944+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75941a2340 con 0x7f7594101e00 2024-09-21T06:03:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.945+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75941a2510 con 0x7f7594101e00 2024-09-21T06:03:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.947+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f7590009a30 con 0x7f7594101e00 2024-09-21T06:03:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.947+0000 7f758affd640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f75800b6480 0x7f75800b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.947+0000 7f75996c5640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f75800b6480 0x7f75800b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.948+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f75900e5680 con 0x7f7594101e00 2024-09-21T06:03:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.948+0000 7f75996c5640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f75800b6480 0x7f75800b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75840057c0 tx=0x7f7584000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:56.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:56.951+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75900adbc0 con 0x7f7594101e00 2024-09-21T06:03:57.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:56 smithi081 ceph-mon[33870]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:57.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:57.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:57.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.143+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f75941a26e0 con 0x7f7594101e00 2024-09-21T06:03:57.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.149+0000 7f758affd640 1 -- 172.21.15.17:0/578052865 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f75900b1fa0 con 0x7f7594101e00 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f75800b6480 msgr2=0x7f75800b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f75800b6480 0x7f75800b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75840057c0 tx=0x7f7584000bc0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 msgr2=0x7f7594199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 0x7f7594199f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f759000d950 tx=0x7f759000de10 comp rx=0 tx=0).stop 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 shutdown_connections 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f75800b6480 0x7f75800b8990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594103830 0x7f759419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7594102e90 0x7f759419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 --2- 172.21.15.17:0/578052865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7594101e00 0x7f7594199f20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 >> 172.21.15.17:0/578052865 conn(0x7f75940fd770 msgr2=0x7f75940ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 shutdown_connections 2024-09-21T06:03:57.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.152+0000 7f759c12a640 1 -- 172.21.15.17:0/578052865 wait complete. 2024-09-21T06:03:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:03:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:58 smithi017 ceph-mon[31080]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:58 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' 2024-09-21T06:03:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:58 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3100353572' entity='client.admin' 2024-09-21T06:03:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:58.299 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:58.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:58.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:58 smithi089 ceph-mon[33879]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:58.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:58 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' 2024-09-21T06:03:58.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:58 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3100353572' entity='client.admin' 2024-09-21T06:03:58.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:58.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:58.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.462+0000 7f9a602b9640 1 -- 172.21.15.17:0/403372400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a581094b0 msgr2=0x7f9a5810b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.462+0000 7f9a602b9640 1 --2- 172.21.15.17:0/403372400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a581094b0 0x7f9a5810b9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009ca0 tx=0x7f9a5002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 -- 172.21.15.17:0/403372400 shutdown_connections 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 --2- 172.21.15.17:0/403372400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a581094b0 0x7f9a5810b9c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 --2- 172.21.15.17:0/403372400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a58106910 0x7f9a58108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 --2- 172.21.15.17:0/403372400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a5806c6a0 0x7f9a581063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 -- 172.21.15.17:0/403372400 >> 172.21.15.17:0/403372400 conn(0x7f9a580fdff0 msgr2=0x7f9a581004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 -- 172.21.15.17:0/403372400 shutdown_connections 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 -- 172.21.15.17:0/403372400 wait complete. 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 Processor -- start 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.463+0000 7f9a602b9640 1 -- start start 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a602b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806c6a0 0x7f9a58103a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a602b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 0x7f9a581022d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a602b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 0x7f9a58102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a602b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5810f2d0 con 0x7f9a58106910 2024-09-21T06:03:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a602b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5810f150 con 0x7f9a5806c6a0 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a602b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5810f450 con 0x7f9a581094b0 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 0x7f9a581022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5e856640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 0x7f9a58102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 0x7f9a581022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55888/0 (socket says 172.21.15.17:55888) 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5e856640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 0x7f9a58102810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:35768/0 (socket says 172.21.15.17:35768) 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 -- 172.21.15.17:0/3100353572 learned_addr learned my addr 172.21.15.17:0/3100353572 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5e055640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806c6a0 0x7f9a58103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 -- 172.21.15.17:0/3100353572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 msgr2=0x7f9a58102810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 0x7f9a58102810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 -- 172.21.15.17:0/3100353572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806c6a0 msgr2=0x7f9a58103a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806c6a0 0x7f9a58103a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5d854640 1 -- 172.21.15.17:0/3100353572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a58102f10 con 0x7f9a58106910 2024-09-21T06:03:58.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.464+0000 7f9a5e856640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 0x7f9a58102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.465+0000 7f9a5d854640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 0x7f9a581022d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00d950 tx=0x7f9a4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.465+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c017070 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.465+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a4c009c30 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.465+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a581a3f20 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.465+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00f620 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.465+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a581a42c0 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.466+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a58106d60 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.467+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f9a4c010460 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.469+0000 7f9a4b7fe640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9a440b6480 0x7f9a440b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.469+0000 7f9a5e055640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9a440b6480 0x7f9a440b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.469+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9a4c0e5170 con 0x7f9a58106910 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.469+0000 7f9a5e055640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9a440b6480 0x7f9a440b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009bd0 tx=0x7f9a54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.472+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a4c009de0 con 0x7f9a58106910 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.669+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f9a580ffb10 con 0x7f9a58106910 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.673+0000 7f9a4b7fe640 1 -- 172.21.15.17:0/3100353572 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f9a580ffb10 con 0x7f9a58106910 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9a440b6480 msgr2=0x7f9a440b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9a440b6480 0x7f9a440b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009bd0 tx=0x7f9a54005f90 comp rx=0 tx=0).stop 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 msgr2=0x7f9a581022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 0x7f9a581022d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00d950 tx=0x7f9a4c00de10 comp rx=0 tx=0).stop 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 shutdown_connections 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9a440b6480 0x7f9a440b8990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a58106910 0x7f9a581022d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a581094b0 0x7f9a58102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 --2- 172.21.15.17:0/3100353572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806c6a0 0x7f9a58103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.675+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 >> 172.21.15.17:0/3100353572 conn(0x7f9a580fdff0 msgr2=0x7f9a58104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.676+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 shutdown_connections 2024-09-21T06:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:57.676+0000 7f9a602b9640 1 -- 172.21.15.17:0/3100353572 wait complete. 2024-09-21T06:03:58.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:58 smithi081 ceph-mon[33870]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:03:58.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:58 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' 2024-09-21T06:03:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:58 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3100353572' entity='client.admin' 2024-09-21T06:03:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 -- 172.21.15.17:0/162033582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c1094a0 msgr2=0x7f6d1c10b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 --2- 172.21.15.17:0/162033582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c1094a0 0x7f6d1c10b9b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009ca0 tx=0x7f6d1402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 -- 172.21.15.17:0/162033582 shutdown_connections 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 --2- 172.21.15.17:0/162033582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c1094a0 0x7f6d1c10b9b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 --2- 172.21.15.17:0/162033582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d1c106900 0x7f6d1c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 --2- 172.21.15.17:0/162033582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 0x7f6d1c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 -- 172.21.15.17:0/162033582 >> 172.21.15.17:0/162033582 conn(0x7f6d1c0fdfe0 msgr2=0x7f6d1c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 -- 172.21.15.17:0/162033582 shutdown_connections 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 -- 172.21.15.17:0/162033582 wait complete. 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.135+0000 7f6d21c85640 1 Processor -- start 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 -- start start 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 0x7f6d1c199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 0x7f6d1c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d1c1094a0 0x7f6d1c19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c10f2c0 con 0x7f6d1c106900 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c10f140 con 0x7f6d1c06c660 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d21c85640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c10f440 con 0x7f6d1c1094a0 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 0x7f6d1c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 0x7f6d1c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33842/0 (socket says 172.21.15.17:33842) 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1affd640 1 -- 172.21.15.17:0/2958098846 learned_addr learned my addr 172.21.15.17:0/2958098846 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:03:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1b7fe640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 0x7f6d1c199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1bfff640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d1c1094a0 0x7f6d1c19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1b7fe640 1 -- 172.21.15.17:0/2958098846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d1c1094a0 msgr2=0x7f6d1c19b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1b7fe640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d1c1094a0 0x7f6d1c19b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1b7fe640 1 -- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 msgr2=0x7f6d1c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1b7fe640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 0x7f6d1c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1b7fe640 1 -- 172.21.15.17:0/2958098846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c19b8c0 con 0x7f6d1c06c660 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.136+0000 7f6d1affd640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 0x7f6d1c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.137+0000 7f6d1b7fe640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 0x7f6d1c199e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00e9f0 tx=0x7f6d0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.137+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00ccc0 con 0x7f6d1c06c660 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.137+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d0c0108c0 con 0x7f6d1c06c660 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.137+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c19bbb0 con 0x7f6d1c06c660 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.137+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0187e0 con 0x7f6d1c06c660 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.137+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c1a22b0 con 0x7f6d1c06c660 2024-09-21T06:03:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.138+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c0ffb00 con 0x7f6d1c06c660 2024-09-21T06:03:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.140+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f6d0c010430 con 0x7f6d1c06c660 2024-09-21T06:03:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.140+0000 7f6d18ff9640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d040b6480 0x7f6d040b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:03:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.140+0000 7f6d1affd640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d040b6480 0x7f6d040b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:03:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.141+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6d0c0e5e80 con 0x7f6d1c06c660 2024-09-21T06:03:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.141+0000 7f6d1affd640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d040b6480 0x7f6d040b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d100104e0 tx=0x7f6d1000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:03:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.143+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d0c0b2720 con 0x7f6d1c06c660 2024-09-21T06:03:59.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.335+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f6d1c02e640 con 0x7f6d1c06c660 2024-09-21T06:03:59.337 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:59.337 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:59.337 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:59.337 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:59.338 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:03:59 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/169667106' entity='client.admin' 2024-09-21T06:03:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.341+0000 7f6d18ff9640 1 -- 172.21.15.17:0/2958098846 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f6d0c0b7660 con 0x7f6d1c06c660 2024-09-21T06:03:59.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d040b6480 msgr2=0x7f6d040b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d040b6480 0x7f6d040b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d100104e0 tx=0x7f6d1000b410 comp rx=0 tx=0).stop 2024-09-21T06:03:59.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 msgr2=0x7f6d1c199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:03:59.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 0x7f6d1c199e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00e9f0 tx=0x7f6d0c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 shutdown_connections 2024-09-21T06:03:59.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d040b6480 0x7f6d040b8990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d1c106900 0x7f6d1c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d1c1094a0 0x7f6d1c19b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 --2- 172.21.15.17:0/2958098846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d1c06c660 0x7f6d1c199e90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:03:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.343+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 >> 172.21.15.17:0/2958098846 conn(0x7f6d1c0fdfe0 msgr2=0x7f6d1c104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:03:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.344+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 shutdown_connections 2024-09-21T06:03:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.344+0000 7f6d21c85640 1 -- 172.21.15.17:0/2958098846 wait complete. 2024-09-21T06:03:59.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:59.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:59.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:59.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:59.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:03:59 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/169667106' entity='client.admin' 2024-09-21T06:03:59.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:03:59.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:03:59.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:03:59.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:03:59.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:03:59 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/169667106' entity='client.admin' 2024-09-21T06:04:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 -- 172.21.15.17:0/2098874834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 msgr2=0x7f57c410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 --2- 172.21.15.17:0/2098874834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c410aa10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009900 tx=0x7f57bc02a480 comp rx=0 tx=0).stop 2024-09-21T06:04:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 -- 172.21.15.17:0/2098874834 shutdown_connections 2024-09-21T06:04:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 --2- 172.21.15.17:0/2098874834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c410aa10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 --2- 172.21.15.17:0/2098874834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c41036d0 0x7f57c4103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 --2- 172.21.15.17:0/2098874834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c4102640 0x7f57c4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 -- 172.21.15.17:0/2098874834 >> 172.21.15.17:0/2098874834 conn(0x7f57c40fdfb0 msgr2=0x7f57c4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 -- 172.21.15.17:0/2098874834 shutdown_connections 2024-09-21T06:04:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.024+0000 7f57c88c2640 1 -- 172.21.15.17:0/2098874834 wait complete. 2024-09-21T06:04:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 Processor -- start 2024-09-21T06:04:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 -- start start 2024-09-21T06:04:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c4102640 0x7f57c4106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c41036d0 0x7f57c4104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c4105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57c410e120 con 0x7f57c4104070 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57c410dfa0 con 0x7f57c41036d0 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.025+0000 7f57c88c2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f57c410e2a0 con 0x7f57c4102640 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c4105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c4105040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33850/0 (socket says 172.21.15.17:33850) 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 -- 172.21.15.17:0/4085329141 learned_addr learned my addr 172.21.15.17:0/4085329141 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c259c640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c4102640 0x7f57c4106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c1d9b640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c41036d0 0x7f57c4104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 -- 172.21.15.17:0/4085329141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c4102640 msgr2=0x7f57c4106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c4102640 0x7f57c4106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 -- 172.21.15.17:0/4085329141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c41036d0 msgr2=0x7f57c4104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c41036d0 0x7f57c4104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 -- 172.21.15.17:0/4085329141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c4105740 con 0x7f57c4104070 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57c2d9d640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c4105040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57bc005ab0 tx=0x7f57bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc03f030 con 0x7f57c4104070 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57bc032e10 con 0x7f57c4104070 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.026+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc035070 con 0x7f57c4104070 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.027+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c41a3f30 con 0x7f57c4104070 2024-09-21T06:04:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.027+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c41a42d0 con 0x7f57c4104070 2024-09-21T06:04:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.028+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c4102ab0 con 0x7f57c4104070 2024-09-21T06:04:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.029+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f57bc042030 con 0x7f57c4104070 2024-09-21T06:04:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.030+0000 7f57bb7fe640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f57b00b6500 0x7f57b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.030+0000 7f57c259c640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f57b00b6500 0x7f57b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.030+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f57bc105de0 con 0x7f57c4104070 2024-09-21T06:04:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.031+0000 7f57c259c640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f57b00b6500 0x7f57b00b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57b4005fd0 tx=0x7f57b4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.033+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57bc005dc0 con 0x7f57c4104070 2024-09-21T06:04:00.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.223+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f57c41a44a0 con 0x7f57c4104070 2024-09-21T06:04:00.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.227+0000 7f57bb7fe640 1 -- 172.21.15.17:0/4085329141 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f57bc0d2720 con 0x7f57c4104070 2024-09-21T06:04:00.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f57b00b6500 msgr2=0x7f57b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f57b00b6500 0x7f57b00b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57b4005fd0 tx=0x7f57b4009500 comp rx=0 tx=0).stop 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 msgr2=0x7f57c4105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c4105040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57bc005ab0 tx=0x7f57bc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 shutdown_connections 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f57b00b6500 0x7f57b00b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57c4104070 0x7f57c4105040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.229+0000 7f57c88c2640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c41036d0 0x7f57c4104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.230+0000 7f57c88c2640 1 --2- 172.21.15.17:0/4085329141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57c4102640 0x7f57c4106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.230+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 >> 172.21.15.17:0/4085329141 conn(0x7f57c40fdfb0 msgr2=0x7f57c40ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.230+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 shutdown_connections 2024-09-21T06:04:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.230+0000 7f57c88c2640 1 -- 172.21.15.17:0/4085329141 wait complete. 2024-09-21T06:04:00.585 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:00 smithi017 ceph-mon[31080]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:00.585 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:00 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' 2024-09-21T06:04:00.585 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:00 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/4085329141' entity='client.admin' 2024-09-21T06:04:00.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:00 smithi089 ceph-mon[33879]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:00.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:00 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' 2024-09-21T06:04:00.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:00 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/4085329141' entity='client.admin' 2024-09-21T06:04:00.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:00 smithi081 ceph-mon[33870]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:00.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:00 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' 2024-09-21T06:04:00.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:00 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/4085329141' entity='client.admin' 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 -- 172.21.15.17:0/266933580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540075c70 msgr2=0x7f2540076080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 --2- 172.21.15.17:0/266933580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540075c70 0x7f2540076080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f253402a410 comp rx=0 tx=0).stop 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 -- 172.21.15.17:0/266933580 shutdown_connections 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 --2- 172.21.15.17:0/266933580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540075c70 0x7f2540076080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 --2- 172.21.15.17:0/266933580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254010b810 0x7f254010dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 --2- 172.21.15.17:0/266933580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2540077060 0x7f2540075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 -- 172.21.15.17:0/266933580 >> 172.21.15.17:0/266933580 conn(0x7f25400ff180 msgr2=0x7f2540101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 -- 172.21.15.17:0/266933580 shutdown_connections 2024-09-21T06:04:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.852+0000 7f2545881640 1 -- 172.21.15.17:0/266933580 wait complete. 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 Processor -- start 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 -- start start 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2540075c70 0x7f254019c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 0x7f254019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254010b810 0x7f254019d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2540111470 con 0x7f2540077060 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25401112f0 con 0x7f2540075c70 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.853+0000 7f2545881640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f25401115f0 con 0x7f254010b810 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 0x7f254019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 0x7f254019c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33890/0 (socket says 172.21.15.17:33890) 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 -- 172.21.15.17:0/2212524280 learned_addr learned my addr 172.21.15.17:0/2212524280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253effd640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2540075c70 0x7f254019c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253f7fe640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254010b810 0x7f254019d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 -- 172.21.15.17:0/2212524280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254010b810 msgr2=0x7f254019d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254010b810 0x7f254019d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 -- 172.21.15.17:0/2212524280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2540075c70 msgr2=0x7f254019c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2540075c70 0x7f254019c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 -- 172.21.15.17:0/2212524280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254019db90 con 0x7f2540077060 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f253e7fc640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 0x7f254019c7d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2534009230 tx=0x7f25340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.854+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253403f030 con 0x7f2540077060 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.855+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2534003c90 con 0x7f2540077060 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.855+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254019de20 con 0x7f2540077060 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.855+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534035070 con 0x7f2540077060 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.855+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25401a4580 con 0x7f2540077060 2024-09-21T06:04:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.856+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25401a4750 con 0x7f2540077060 2024-09-21T06:04:00.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.857+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2534042030 con 0x7f2540077060 2024-09-21T06:04:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.858+0000 7f254487f640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f25280b6500 0x7f25280b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.859+0000 7f253effd640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f25280b6500 0x7f25280b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.859+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2534105f70 con 0x7f2540077060 2024-09-21T06:04:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.859+0000 7f253effd640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f25280b6500 0x7f25280b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f253000bbe0 tx=0x7f253000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.862+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25340d28b0 con 0x7f2540077060 2024-09-21T06:04:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 -- 172.21.15.17:0/2134889573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 msgr2=0x7fc92c101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 --2- 172.21.15.17:0/2134889573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c101f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009900 tx=0x7fc91c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 -- 172.21.15.17:0/2134889573 shutdown_connections 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 --2- 172.21.15.17:0/2134889573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92c109540 0x7fc92c10b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 --2- 172.21.15.17:0/2134889573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 0x7fc92c109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 --2- 172.21.15.17:0/2134889573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c101f50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 -- 172.21.15.17:0/2134889573 >> 172.21.15.17:0/2134889573 conn(0x7fc92c0fd770 msgr2=0x7fc92c0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 -- 172.21.15.17:0/2134889573 shutdown_connections 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.815+0000 7fc931193640 1 -- 172.21.15.17:0/2134889573 wait complete. 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 Processor -- start 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 -- start start 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c104210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 0x7fc92c102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92c109540 0x7fc92c103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c10f250 con 0x7fc92c101b40 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c10f0d0 con 0x7fc92c109540 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc931193640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c10f3d0 con 0x7fc92c106be0 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c104210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33816/0 (socket says 172.21.15.17:33816) 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92ad9d640 1 -- 172.21.15.17:0/169667106 learned_addr learned my addr 172.21.15.17:0/169667106 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92b59e640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92c109540 0x7fc92c103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92a59c640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 0x7fc92c102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92ad9d640 1 -- 172.21.15.17:0/169667106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 msgr2=0x7fc92c102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.816+0000 7fc92ad9d640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 0x7fc92c102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc92ad9d640 1 -- 172.21.15.17:0/169667106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92c109540 msgr2=0x7fc92c103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc92ad9d640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92c109540 0x7fc92c103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc92ad9d640 1 -- 172.21.15.17:0/169667106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c103690 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc92a59c640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 0x7fc92c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc92ad9d640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c104210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009230 tx=0x7fc91c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c03f030 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c103920 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc91c003c90 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c035070 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.817+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c1a4220 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.818+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c0ff290 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.821+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fc91c042030 con 0x7fc92c101b40 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.822+0000 7fc913fff640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc9140b6500 0x7fc9140b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.822+0000 7fc92a59c640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc9140b6500 0x7fc9140b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.822+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc91c106020 con 0x7fc92c101b40 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.822+0000 7fc92a59c640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc9140b6500 0x7fc9140b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc92000baa0 tx=0x7fc920005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:58.824+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc91c0ce580 con 0x7fc92c101b40 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.016+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc92c02e640 con 0x7fc92c101b40 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.021+0000 7fc913fff640 1 -- 172.21.15.17:0/169667106 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7fc91c0d2960 con 0x7fc92c101b40 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.023+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc9140b6500 msgr2=0x7fc9140b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.023+0000 7fc931193640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc9140b6500 0x7fc9140b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc92000baa0 tx=0x7fc920005d90 comp rx=0 tx=0).stop 2024-09-21T06:04:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.023+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 msgr2=0x7fc92c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.023+0000 7fc931193640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c104210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009230 tx=0x7fc91c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 shutdown_connections 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc9140b6500 0x7fc9140b8a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc92c109540 0x7fc92c103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92c106be0 0x7fc92c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 --2- 172.21.15.17:0/169667106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc92c101b40 0x7fc92c104210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 >> 172.21.15.17:0/169667106 conn(0x7fc92c0fd770 msgr2=0x7fc92c107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 shutdown_connections 2024-09-21T06:04:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:03:59.024+0000 7fc931193640 1 -- 172.21.15.17:0/169667106 wait complete. 2024-09-21T06:04:01.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.063+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f25401a4920 con 0x7f2540077060 2024-09-21T06:04:01.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.067+0000 7f254487f640 1 -- 172.21.15.17:0/2212524280 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7f25340d77f0 con 0x7f2540077060 2024-09-21T06:04:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f25280b6500 msgr2=0x7f25280b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f25280b6500 0x7f25280b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f253000bbe0 tx=0x7f253000b390 comp rx=0 tx=0).stop 2024-09-21T06:04:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 msgr2=0x7f254019c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 0x7f254019c7d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2534009230 tx=0x7f25340042f0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 shutdown_connections 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f25280b6500 0x7f25280b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2540077060 0x7f254019c7d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f254010b810 0x7f254019d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 --2- 172.21.15.17:0/2212524280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2540075c70 0x7f254019c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.069+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 >> 172.21.15.17:0/2212524280 conn(0x7f25400ff180 msgr2=0x7f25400ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.070+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 shutdown_connections 2024-09-21T06:04:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:01.070+0000 7f2545881640 1 -- 172.21.15.17:0/2212524280 wait complete. 2024-09-21T06:04:02.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/567453000' entity='client.admin' 2024-09-21T06:04:02.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:01 smithi017 ceph-mon[31080]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:02.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2212524280' entity='client.admin' 2024-09-21T06:04:02.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/567453000' entity='client.admin' 2024-09-21T06:04:02.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:01 smithi081 ceph-mon[33870]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:02.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2212524280' entity='client.admin' 2024-09-21T06:04:02.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/567453000' entity='client.admin' 2024-09-21T06:04:02.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:01 smithi089 ceph-mon[33879]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:02.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2212524280' entity='client.admin' 2024-09-21T06:04:03.502 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.502 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.502 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.502 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.503 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 -- 172.21.15.17:0/2596364646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30281068e0 msgr2=0x7f3028108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 --2- 172.21.15.17:0/2596364646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30281068e0 0x7f3028108d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3018009900 tx=0x7f301802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 -- 172.21.15.17:0/2596364646 shutdown_connections 2024-09-21T06:04:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 --2- 172.21.15.17:0/2596364646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30281068e0 0x7f3028108d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 --2- 172.21.15.17:0/2596364646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3028109480 0x7f302810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 --2- 172.21.15.17:0/2596364646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f302806c600 0x7f30281063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 -- 172.21.15.17:0/2596364646 >> 172.21.15.17:0/2596364646 conn(0x7f30280fdfa0 msgr2=0x7f3028100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 -- 172.21.15.17:0/2596364646 shutdown_connections 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.710+0000 7f30306b2640 1 -- 172.21.15.17:0/2596364646 wait complete. 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 Processor -- start 2024-09-21T06:04:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 -- start start 2024-09-21T06:04:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 0x7f30281039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30281068e0 0x7f30281022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028109480 0x7f30281027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f302810f240 con 0x7f302806c600 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f302810f0c0 con 0x7f3028109480 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f30306b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f302810f3c0 con 0x7f30281068e0 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f302e44e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 0x7f30281039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f302e44e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 0x7f30281039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33910/0 (socket says 172.21.15.17:33910) 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f302e44e640 1 -- 172.21.15.17:0/2803117653 learned_addr learned my addr 172.21.15.17:0/2803117653 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f302dc4d640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30281068e0 0x7f30281022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.711+0000 7f302ec4f640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028109480 0x7f30281027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302e44e640 1 -- 172.21.15.17:0/2803117653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30281068e0 msgr2=0x7f30281022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302e44e640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30281068e0 0x7f30281022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302e44e640 1 -- 172.21.15.17:0/2803117653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028109480 msgr2=0x7f30281027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302e44e640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028109480 0x7f30281027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302e44e640 1 -- 172.21.15.17:0/2803117653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3028102ee0 con 0x7f302806c600 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302dc4d640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30281068e0 0x7f30281022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302ec4f640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028109480 0x7f30281027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f302e44e640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 0x7f30281039d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f302400e9f0 tx=0x7f302400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302400cd80 con 0x7f302806c600 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30240108c0 con 0x7f302806c600 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30281a3f80 con 0x7f302806c600 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30240187c0 con 0x7f302806c600 2024-09-21T06:04:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.712+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30281a4370 con 0x7f302806c600 2024-09-21T06:04:03.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.713+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3028106d30 con 0x7f302806c600 2024-09-21T06:04:03.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.715+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3024010430 con 0x7f302806c600 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.716+0000 7f301f7fe640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f30140b6500 0x7f30140b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.716+0000 7f302dc4d640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f30140b6500 0x7f30140b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.716+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f30240e5a50 con 0x7f302806c600 2024-09-21T06:04:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.717+0000 7f302dc4d640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f30140b6500 0x7f30140b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3018000c00 tx=0x7f3018031420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.720+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30240adfb0 con 0x7f302806c600 2024-09-21T06:04:03.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 -- 172.21.15.17:0/2127870288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 msgr2=0x7f34d8108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 --2- 172.21.15.17:0/2127870288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d8108db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009900 tx=0x7f34c802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 -- 172.21.15.17:0/2127870288 shutdown_connections 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 --2- 172.21.15.17:0/2127870288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d8108db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 --2- 172.21.15.17:0/2127870288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 0x7f34d810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 --2- 172.21.15.17:0/2127870288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d806b8c0 0x7f34d8106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 -- 172.21.15.17:0/2127870288 >> 172.21.15.17:0/2127870288 conn(0x7f34d80fdfb0 msgr2=0x7f34d8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 -- 172.21.15.17:0/2127870288 shutdown_connections 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.759+0000 7f34df76d640 1 -- 172.21.15.17:0/2127870288 wait complete. 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 Processor -- start 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 -- start start 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d806b8c0 0x7f34d8199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 0x7f34d819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34d810f210 con 0x7f34d8106990 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34d810f090 con 0x7f34d806b8c0 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.760+0000 7f34df76d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34d810f390 con 0x7f34d8109470 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33866/0 (socket says 172.21.15.17:33866) 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 -- 172.21.15.17:0/567453000 learned_addr learned my addr 172.21.15.17:0/567453000 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dd509640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d806b8c0 0x7f34d8199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34ddd0a640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 0x7f34d819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 -- 172.21.15.17:0/567453000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 msgr2=0x7f34d819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 0x7f34d819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 -- 172.21.15.17:0/567453000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d806b8c0 msgr2=0x7f34d8199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d806b8c0 0x7f34d8199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 -- 172.21.15.17:0/567453000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d819b870 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34ddd0a640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 0x7f34d819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34dcd08640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d819a540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009230 tx=0x7f34c80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c803f030 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.761+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34c80044c0 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.762+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8035070 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.762+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d819bb00 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.762+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d81a2120 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.763+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d80ffad0 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.764+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f34c8042030 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.765+0000 7f34ce7fc640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f34c40b6500 0x7f34c40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.765+0000 7f34dd509640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f34c40b6500 0x7f34c40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.766+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f34c8105f00 con 0x7f34d8106990 2024-09-21T06:04:03.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.766+0000 7f34dd509640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f34c40b6500 0x7f34c40b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34d400abe0 tx=0x7f34d400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.769+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34c80ce460 con 0x7f34d8106990 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.960+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f34d802e640 con 0x7f34d8106990 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.964+0000 7f34ce7fc640 1 -- 172.21.15.17:0/567453000 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7f34c80d2840 con 0x7f34d8106990 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f34c40b6500 msgr2=0x7f34c40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f34c40b6500 0x7f34c40b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34d400abe0 tx=0x7f34d400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 msgr2=0x7f34d819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d819a540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009230 tx=0x7f34c80040c0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 shutdown_connections 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f34c40b6500 0x7f34c40b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d8106990 0x7f34d819a540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d8109470 0x7f34d819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 --2- 172.21.15.17:0/567453000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d806b8c0 0x7f34d8199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 >> 172.21.15.17:0/567453000 conn(0x7f34d80fdfb0 msgr2=0x7f34d8104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 shutdown_connections 2024-09-21T06:04:03.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:00.967+0000 7f34df76d640 1 -- 172.21.15.17:0/567453000 wait complete. 2024-09-21T06:04:03.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.911+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3028063fc0 con 0x7f302806c600 2024-09-21T06:04:03.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.912+0000 7f301f7fe640 1 -- 172.21.15.17:0/2803117653 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7f30240b2390 con 0x7f302806c600 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f30140b6500 msgr2=0x7f30140b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f30140b6500 0x7f30140b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3018000c00 tx=0x7f3018031420 comp rx=0 tx=0).stop 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 msgr2=0x7f30281039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 0x7f30281039d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f302400e9f0 tx=0x7f302400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 shutdown_connections 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f30140b6500 0x7f30140b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3028109480 0x7f30281027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30281068e0 0x7f30281022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 --2- 172.21.15.17:0/2803117653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f302806c600 0x7f30281039d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:03.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 >> 172.21.15.17:0/2803117653 conn(0x7f30280fdfa0 msgr2=0x7f3028104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:03.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 shutdown_connections 2024-09-21T06:04:03.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:03.914+0000 7f30306b2640 1 -- 172.21.15.17:0/2803117653 wait complete. 2024-09-21T06:04:04.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:04 smithi017 ceph-mon[31080]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:04.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:04 smithi089 ceph-mon[33879]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:04.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/2670987170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad41036e0 msgr2=0x7f9ad4103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/2670987170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad41036e0 0x7f9ad4103af0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009900 tx=0x7f9abc02a480 comp rx=0 tx=0).stop 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/2670987170 shutdown_connections 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/2670987170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad41036e0 0x7f9ad4103af0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/2670987170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ad4104080 0x7f9ad410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/2670987170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad4102650 0x7f9ad4102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.473+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/2670987170 >> 172.21.15.17:0/2670987170 conn(0x7f9ad40fdfa0 msgr2=0x7f9ad4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.474+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/2670987170 shutdown_connections 2024-09-21T06:04:04.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.474+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/2670987170 wait complete. 2024-09-21T06:04:04.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.474+0000 7f9ad8cc3640 1 Processor -- start 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.474+0000 7f9ad8cc3640 1 -- start start 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad8cc3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 0x7f9ad4106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad8cc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad41036e0 0x7f9ad4104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad8cc3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ad4104080 0x7f9ad4105030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad8cc3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410e180 con 0x7f9ad4102650 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad8cc3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410e000 con 0x7f9ad4104080 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad8cc3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410e300 con 0x7f9ad41036e0 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 0x7f9ad4106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 0x7f9ad4106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33938/0 (socket says 172.21.15.17:33938) 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 -- 172.21.15.17:0/1884229505 learned_addr learned my addr 172.21.15.17:0/1884229505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9acbfff640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad41036e0 0x7f9ad4104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad2d9d640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ad4104080 0x7f9ad4105030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 -- 172.21.15.17:0/1884229505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad41036e0 msgr2=0x7f9ad4104af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad41036e0 0x7f9ad4104af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 -- 172.21.15.17:0/1884229505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ad4104080 msgr2=0x7f9ad4105030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ad4104080 0x7f9ad4105030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 -- 172.21.15.17:0/1884229505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad4105730 con 0x7f9ad4102650 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.475+0000 7f9ad259c640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 0x7f9ad4106220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d950 tx=0x7f9ac400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.476+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4017030 con 0x7f9ad4102650 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.476+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad41a3fb0 con 0x7f9ad4102650 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.476+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ac4004020 con 0x7f9ad4102650 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.476+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40055d0 con 0x7f9ad4102650 2024-09-21T06:04:04.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.476+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad41a4350 con 0x7f9ad4102650 2024-09-21T06:04:04.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.477+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad4102ac0 con 0x7f9ad4102650 2024-09-21T06:04:04.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.478+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f9ac4009a30 con 0x7f9ad4102650 2024-09-21T06:04:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.479+0000 7f9acb7fe640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9ac00b6480 0x7f9ac00b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.479+0000 7f9acbfff640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9ac00b6480 0x7f9ac00b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.479+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9ac40e5680 con 0x7f9ad4102650 2024-09-21T06:04:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.480+0000 7f9acbfff640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9ac00b6480 0x7f9ac00b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005760 tx=0x7f9abc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.482+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ac40adbe0 con 0x7f9ad4102650 2024-09-21T06:04:04.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:04 smithi081 ceph-mon[33870]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.674+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f9ad41a49d0 con 0x7f9ad4102650 2024-09-21T06:04:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.678+0000 7f9acb7fe640 1 -- 172.21.15.17:0/1884229505 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v31)=0 v31) ==== 125+0+0 (secure 0 0 0) 0x7f9ac40b1fc0 con 0x7f9ad4102650 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9ac00b6480 msgr2=0x7f9ac00b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9ac00b6480 0x7f9ac00b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005760 tx=0x7f9abc031400 comp rx=0 tx=0).stop 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 msgr2=0x7f9ad4106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 0x7f9ad4106220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d950 tx=0x7f9ac400de10 comp rx=0 tx=0).stop 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 shutdown_connections 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9ac00b6480 0x7f9ac00b8990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ad4104080 0x7f9ad4105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ad41036e0 0x7f9ad4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 --2- 172.21.15.17:0/1884229505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad4102650 0x7f9ad4106220 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 >> 172.21.15.17:0/1884229505 conn(0x7f9ad40fdfa0 msgr2=0x7f9ad40ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 shutdown_connections 2024-09-21T06:04:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:04.681+0000 7f9ad8cc3640 1 -- 172.21.15.17:0/1884229505 wait complete. 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.067+0000 7f6b857b0640 1 -- 172.21.15.17:0/1264036911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80102640 msgr2=0x7f6b80102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.067+0000 7f6b857b0640 1 --2- 172.21.15.17:0/1264036911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80102640 0x7f6b80102ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009900 tx=0x7f6b7802a480 comp rx=0 tx=0).stop 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 -- 172.21.15.17:0/1264036911 shutdown_connections 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 --2- 172.21.15.17:0/1264036911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80104070 0x7f6b8010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 --2- 172.21.15.17:0/1264036911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 0x7f6b80103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 --2- 172.21.15.17:0/1264036911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80102640 0x7f6b80102ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 -- 172.21.15.17:0/1264036911 >> 172.21.15.17:0/1264036911 conn(0x7f6b800fdfb0 msgr2=0x7f6b80100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 -- 172.21.15.17:0/1264036911 shutdown_connections 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 -- 172.21.15.17:0/1264036911 wait complete. 2024-09-21T06:04:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 Processor -- start 2024-09-21T06:04:05.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.068+0000 7f6b857b0640 1 -- start start 2024-09-21T06:04:05.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b857b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80102640 0x7f6b80106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b857b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 0x7f6b80104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b857b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 0x7f6b80105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b857b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8010e160 con 0x7f6b80104070 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b857b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8010dfe0 con 0x7f6b801036d0 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b857b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8010e2e0 con 0x7f6b80102640 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 0x7f6b80105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 0x7f6b80105040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33970/0 (socket says 172.21.15.17:33970) 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 -- 172.21.15.17:0/2294564179 learned_addr learned my addr 172.21.15.17:0/2294564179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7effd640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80102640 0x7f6b80106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7e7fc640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 0x7f6b80104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 -- 172.21.15.17:0/2294564179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80102640 msgr2=0x7f6b80106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80102640 0x7f6b80106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 -- 172.21.15.17:0/2294564179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 msgr2=0x7f6b80104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 0x7f6b80104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 -- 172.21.15.17:0/2294564179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b80105740 con 0x7f6b80104070 2024-09-21T06:04:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7e7fc640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 0x7f6b80104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.069+0000 7f6b7f7fe640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 0x7f6b80105040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000eaa0 tx=0x7f6b7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.070+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000cdb0 con 0x7f6b80104070 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.070+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b70005020 con 0x7f6b80104070 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.070+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b801a3f70 con 0x7f6b80104070 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.070+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b700116d0 con 0x7f6b80104070 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.070+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b801a4310 con 0x7f6b80104070 2024-09-21T06:04:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.071+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b80102ab0 con 0x7f6b80104070 2024-09-21T06:04:05.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.072+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f6b700051d0 con 0x7f6b80104070 2024-09-21T06:04:05.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.073+0000 7f6b77fff640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6b6c0b6500 0x7f6b6c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:05.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.073+0000 7f6b7effd640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6b6c0b6500 0x7f6b6c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:05.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.074+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6b700e5800 con 0x7f6b80104070 2024-09-21T06:04:05.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.074+0000 7f6b7effd640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6b6c0b6500 0x7f6b6c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b78005760 tx=0x7f6b78031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:05.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.078+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b70016030 con 0x7f6b80104070 2024-09-21T06:04:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.269+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6b801a4ca0 con 0x7f6b80104070 2024-09-21T06:04:05.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.274+0000 7f6b77fff640 1 -- 172.21.15.17:0/2294564179 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f6b700adcc0 con 0x7f6b80104070 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6b6c0b6500 msgr2=0x7f6b6c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6b6c0b6500 0x7f6b6c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b78005760 tx=0x7f6b78031400 comp rx=0 tx=0).stop 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 msgr2=0x7f6b80105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 0x7f6b80105040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000eaa0 tx=0x7f6b7000ef60 comp rx=0 tx=0).stop 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 shutdown_connections 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6b6c0b6500 0x7f6b6c0b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b80104070 0x7f6b80105040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801036d0 0x7f6b80104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 --2- 172.21.15.17:0/2294564179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80102640 0x7f6b80106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 >> 172.21.15.17:0/2294564179 conn(0x7f6b800fdfb0 msgr2=0x7f6b800ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 shutdown_connections 2024-09-21T06:04:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:05.276+0000 7f6b857b0640 1 -- 172.21.15.17:0/2294564179 wait complete. 2024-09-21T06:04:05.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:05 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1884229505' entity='client.admin' 2024-09-21T06:04:05.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:05 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:05.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:05 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:05.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:05 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:05.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:05 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:05.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:05 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2294564179' entity='client.admin' 2024-09-21T06:04:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:06.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:05 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1884229505' entity='client.admin' 2024-09-21T06:04:06.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:05 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:06.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:05 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:06.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:05 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:06.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:05 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:06.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:05 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2294564179' entity='client.admin' 2024-09-21T06:04:06.025 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi017') 2024-09-21T06:04:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:05 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1884229505' entity='client.admin' 2024-09-21T06:04:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:05 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:05 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:05 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:05 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:05 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2294564179' entity='client.admin' 2024-09-21T06:04:06.377 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-21T06:04:06.885 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:06 smithi017 ceph-mon[31080]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:06 smithi081 ceph-mon[33870]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:06 smithi089 ceph-mon[33879]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:07.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-21T06:04:07.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-21T06:04:07.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi017') 2024-09-21T06:04:07.356 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi017') 2024-09-21T06:04:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 -- 172.21.15.17:0/3140212361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a010b790 msgr2=0x7fa4a010dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/3140212361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a010b790 0x7fa4a010dbb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa498009900 tx=0x7fa49802a410 comp rx=0 tx=0).stop 2024-09-21T06:04:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 -- 172.21.15.17:0/3140212361 shutdown_connections 2024-09-21T06:04:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/3140212361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a010b790 0x7fa4a010dbb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/3140212361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a0075c70 0x7fa4a0076080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/3140212361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0077060 0x7fa4a0075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 -- 172.21.15.17:0/3140212361 >> 172.21.15.17:0/3140212361 conn(0x7fa4a00ff0e0 msgr2=0x7fa4a0101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 -- 172.21.15.17:0/3140212361 shutdown_connections 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.809+0000 7fa4a4b10640 1 -- 172.21.15.17:0/3140212361 wait complete. 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.810+0000 7fa4a4b10640 1 Processor -- start 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.810+0000 7fa4a4b10640 1 -- start start 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.810+0000 7fa4a4b10640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0075c70 0x7fa4a019c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4a4b10640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 0x7fa4a019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4a4b10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a010b790 0x7fa4a019d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4a4b10640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a0111460 con 0x7fa4a0077060 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4a4b10640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a01112e0 con 0x7fa4a010b790 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4a4b10640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a01115e0 con 0x7fa4a0075c70 2024-09-21T06:04:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 0x7fa4a019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 0x7fa4a019c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33978/0 (socket says 172.21.15.17:33978) 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 -- 172.21.15.17:0/607781581 learned_addr learned my addr 172.21.15.17:0/607781581 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49e59c640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0075c70 0x7fa4a019c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49ed9d640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a010b790 0x7fa4a019d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 -- 172.21.15.17:0/607781581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0075c70 msgr2=0x7fa4a019c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0075c70 0x7fa4a019c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 -- 172.21.15.17:0/607781581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a010b790 msgr2=0x7fa4a019d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a010b790 0x7fa4a019d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 -- 172.21.15.17:0/607781581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a019dac0 con 0x7fa4a0077060 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49e59c640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0075c70 0x7fa4a019c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa49dd9b640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 0x7fa4a019c700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa48800d950 tx=0x7fa48800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488017030 con 0x7fa4a0077060 2024-09-21T06:04:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa488004020 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a019ddb0 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.811+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4880055d0 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.812+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01a44b0 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.813+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a010a5a0 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.814+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa488009a30 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.815+0000 7fa4977fe640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa48c0b6500 0x7fa48c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.815+0000 7fa49e59c640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa48c0b6500 0x7fa48c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.815+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4880e57e0 con 0x7fa4a0077060 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.816+0000 7fa49e59c640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa48c0b6500 0x7fa48c0b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4900092f0 tx=0x7fa490009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:07.818+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4880add20 con 0x7fa4a0077060 2024-09-21T06:04:08.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.005+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fa4a002e640 con 0x7fa4a0077060 2024-09-21T06:04:08.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.010+0000 7fa4977fe640 1 -- 172.21.15.17:0/607781581 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v33)=0 v33) ==== 111+0+0 (secure 0 0 0) 0x7fa4880b2100 con 0x7fa4a0077060 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa48c0b6500 msgr2=0x7fa48c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa48c0b6500 0x7fa48c0b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4900092f0 tx=0x7fa490009280 comp rx=0 tx=0).stop 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 msgr2=0x7fa4a019c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 0x7fa4a019c700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa48800d950 tx=0x7fa48800de10 comp rx=0 tx=0).stop 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 shutdown_connections 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa48c0b6500 0x7fa48c0b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4a0077060 0x7fa4a019c700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a010b790 0x7fa4a019d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 --2- 172.21.15.17:0/607781581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0075c70 0x7fa4a019c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:08.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 >> 172.21.15.17:0/607781581 conn(0x7fa4a00ff0e0 msgr2=0x7fa4a0107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:08.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 shutdown_connections 2024-09-21T06:04:08.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:08.012+0000 7fa4a4b10640 1 -- 172.21.15.17:0/607781581 wait complete. 2024-09-21T06:04:09.004 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:08 smithi017 ceph-mon[31080]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:09.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:08 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/607781581' entity='client.admin' 2024-09-21T06:04:09.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:09.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:09.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:09.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:08 smithi081 ceph-mon[33870]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:08 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/607781581' entity='client.admin' 2024-09-21T06:04:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:09.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi017') 2024-09-21T06:04:09.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi017') 2024-09-21T06:04:09.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi017') 2024-09-21T06:04:09.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi017') 2024-09-21T06:04:09.034 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'dc6785ee-77de-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-21T06:04:09.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T06:04:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:08 smithi089 ceph-mon[33879]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:08 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/607781581' entity='client.admin' 2024-09-21T06:04:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:09.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:09.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:09.289 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 -- 172.21.15.17:0/2828325606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44103830 msgr2=0x7f4b4410a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 --2- 172.21.15.17:0/2828325606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44103830 0x7f4b4410a1d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009ca0 tx=0x7f4b3c02a950 comp rx=0 tx=0).stop 2024-09-21T06:04:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 -- 172.21.15.17:0/2828325606 shutdown_connections 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 --2- 172.21.15.17:0/2828325606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44103830 0x7f4b4410a1d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 --2- 172.21.15.17:0/2828325606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44102e90 0x7f4b441032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 --2- 172.21.15.17:0/2828325606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b44101e00 0x7f4b44102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 -- 172.21.15.17:0/2828325606 >> 172.21.15.17:0/2828325606 conn(0x7f4b440fd770 msgr2=0x7f4b440ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 -- 172.21.15.17:0/2828325606 shutdown_connections 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.696+0000 7f4b4972b640 1 -- 172.21.15.17:0/2828325606 wait complete. 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 Processor -- start 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 -- start start 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b44101e00 0x7f4b440ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 0x7f4b4419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44103830 0x7f4b441a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4410d8f0 con 0x7f4b44102e90 2024-09-21T06:04:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4410d770 con 0x7f4b44101e00 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b4972b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4410da70 con 0x7f4b44103830 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 0x7f4b4419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 0x7f4b4419ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37328/0 (socket says 172.21.15.17:37328) 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b427fc640 1 -- 172.21.15.17:0/1512703489 learned_addr learned my addr 172.21.15.17:0/1512703489 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b42ffd640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b44101e00 0x7f4b440ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.697+0000 7f4b437fe640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44103830 0x7f4b441a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b427fc640 1 -- 172.21.15.17:0/1512703489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44103830 msgr2=0x7f4b441a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b427fc640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44103830 0x7f4b441a1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b427fc640 1 -- 172.21.15.17:0/1512703489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b44101e00 msgr2=0x7f4b440ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b427fc640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b44101e00 0x7f4b440ff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b427fc640 1 -- 172.21.15.17:0/1512703489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b441a1970 con 0x7f4b44102e90 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b437fe640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44103830 0x7f4b441a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b427fc640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 0x7f4b4419ebc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800c970 tx=0x7f4b3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38007bb0 con 0x7f4b44102e90 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b38007d50 con 0x7f4b44102e90 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b441a1c60 con 0x7f4b44102e90 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38004e40 con 0x7f4b44102e90 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.698+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b441a2150 con 0x7f4b44102e90 2024-09-21T06:04:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.699+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b44109980 con 0x7f4b44102e90 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.701+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f4b38005000 con 0x7f4b44102e90 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.702+0000 7f4b2bfff640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4b2c0b6480 0x7f4b2c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.702+0000 7f4b42ffd640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4b2c0b6480 0x7f4b2c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.702+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4b380e5770 con 0x7f4b44102e90 2024-09-21T06:04:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.702+0000 7f4b42ffd640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4b2c0b6480 0x7f4b2c0b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b34005d00 tx=0x7f4b34005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:09.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.705+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b38014030 con 0x7f4b44102e90 2024-09-21T06:04:09.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.895+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4b4402e890 con 0x7f4b44102e90 2024-09-21T06:04:09.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.895+0000 7f4b2bfff640 1 -- 172.21.15.17:0/1512703489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21112 (secure 0 0 0) 0x7f4b380adcd0 con 0x7f4b44102e90 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global dev auth_debug true 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global basic log_to_file true 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global basic log_to_journald false 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global basic log_to_stderr false 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_allow_pool_delete true 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T06:04:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global dev ms_die_on_bug true 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global dev ms_die_on_old_message true 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T06:04:09.900 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced debug_mon 20/20 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced debug_ms 1/1 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced debug_paxos 20/20 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T06:04:09.901 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced debug_client 20/20 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev bdev_debug_aio true 2024-09-21T06:04:09.902 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced debug_bluefs 20/20 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced debug_bluestore 20/20 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced debug_ms 1/1 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced debug_osd 20/20 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_op_order true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_shutdown true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T06:04:09.903 INFO:teuthology.orchestra.run.smithi017.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T06:04:09.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_bal_split_size 100 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:04:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T06:04:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4b2c0b6480 msgr2=0x7f4b2c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4b2c0b6480 0x7f4b2c0b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b34005d00 tx=0x7f4b34005c50 comp rx=0 tx=0).stop 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 msgr2=0x7f4b4419ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 0x7f4b4419ebc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800c970 tx=0x7f4b3800ce30 comp rx=0 tx=0).stop 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 shutdown_connections 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4b2c0b6480 0x7f4b2c0b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b44102e90 0x7f4b4419ebc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b44103830 0x7f4b441a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 --2- 172.21.15.17:0/1512703489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b44101e00 0x7f4b440ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 >> 172.21.15.17:0/1512703489 conn(0x7f4b440fd770 msgr2=0x7f4b44106b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 shutdown_connections 2024-09-21T06:04:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:09.898+0000 7f4b4972b640 1 -- 172.21.15.17:0/1512703489 wait complete. 2024-09-21T06:04:10.499 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T06:04:10.499 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:04:10.499 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:04:10.516 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:04:10.516 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:10.571 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-21 06:02:59.443590923 +0000 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-21 05:58:40.030367250 +0000 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-21 05:58:40.030367250 +0000 2024-09-21T06:04:10.572 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-21 05:58:40.030367250 +0000 2024-09-21T06:04:10.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-21T06:04:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000113689 s, 4.5 MB/s 2024-09-21T06:04:10.638 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:04:10.695 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-21T06:04:10.751 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-21 06:02:59.478590581 +0000 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-21 05:58:40.340364236 +0000 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-21 05:58:40.340364236 +0000 2024-09-21T06:04:10.752 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-21 05:58:40.340364236 +0000 2024-09-21T06:04:10.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-21T06:04:10.815 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.6146e-05 s, 5.3 MB/s 2024-09-21T06:04:10.816 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:04:10.873 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:10.929 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-21 06:02:59.513590239 +0000 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-21 05:58:40.665361077 +0000 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-21 05:58:40.665361077 +0000 2024-09-21T06:04:10.930 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-21 05:58:40.665361077 +0000 2024-09-21T06:04:10.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:04:10.990 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:10 smithi017 ceph-mon[31080]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:10.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:10 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1512703489' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-21T06:04:10.993 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000113867 s, 4.5 MB/s 2024-09-21T06:04:10.994 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:04:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:10 smithi081 ceph-mon[33870]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:10 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1512703489' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:04:11.051 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-21T06:04:11.107 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:04:11.107 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:11.107 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T06:04:11.107 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:11.107 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:11.107 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-21 06:02:59.548589897 +0000 2024-09-21T06:04:11.108 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-21 05:58:40.978358034 +0000 2024-09-21T06:04:11.108 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-21 05:58:40.978358034 +0000 2024-09-21T06:04:11.108 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-21 05:58:40.978358034 +0000 2024-09-21T06:04:11.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:04:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:10 smithi089 ceph-mon[33879]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:10 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1512703489' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:04:11.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-21T06:04:11.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-21T06:04:11.171 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000111491 s, 4.6 MB/s 2024-09-21T06:04:11.172 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:04:11.229 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:04:11.229 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:04:11.248 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:04:11.249 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-21T06:04:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:04:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:11.307 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T06:04:11.307 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:11.308 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:11.308 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:03:45.653284669 +0000 2024-09-21T06:04:11.308 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 05:58:32.854743358 +0000 2024-09-21T06:04:11.308 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 05:58:32.854743358 +0000 2024-09-21T06:04:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 05:58:32.854743358 +0000 2024-09-21T06:04:11.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:04:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:04:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:04:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000282161 s, 1.8 MB/s 2024-09-21T06:04:11.379 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:04:11.438 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-21T06:04:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:03:45.653284669 +0000 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 05:58:33.184737151 +0000 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 05:58:33.184737151 +0000 2024-09-21T06:04:11.496 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 05:58:33.184737151 +0000 2024-09-21T06:04:11.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:04:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:04:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:04:11.562 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000235899 s, 2.2 MB/s 2024-09-21T06:04:11.563 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:04:11.621 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:03:45.654284650 +0000 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 05:58:33.511731002 +0000 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 05:58:33.511731002 +0000 2024-09-21T06:04:11.678 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 05:58:33.511731002 +0000 2024-09-21T06:04:11.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:04:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:04:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:04:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000197731 s, 2.6 MB/s 2024-09-21T06:04:11.744 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:04:11.801 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-21T06:04:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:04:11.857 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:03:45.654284650 +0000 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 05:58:33.850724626 +0000 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 05:58:33.850724626 +0000 2024-09-21T06:04:11.858 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 05:58:33.850724626 +0000 2024-09-21T06:04:11.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:04:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:04:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:04:11.922 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000205296 s, 2.5 MB/s 2024-09-21T06:04:11.923 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:04:11.980 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:04:11.980 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:04:12.000 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:04:12.000 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:03:43.406687600 +0000 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 05:58:32.854317484 +0000 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 05:58:32.854317484 +0000 2024-09-21T06:04:12.058 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 05:58:32.854317484 +0000 2024-09-21T06:04:12.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:04:12.129 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:04:12.129 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:04:12.129 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000222372 s, 2.3 MB/s 2024-09-21T06:04:12.130 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:04:12.189 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-21T06:04:12.246 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:03:43.406687600 +0000 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 05:58:33.165309966 +0000 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 05:58:33.165309966 +0000 2024-09-21T06:04:12.247 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 05:58:33.165309966 +0000 2024-09-21T06:04:12.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:04:12.313 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:04:12.313 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:04:12.313 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000217577 s, 2.4 MB/s 2024-09-21T06:04:12.314 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:04:12.373 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-21T06:04:12.429 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:03:43.407687576 +0000 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 05:58:33.483302280 +0000 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 05:58:33.483302280 +0000 2024-09-21T06:04:12.430 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 05:58:33.483302280 +0000 2024-09-21T06:04:12.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:04:12.495 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:04:12.496 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:04:12.496 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000201221 s, 2.5 MB/s 2024-09-21T06:04:12.497 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:04:12.556 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-21T06:04:12.613 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:03:43.407687576 +0000 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 05:58:33.801294593 +0000 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 05:58:33.801294593 +0000 2024-09-21T06:04:12.614 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 05:58:33.801294593 +0000 2024-09-21T06:04:12.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:04:12.681 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:04:12.681 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:04:12.681 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000213719 s, 2.4 MB/s 2024-09-21T06:04:12.682 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:04:12.741 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-09-21T06:04:12.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:04:12.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:12 smithi089 ceph-mon[33879]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:13.002 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:13.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:12 smithi081 ceph-mon[33870]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:13.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:12 smithi017 ceph-mon[31080]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:14 smithi081 ceph-mon[33870]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:14 smithi089 ceph-mon[33879]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:14 smithi017 ceph-mon[31080]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:15.426 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:04:15.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-09-21T06:04:15.709 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:04:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 -- 172.21.15.17:0/934774557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63701036d0 msgr2=0x7f6370103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 --2- 172.21.15.17:0/934774557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63701036d0 0x7f6370103ae0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6360009900 tx=0x7f636002a480 comp rx=0 tx=0).stop 2024-09-21T06:04:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 -- 172.21.15.17:0/934774557 shutdown_connections 2024-09-21T06:04:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 --2- 172.21.15.17:0/934774557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63701036d0 0x7f6370103ae0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 --2- 172.21.15.17:0/934774557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6370104070 0x7f637010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 --2- 172.21.15.17:0/934774557 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 0x7f6370102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 -- 172.21.15.17:0/934774557 >> 172.21.15.17:0/934774557 conn(0x7f63700fdfb0 msgr2=0x7f6370100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 -- 172.21.15.17:0/934774557 shutdown_connections 2024-09-21T06:04:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.195+0000 7f6378159640 1 -- 172.21.15.17:0/934774557 wait complete. 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 Processor -- start 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 -- start start 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 0x7f637010cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63701036d0 0x7f637010b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 0x7f637010bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f637010f2c0 con 0x7f6370104070 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f637010f140 con 0x7f63701036d0 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f6378159640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f637010f440 con 0x7f6370102640 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f63766f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 0x7f637010bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f63766f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 0x7f637010bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37346/0 (socket says 172.21.15.17:37346) 2024-09-21T06:04:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.196+0000 7f63766f6640 1 -- 172.21.15.17:0/3731838242 learned_addr learned my addr 172.21.15.17:0/3731838242 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63756f4640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63701036d0 0x7f637010b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6375ef5640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 0x7f637010cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63766f6640 1 -- 172.21.15.17:0/3731838242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 msgr2=0x7f637010cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63766f6640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 0x7f637010cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63766f6640 1 -- 172.21.15.17:0/3731838242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63701036d0 msgr2=0x7f637010b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63766f6640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63701036d0 0x7f637010b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63766f6640 1 -- 172.21.15.17:0/3731838242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637010c290 con 0x7f6370104070 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6375ef5640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 0x7f637010cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f63766f6640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 0x7f637010bb90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f636800eaa0 tx=0x7f636800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636800cdb0 con 0x7f6370104070 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6368005020 con 0x7f6370104070 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63701a3f80 con 0x7f6370104070 2024-09-21T06:04:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63680116d0 con 0x7f6370104070 2024-09-21T06:04:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.197+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63701a4320 con 0x7f6370104070 2024-09-21T06:04:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.198+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6370102ab0 con 0x7f6370104070 2024-09-21T06:04:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.200+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f63680051d0 con 0x7f6370104070 2024-09-21T06:04:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.201+0000 7f6366ffd640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f635c0b6500 0x7f635c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.201+0000 7f6375ef5640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f635c0b6500 0x7f635c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.201+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f63680e5c90 con 0x7f6370104070 2024-09-21T06:04:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.201+0000 7f6375ef5640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f635c0b6500 0x7f635c0b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f636c0058c0 tx=0x7f636c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.204+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6368016030 con 0x7f6370104070 2024-09-21T06:04:16.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:16.403+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6370063800 con 0x7f635c0b6500 2024-09-21T06:04:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:16 smithi081 ceph-mon[33870]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:17.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:04:17.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:04:17.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:17.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:16 smithi017 ceph-mon[31080]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:17.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:04:17.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:04:17.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:16 smithi089 ceph-mon[33879]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:17.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:04:17.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:04:17.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:17.824 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:17 smithi017 ceph-mon[31080]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:04:18.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:17 smithi081 ceph-mon[33870]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:04:18.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:17 smithi089 ceph-mon[33879]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:04:19.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:18 smithi081 ceph-mon[33870]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:19.023 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:18 smithi017 ceph-mon[31080]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:18 smithi089 ceph-mon[33879]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/4151455303' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da504fcf-fc17-4c8b-a419-69189bf1b15d"} : dispatch 2024-09-21T06:04:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/4151455303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da504fcf-fc17-4c8b-a419-69189bf1b15d"}]': finished 2024-09-21T06:04:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:19 smithi081 ceph-mon[33870]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T06:04:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1884712894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:04:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/4151455303' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da504fcf-fc17-4c8b-a419-69189bf1b15d"} : dispatch 2024-09-21T06:04:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/4151455303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da504fcf-fc17-4c8b-a419-69189bf1b15d"}]': finished 2024-09-21T06:04:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:19 smithi089 ceph-mon[33879]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T06:04:20.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:20.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1884712894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:04:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/4151455303' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da504fcf-fc17-4c8b-a419-69189bf1b15d"} : dispatch 2024-09-21T06:04:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/4151455303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da504fcf-fc17-4c8b-a419-69189bf1b15d"}]': finished 2024-09-21T06:04:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:19 smithi017 ceph-mon[31080]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T06:04:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:20.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1884712894' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:04:21.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:20 smithi081 ceph-mon[33870]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:20 smithi089 ceph-mon[33879]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:20 smithi017 ceph-mon[31080]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:23.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:22 smithi081 ceph-mon[33870]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:22 smithi089 ceph-mon[33879]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:23.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:22 smithi017 ceph-mon[31080]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:25.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:24 smithi081 ceph-mon[33870]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:24 smithi089 ceph-mon[33879]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:24 smithi017 ceph-mon[31080]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:27.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:26 smithi081 ceph-mon[33870]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:26 smithi089 ceph-mon[33879]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:27.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:26 smithi017 ceph-mon[31080]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:28.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:04:28.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:28.036 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:04:28.036 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:28.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:04:28.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:28.953 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:28 smithi017 ceph-mon[31080]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:28.953 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:28 smithi017 ceph-mon[31080]: Deploying daemon osd.0 on smithi017 2024-09-21T06:04:29.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:28 smithi081 ceph-mon[33870]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:29.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:28 smithi081 ceph-mon[33870]: Deploying daemon osd.0 on smithi017 2024-09-21T06:04:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:28 smithi089 ceph-mon[33879]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:28 smithi089 ceph-mon[33879]: Deploying daemon osd.0 on smithi017 2024-09-21T06:04:30.866 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:30 smithi017 ceph-mon[31080]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:30 smithi089 ceph-mon[33879]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:31.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:30 smithi081 ceph-mon[33870]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:32.969 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:32 smithi017 ceph-mon[31080]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:33.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:32 smithi089 ceph-mon[33879]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:33.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:32 smithi081 ceph-mon[33870]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:34 smithi017 ceph-mon[31080]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:34 smithi089 ceph-mon[33879]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:34 smithi081 ceph-mon[33870]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:35.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:35.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:36 smithi089 ceph-mon[33879]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:36 smithi017 ceph-mon[31080]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:37.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:37.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:36 smithi081 ceph-mon[33870]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:37.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:37.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:37.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:37.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:38.120 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-09-21T06:04:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.118+0000 7f6366ffd640 1 -- 172.21.15.17:0/3731838242 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6370063800 con 0x7f635c0b6500 2024-09-21T06:04:38.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.120+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f635c0b6500 msgr2=0x7f635c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.120+0000 7f6378159640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f635c0b6500 0x7f635c0b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f636c0058c0 tx=0x7f636c005850 comp rx=0 tx=0).stop 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 msgr2=0x7f637010bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 0x7f637010bb90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f636800eaa0 tx=0x7f636800ef60 comp rx=0 tx=0).stop 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 shutdown_connections 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f635c0b6500 0x7f635c0b8a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6370104070 0x7f637010bb90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63701036d0 0x7f637010b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 --2- 172.21.15.17:0/3731838242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6370102640 0x7f637010cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 >> 172.21.15.17:0/3731838242 conn(0x7f63700fdfb0 msgr2=0x7f63701069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 shutdown_connections 2024-09-21T06:04:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:04:38.121+0000 7f6378159640 1 -- 172.21.15.17:0/3731838242 wait complete. 2024-09-21T06:04:38.711 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T06:04:38.714 INFO:tasks.cephadm:Deploying osd.1 on smithi081 with /dev/vg_nvme/lv_4... 2024-09-21T06:04:38.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:04:38.942 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:38 smithi017 ceph-mon[31080]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:38.942 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:38.942 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:38.942 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:39.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:38 smithi081 ceph-mon[33870]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:39.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:39.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:39.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:38 smithi089 ceph-mon[33879]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:04:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:40.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:39 smithi017 ceph-mon[31080]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:40.074 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:04:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0[47023]: 2024-09-21T06:04:39.947+0000 7fe6968d4640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:04:40.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:39 smithi089 ceph-mon[33879]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:40.127 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:39 smithi081 ceph-mon[33870]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:40 smithi089 ceph-mon[33879]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:04:41.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:40 smithi017 ceph-mon[31080]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:04:41.191 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:40 smithi081 ceph-mon[33870]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:04:41.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:04:41.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-09-21T06:04:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:04:41.887 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0[47023]: 2024-09-21T06:04:41.837+0000 7fe692856640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:04:41.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0[47023]: 2024-09-21T06:04:41.842+0000 7fe68e654640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi017 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-21T06:04:41.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:41.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:41.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:41.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi017 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:42.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi017 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi017 to 17092M 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.130 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:42.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:04:42.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:04:42.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 -- 172.21.15.81:0/1716666132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8109480 msgr2=0x7f67b810b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 --2- 172.21.15.81:0/1716666132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8109480 0x7f67b810b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009ca0 tx=0x7f67b002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 -- 172.21.15.81:0/1716666132 shutdown_connections 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 --2- 172.21.15.81:0/1716666132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b81068e0 0x7f67b8108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 --2- 172.21.15.81:0/1716666132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8109480 0x7f67b810b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 --2- 172.21.15.81:0/1716666132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b806c340 0x7f67b81063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 -- 172.21.15.81:0/1716666132 >> 172.21.15.81:0/1716666132 conn(0x7f67b80fdfa0 msgr2=0x7f67b8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 -- 172.21.15.81:0/1716666132 shutdown_connections 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.222+0000 7f67bce70640 1 -- 172.21.15.81:0/1716666132 wait complete. 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 Processor -- start 2024-09-21T06:04:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 -- start start 2024-09-21T06:04:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b806c340 0x7f67b819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 0x7f67b819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b8109480 0x7f67b819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810f280 con 0x7f67b806c340 2024-09-21T06:04:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810f100 con 0x7f67b81068e0 2024-09-21T06:04:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67bce70640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67b810f400 con 0x7f67b8109480 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67b5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 0x7f67b819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67b5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 0x7f67b819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46260/0 (socket says 172.21.15.81:46260) 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.223+0000 7f67b5d9b640 1 -- 172.21.15.81:0/3086109257 learned_addr learned my addr 172.21.15.81:0/3086109257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b659c640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b806c340 0x7f67b819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b6d9d640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b8109480 0x7f67b819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b5d9b640 1 -- 172.21.15.81:0/3086109257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b8109480 msgr2=0x7f67b819d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b5d9b640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b8109480 0x7f67b819d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b5d9b640 1 -- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b806c340 msgr2=0x7f67b819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b5d9b640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b806c340 0x7f67b819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b5d9b640 1 -- 172.21.15.81:0/3086109257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b819daa0 con 0x7f67b81068e0 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b659c640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b806c340 0x7f67b819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67b5d9b640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 0x7f67b819c6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67a000d950 tx=0x7f67a000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0017070 con 0x7f67b81068e0 2024-09-21T06:04:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b819dd90 con 0x7f67b81068e0 2024-09-21T06:04:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67a0009c30 con 0x7f67b81068e0 2024-09-21T06:04:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a000f620 con 0x7f67b81068e0 2024-09-21T06:04:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.224+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b81a4490 con 0x7f67b81068e0 2024-09-21T06:04:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.225+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b810afa0 con 0x7f67b81068e0 2024-09-21T06:04:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.228+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f67a0010460 con 0x7f67b81068e0 2024-09-21T06:04:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.229+0000 7f67af7fe640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67a40b6480 0x7f67a40b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:04:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.229+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f67a00e5360 con 0x7f67b81068e0 2024-09-21T06:04:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.229+0000 7f67b659c640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67a40b6480 0x7f67a40b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:04:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.230+0000 7f67b659c640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67a40b6480 0x7f67a40b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67a800bfd0 tx=0x7f67a800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:04:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.231+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67a00ad780 con 0x7f67b81068e0 2024-09-21T06:04:42.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:04:42.424+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f67b8063800 con 0x7f67a40b6480 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:04:43.116 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:04:43.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:04:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:04:43.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:44.055 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:43 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:04:44.055 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:43 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:04:44.055 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:43 smithi081 ceph-mon[33870]: osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] boot 2024-09-21T06:04:44.055 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:43 smithi081 ceph-mon[33870]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T06:04:44.055 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:43 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:44.055 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:43 smithi081 ceph-mon[33870]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:43 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:04:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:43 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:04:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:43 smithi089 ceph-mon[33879]: osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] boot 2024-09-21T06:04:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:43 smithi089 ceph-mon[33879]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T06:04:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:43 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:43 smithi089 ceph-mon[33879]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:43 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:04:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:43 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:04:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:43 smithi017 ceph-mon[31080]: osd.0 [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] boot 2024-09-21T06:04:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:43 smithi017 ceph-mon[31080]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T06:04:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:43 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:04:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:43 smithi017 ceph-mon[31080]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:04:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:44 smithi089 ceph-mon[33879]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:04:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:44 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/2878330868' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"} : dispatch 2024-09-21T06:04:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:44 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"} : dispatch 2024-09-21T06:04:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:44 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"}]': finished 2024-09-21T06:04:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:44 smithi089 ceph-mon[33879]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T06:04:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:04:45.122 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:44 smithi081 ceph-mon[33870]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:04:45.122 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:44 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/2878330868' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"} : dispatch 2024-09-21T06:04:45.122 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:44 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"} : dispatch 2024-09-21T06:04:45.122 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:44 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"}]': finished 2024-09-21T06:04:45.122 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:44 smithi081 ceph-mon[33870]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T06:04:45.122 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:04:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:44 smithi017 ceph-mon[31080]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:04:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:44 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/2878330868' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"} : dispatch 2024-09-21T06:04:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:44 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"} : dispatch 2024-09-21T06:04:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:44 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df0069ef-5308-4521-958f-4c40caa8055c"}]': finished 2024-09-21T06:04:45.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:44 smithi017 ceph-mon[31080]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T06:04:45.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:04:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:45 smithi089 ceph-mon[33879]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:45 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/814269734' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:04:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:45 smithi017 ceph-mon[31080]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:45 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/814269734' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:04:46.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:45 smithi081 ceph-mon[33870]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:46.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:45 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/814269734' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:04:48.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:48 smithi089 ceph-mon[33879]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:48.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:48 smithi017 ceph-mon[31080]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:48.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:48 smithi081 ceph-mon[33870]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:50.221 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:50 smithi081 ceph-mon[33870]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:50.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:50 smithi089 ceph-mon[33879]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:50.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:50 smithi017 ceph-mon[31080]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:52.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:52 smithi089 ceph-mon[33879]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:52.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:52 smithi017 ceph-mon[31080]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:52.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:52 smithi081 ceph-mon[33870]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:53.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:04:53.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:53.390 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:04:53.390 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:53.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:04:53.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:04:54.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:54 smithi089 ceph-mon[33879]: Deploying daemon osd.1 on smithi081 2024-09-21T06:04:54.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:54 smithi089 ceph-mon[33879]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:54.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:54 smithi017 ceph-mon[31080]: Deploying daemon osd.1 on smithi081 2024-09-21T06:04:54.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:54 smithi017 ceph-mon[31080]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:54.464 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:54 smithi081 ceph-mon[33870]: Deploying daemon osd.1 on smithi081 2024-09-21T06:04:54.464 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:54 smithi081 ceph-mon[33870]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:56.244 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:56 smithi081 ceph-mon[33870]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:56.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:56 smithi017 ceph-mon[31080]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:56.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:56 smithi089 ceph-mon[33879]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:58.288 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:04:58 smithi081 ceph-mon[33870]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:58.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:04:58 smithi017 ceph-mon[31080]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:04:58.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:04:58 smithi089 ceph-mon[33879]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:00.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:00 smithi081 ceph-mon[33870]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:00.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:00.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:00.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:00.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:00 smithi017 ceph-mon[31080]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:00.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:00.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:00.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:00.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:00 smithi089 ceph-mon[33879]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:00.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:00.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:00.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:02 smithi017 ceph-mon[31080]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:02.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:02.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:02.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:02 smithi081 ceph-mon[33870]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:02.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:02.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:02.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:02 smithi089 ceph-mon[33879]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:02.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:02.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:02.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:02.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:03.483 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 1 on host 'smithi081' 2024-09-21T06:05:03.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.480+0000 7f67af7fe640 1 -- 172.21.15.81:0/3086109257 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f67b8063800 con 0x7f67a40b6480 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67a40b6480 msgr2=0x7f67a40b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67a40b6480 0x7f67a40b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f67a800bfd0 tx=0x7f67a800b390 comp rx=0 tx=0).stop 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 msgr2=0x7f67b819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 0x7f67b819c6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67a000d950 tx=0x7f67a000de10 comp rx=0 tx=0).stop 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 shutdown_connections 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67a40b6480 0x7f67a40b8990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67b8109480 0x7f67b819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b81068e0 0x7f67b819c6e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 --2- 172.21.15.81:0/3086109257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67b806c340 0x7f67b819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:03.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 >> 172.21.15.81:0/3086109257 conn(0x7f67b80fdfa0 msgr2=0x7f67b8104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:03.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 shutdown_connections 2024-09-21T06:05:03.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:03.482+0000 7f67bce70640 1 -- 172.21.15.81:0/3086109257 wait complete. 2024-09-21T06:05:04.096 DEBUG:teuthology.orchestra.run.smithi081:osd.1> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T06:05:04.099 INFO:tasks.cephadm:Deploying osd.2 on smithi089 with /dev/vg_nvme/lv_4... 2024-09-21T06:05:04.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:05:04.352 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:05:04.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:04 smithi017 ceph-mon[31080]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:04.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:04.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:04.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:04.437 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:04 smithi081 ceph-mon[33870]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:04.438 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:04.438 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:04.438 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:04.472 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:04 smithi089 ceph-mon[33879]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:04.472 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:04.472 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:04.472 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:05.508 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1[37832]: 2024-09-21T06:05:05.287+0000 7f5e729af640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:05:06.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:06 smithi017 ceph-mon[31080]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:06.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:06 smithi017 ceph-mon[31080]: from='osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:05:06.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:06 smithi017 ceph-mon[31080]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:05:06.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:06 smithi081 ceph-mon[33870]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:06.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:06 smithi081 ceph-mon[33870]: from='osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:05:06.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:06 smithi081 ceph-mon[33870]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:05:06.584 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:06 smithi089 ceph-mon[33879]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:06.585 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:06 smithi089 ceph-mon[33879]: from='osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:05:06.585 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:06 smithi089 ceph-mon[33879]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:05:06.666 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:05:06.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-09-21T06:05:06.935 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:05:07.334 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:05:07.334 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:07.335 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 -- 172.21.15.89:0/1051536339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c103710 msgr2=0x7efc9c103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 --2- 172.21.15.89:0/1051536339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c103710 0x7efc9c103b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc84009900 tx=0x7efc8402a480 comp rx=0 tx=0).stop 2024-09-21T06:05:07.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 -- 172.21.15.89:0/1051536339 shutdown_connections 2024-09-21T06:05:07.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 --2- 172.21.15.89:0/1051536339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc9c1040b0 0x7efc9c10aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.426 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 --2- 172.21.15.89:0/1051536339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c103710 0x7efc9c103b20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 --2- 172.21.15.89:0/1051536339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c102680 0x7efc9c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 -- 172.21.15.89:0/1051536339 >> 172.21.15.89:0/1051536339 conn(0x7efc9c0fdff0 msgr2=0x7efc9c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 -- 172.21.15.89:0/1051536339 shutdown_connections 2024-09-21T06:05:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.423+0000 7efca112d640 1 -- 172.21.15.89:0/1051536339 wait complete. 2024-09-21T06:05:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.424+0000 7efca112d640 1 Processor -- start 2024-09-21T06:05:07.427 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.424+0000 7efca112d640 1 -- start start 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efca112d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 0x7efc9c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efca112d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc9c103710 0x7efc9c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efca112d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c1040b0 0x7efc9c19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efca112d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c10f300 con 0x7efc9c1040b0 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efca112d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c10f180 con 0x7efc9c103710 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efca112d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c10f480 con 0x7efc9c102680 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 0x7efc9c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 0x7efc9c199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35590/0 (socket says 172.21.15.89:35590) 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 -- 172.21.15.89:0/4215649390 learned_addr learned my addr 172.21.15.89:0/4215649390 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9a59c640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc9c103710 0x7efc9c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9b59e640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c1040b0 0x7efc9c19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 -- 172.21.15.89:0/4215649390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc9c103710 msgr2=0x7efc9c19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc9c103710 0x7efc9c19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 -- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c1040b0 msgr2=0x7efc9c19b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c1040b0 0x7efc9c19b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 -- 172.21.15.89:0/4215649390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c19b8a0 con 0x7efc9c102680 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9b59e640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c1040b0 0x7efc9c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc9ad9d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 0x7efc9c199f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00d950 tx=0x7efc8c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.425+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c017070 con 0x7efc9c102680 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.426+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc8c009c30 con 0x7efc9c102680 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.426+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c19bb90 con 0x7efc9c102680 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.426+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00f620 con 0x7efc9c102680 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.426+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c1a2320 con 0x7efc9c102680 2024-09-21T06:05:07.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.427+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c102af0 con 0x7efc9c102680 2024-09-21T06:05:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.428+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7efc8c010460 con 0x7efc9c102680 2024-09-21T06:05:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.429+0000 7efc93fff640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efc880b6480 0x7efc880b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.429+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7efc8c0e5580 con 0x7efc9c102680 2024-09-21T06:05:07.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.429+0000 7efc9a59c640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efc880b6480 0x7efc880b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:07.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.430+0000 7efc9a59c640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efc880b6480 0x7efc880b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc84005760 tx=0x7efc84031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:07.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.432+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc8c0ad780 con 0x7efc9c102680 2024-09-21T06:05:07.507 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1[37832]: 2024-09-21T06:05:07.146+0000 7f5e6e931640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:05:07.507 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1[37832]: 2024-09-21T06:05:07.150+0000 7f5e6a72f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:07.622+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7efc9c063800 con 0x7efc880b6480 2024-09-21T06:05:07.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:05:07.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:07.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi081 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:08.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:08.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:08.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:08.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:08.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi081 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:08.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:08.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi081 2024-09-21T06:05:08.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:08.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:09.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:09 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:05:09.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:09 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:05:09.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:09 smithi089 ceph-mon[33879]: osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] boot 2024-09-21T06:05:09.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:09 smithi089 ceph-mon[33879]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T06:05:09.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:09.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:09 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:05:09.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:09 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:05:09.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:09 smithi081 ceph-mon[33870]: osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] boot 2024-09-21T06:05:09.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:09 smithi081 ceph-mon[33870]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T06:05:09.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:09.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:09 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:05:09.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:09 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:05:09.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:09 smithi017 ceph-mon[31080]: osd.1 [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] boot 2024-09-21T06:05:09.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:09 smithi017 ceph-mon[31080]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T06:05:09.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:05:10.471 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:10.471 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:05:10.471 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/139962215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"} : dispatch 2024-09-21T06:05:10.471 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"} : dispatch 2024-09-21T06:05:10.471 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"}]': finished 2024-09-21T06:05:10.472 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T06:05:10.472 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:10.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:10.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:05:10.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/139962215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"} : dispatch 2024-09-21T06:05:10.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"} : dispatch 2024-09-21T06:05:10.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"}]': finished 2024-09-21T06:05:10.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T06:05:10.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:10.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:05:10.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:05:10.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/139962215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"} : dispatch 2024-09-21T06:05:10.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"} : dispatch 2024-09-21T06:05:10.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51f5eff4-8860-44d4-a452-8c34286ceca4"}]': finished 2024-09-21T06:05:10.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T06:05:10.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:11.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:11 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/1323246920' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:05:11.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:11 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/1323246920' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:05:11.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:11 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/1323246920' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:05:12.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:12 smithi081 ceph-mon[33870]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:12.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:12 smithi089 ceph-mon[33879]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:12.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:12 smithi017 ceph-mon[31080]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:14.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:14 smithi081 ceph-mon[33870]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:14.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:14 smithi089 ceph-mon[33879]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:14.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:14 smithi017 ceph-mon[31080]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:16.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:16 smithi089 ceph-mon[33879]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:16.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:16 smithi081 ceph-mon[33870]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:16 smithi017 ceph-mon[31080]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:18.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:18 smithi081 ceph-mon[33870]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:18.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:05:18.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:18.533 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:18 smithi089 ceph-mon[33879]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:18.534 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:05:18.534 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:18 smithi017 ceph-mon[31080]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:05:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:19.435 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:19 smithi089 ceph-mon[33879]: Deploying daemon osd.2 on smithi089 2024-09-21T06:05:19.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:19 smithi081 ceph-mon[33870]: Deploying daemon osd.2 on smithi089 2024-09-21T06:05:19.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:19 smithi017 ceph-mon[31080]: Deploying daemon osd.2 on smithi089 2024-09-21T06:05:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:20 smithi089 ceph-mon[33879]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:20.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:20 smithi081 ceph-mon[33870]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:20.641 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:20 smithi017 ceph-mon[31080]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:22.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:22 smithi081 ceph-mon[33870]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:22.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:22 smithi089 ceph-mon[33879]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:22 smithi017 ceph-mon[31080]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:24.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:24 smithi089 ceph-mon[33879]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:24.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:24 smithi081 ceph-mon[33870]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:24 smithi017 ceph-mon[31080]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:25.239 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:25.239 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:25.239 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:25.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:25.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:25.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:25.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:25.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:25.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:26.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:26 smithi089 ceph-mon[33879]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:26 smithi017 ceph-mon[31080]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:27.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:26 smithi081 ceph-mon[33870]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:28.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:28 smithi089 ceph-mon[33879]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:28 smithi017 ceph-mon[31080]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:28.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:28.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:28.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:28 smithi081 ceph-mon[33870]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:28.702 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 2 on host 'smithi089' 2024-09-21T06:05:28.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.699+0000 7efc93fff640 1 -- 172.21.15.89:0/4215649390 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efc9c063800 con 0x7efc880b6480 2024-09-21T06:05:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efc880b6480 msgr2=0x7efc880b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efc880b6480 0x7efc880b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc84005760 tx=0x7efc84031400 comp rx=0 tx=0).stop 2024-09-21T06:05:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 msgr2=0x7efc9c199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 0x7efc9c199f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00d950 tx=0x7efc8c00de10 comp rx=0 tx=0).stop 2024-09-21T06:05:28.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 shutdown_connections 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efc880b6480 0x7efc880b8990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc9c1040b0 0x7efc9c19b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc9c103710 0x7efc9c19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 --2- 172.21.15.89:0/4215649390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc9c102680 0x7efc9c199f00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 >> 172.21.15.89:0/4215649390 conn(0x7efc9c0fdff0 msgr2=0x7efc9c106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 shutdown_connections 2024-09-21T06:05:28.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:05:28.702+0000 7efca112d640 1 -- 172.21.15.89:0/4215649390 wait complete. 2024-09-21T06:05:29.289 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:29 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:29.289 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:29 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:29.289 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:29 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:29.315 DEBUG:teuthology.orchestra.run.smithi089:osd.2> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T06:05:29.317 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2024-09-21T06:05:29.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:05:29.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:29 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:29.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:29 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:29.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:29 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:29.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:29 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:29.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:29 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:29.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:29 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:29.582 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:30.747 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:30 smithi089 ceph-mon[33879]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:30.975 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:30 smithi017 ceph-mon[31080]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:31.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:30 smithi081 ceph-mon[33870]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:31.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:30 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2[38266]: 2024-09-21T06:05:30.862+0000 7fb0cd6d5640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:05:31.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:31 smithi017 ceph-mon[31080]: from='osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:05:31.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:31 smithi017 ceph-mon[31080]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:05:32.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:31 smithi081 ceph-mon[33870]: from='osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:05:32.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:31 smithi081 ceph-mon[33870]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:05:32.036 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:05:32.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-09-21T06:05:32.094 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:31 smithi089 ceph-mon[33879]: from='osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:05:32.095 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:31 smithi089 ceph-mon[33879]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:05:32.380 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:05:32.752 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:32.752 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:32.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 -- 172.21.15.17:0/1410877896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 msgr2=0x7f24b8105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 --2- 172.21.15.17:0/1410877896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8105140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009900 tx=0x7f24a002a410 comp rx=0 tx=0).stop 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 -- 172.21.15.17:0/1410877896 shutdown_connections 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 --2- 172.21.15.17:0/1410877896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24b81083a0 0x7f24b810a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 --2- 172.21.15.17:0/1410877896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b8105780 0x7f24b8107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 --2- 172.21.15.17:0/1410877896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8105140 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 -- 172.21.15.17:0/1410877896 >> 172.21.15.17:0/1410877896 conn(0x7f24b80fd760 msgr2=0x7f24b80ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 -- 172.21.15.17:0/1410877896 shutdown_connections 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.847+0000 7f24bec29640 1 -- 172.21.15.17:0/1410877896 wait complete. 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 Processor -- start 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 -- start start 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:32.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24b8105780 0x7f24b819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b81083a0 0x7f24b819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24b810e1a0 con 0x7f24b8102d00 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24b810e020 con 0x7f24b81083a0 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.848+0000 7f24bec29640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f24b810e320 con 0x7f24b8105780 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43780/0 (socket says 172.21.15.17:43780) 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 -- 172.21.15.17:0/3449838153 learned_addr learned my addr 172.21.15.17:0/3449838153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bd1c6640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b81083a0 0x7f24b819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24b7fff640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24b8105780 0x7f24b819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 -- 172.21.15.17:0/3449838153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24b8105780 msgr2=0x7f24b819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24b8105780 0x7f24b819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:32.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 -- 172.21.15.17:0/3449838153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b81083a0 msgr2=0x7f24b819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b81083a0 0x7f24b819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 -- 172.21.15.17:0/3449838153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b819b930 con 0x7f24b8102d00 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bc9c5640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8199f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24a0005760 tx=0x7f24a0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a003f070 con 0x7f24b8102d00 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24a0031da0 con 0x7f24b8102d00 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0035030 con 0x7f24b8102d00 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.849+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b819bbc0 con 0x7f24b8102d00 2024-09-21T06:05:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.850+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81a2320 con 0x7f24b8102d00 2024-09-21T06:05:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.851+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8105c50 con 0x7f24b8102d00 2024-09-21T06:05:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.852+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f24a0042070 con 0x7f24b8102d00 2024-09-21T06:05:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.853+0000 7f24b5ffb640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24a40b6500 0x7f24a40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.854+0000 7f24b7fff640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24a40b6500 0x7f24a40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.854+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f24a0106c10 con 0x7f24b8102d00 2024-09-21T06:05:32.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.854+0000 7f24b7fff640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24a40b6500 0x7f24a40b8a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f24a8005c40 tx=0x7f24a8005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:32.857+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24a00cebd0 con 0x7f24b8102d00 2024-09-21T06:05:33.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:33.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:33.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:33.057+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f24b8063800 con 0x7f24a40b6500 2024-09-21T06:05:33.116 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2[38266]: 2024-09-21T06:05:32.716+0000 7fb0c9657640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:05:33.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2[38266]: 2024-09-21T06:05:32.720+0000 7fb0c5455640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:33.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:33.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:33.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:34.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi089 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:34.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:34.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi089 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:34.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:34.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi089 2024-09-21T06:05:34.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi089 to 17087M 2024-09-21T06:05:34.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:05:34.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:05:34.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:34.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:34.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:34.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:34.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:34.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:05:34.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:05:34.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:34.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:34.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] boot 2024-09-21T06:05:34.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T06:05:34.929 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] boot 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T06:05:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:05:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:05:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:05:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: osd.2 [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] boot 2024-09-21T06:05:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T06:05:35.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:05:36.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:35 smithi081 ceph-mon[33870]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:05:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:35 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3558445915' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7b1c53e-ef58-4c7b-8af8-4f3b6401336b"} : dispatch 2024-09-21T06:05:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:35 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3558445915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7b1c53e-ef58-4c7b-8af8-4f3b6401336b"}]': finished 2024-09-21T06:05:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:35 smithi081 ceph-mon[33870]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T06:05:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:36.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:36.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:35 smithi017 ceph-mon[31080]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:05:36.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:35 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3558445915' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7b1c53e-ef58-4c7b-8af8-4f3b6401336b"} : dispatch 2024-09-21T06:05:36.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:35 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3558445915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7b1c53e-ef58-4c7b-8af8-4f3b6401336b"}]': finished 2024-09-21T06:05:36.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:35 smithi017 ceph-mon[31080]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T06:05:36.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:36.031 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:36.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:35 smithi089 ceph-mon[33879]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:05:36.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:35 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3558445915' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e7b1c53e-ef58-4c7b-8af8-4f3b6401336b"} : dispatch 2024-09-21T06:05:36.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:35 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3558445915' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7b1c53e-ef58-4c7b-8af8-4f3b6401336b"}]': finished 2024-09-21T06:05:36.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:35 smithi089 ceph-mon[33879]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T06:05:36.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:36.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:36 smithi081 ceph-mon[33870]: pgmap v94: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:36 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1683097532' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:05:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:36 smithi081 ceph-mon[33870]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:05:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:36 smithi089 ceph-mon[33879]: pgmap v94: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:36 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1683097532' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:05:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:36 smithi089 ceph-mon[33879]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:05:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:36 smithi017 ceph-mon[31080]: pgmap v94: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:36 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1683097532' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:05:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:36 smithi017 ceph-mon[31080]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:05:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:05:37.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51880]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:05:37.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51880]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:37.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:37.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51880]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:37.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:05:37.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:37.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:37.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51883]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:37.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51872]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:05:37.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51872]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:37.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:37.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51872]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:37.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51875]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:05:37.888 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51875]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:37.889 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:37.889 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:05:37 smithi017 sudo[51875]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41684]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41684]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41684]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41687]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41687]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41687]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.008 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41678]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:05:38.008 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.008 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.008 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41678]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.009 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41681]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:05:38.009 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41681]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.009 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.009 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:05:37 smithi081 sudo[41681]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.116 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41866]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:05:38.116 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41866]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41866]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41869]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:05:38.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41869]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41869]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41872]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:05:38.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41872]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41872]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41875]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:05:38.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41875]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:05:38.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:05:38.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:37 smithi089 sudo[41875]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:05:38.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:38.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:38 smithi089 ceph-mon[33879]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:38 smithi081 ceph-mon[33870]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:38.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:05:38.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:38.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:05:38.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:05:38.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:05:38.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:05:38.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:38 smithi017 ceph-mon[31080]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:05:39.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:39.451+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f24a00ca740 con 0x7f24b8102d00 2024-09-21T06:05:39.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:39 smithi081 ceph-mon[33870]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:05:39.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:39 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:39.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:39 smithi089 ceph-mon[33879]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:05:39.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:39 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:39 smithi017 ceph-mon[31080]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:05:39.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:39 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:40.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:40 smithi017 ceph-mon[31080]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:40.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:40 smithi017 ceph-mon[31080]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T06:05:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:40 smithi081 ceph-mon[33870]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:40 smithi081 ceph-mon[33870]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T06:05:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:40 smithi089 ceph-mon[33879]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:40.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:40 smithi089 ceph-mon[33879]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T06:05:42.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:42 smithi081 ceph-mon[33870]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:42.817 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:42 smithi017 ceph-mon[31080]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:42.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:42 smithi089 ceph-mon[33879]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:44.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:44 smithi017 ceph-mon[31080]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:44.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:05:44.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:44.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:44 smithi081 ceph-mon[33870]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:44.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:05:44.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:44 smithi089 ceph-mon[33879]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:44.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:05:44.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:45.536 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:45 smithi017 ceph-mon[31080]: Deploying daemon osd.3 on smithi017 2024-09-21T06:05:45.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:45 smithi081 ceph-mon[33870]: Deploying daemon osd.3 on smithi017 2024-09-21T06:05:45.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:45 smithi089 ceph-mon[33879]: Deploying daemon osd.3 on smithi017 2024-09-21T06:05:46.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:46 smithi081 ceph-mon[33870]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:46.791 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:46 smithi017 ceph-mon[31080]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:46.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:46 smithi089 ceph-mon[33879]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:48 smithi081 ceph-mon[33870]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:48.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:48 smithi089 ceph-mon[33879]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:48.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:48 smithi017 ceph-mon[31080]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:50 smithi081 ceph-mon[33870]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:50.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:50 smithi017 ceph-mon[31080]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:50.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:50.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:50.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:50.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:50 smithi089 ceph-mon[33879]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:52 smithi081 ceph-mon[33870]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:52 smithi089 ceph-mon[33879]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:52 smithi017 ceph-mon[31080]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:54.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:54.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:54.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:53 smithi089 ceph-mon[33879]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:54.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:54.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:54.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:53 smithi017 ceph-mon[31080]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:54.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.160+0000 7f24b5ffb640 1 -- 172.21.15.17:0/3449838153 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24b8063800 con 0x7f24a40b6500 2024-09-21T06:05:54.163 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24a40b6500 msgr2=0x7f24a40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24a40b6500 0x7f24a40b8a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f24a8005c40 tx=0x7f24a8005bd0 comp rx=0 tx=0).stop 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 msgr2=0x7f24b8199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8199f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24a0005760 tx=0x7f24a0003d50 comp rx=0 tx=0).stop 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 shutdown_connections 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24a40b6500 0x7f24a40b8a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24b81083a0 0x7f24b819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24b8105780 0x7f24b819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 --2- 172.21.15.17:0/3449838153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24b8102d00 0x7f24b8199f00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:54.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 >> 172.21.15.17:0/3449838153 conn(0x7f24b80fd760 msgr2=0x7f24b80ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:54.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 shutdown_connections 2024-09-21T06:05:54.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:05:54.163+0000 7f24bec29640 1 -- 172.21.15.17:0/3449838153 wait complete. 2024-09-21T06:05:54.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:54.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:54.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:53 smithi081 ceph-mon[33870]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:54.776 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T06:05:54.778 INFO:tasks.cephadm:Deploying osd.4 on smithi081 with /dev/vg_nvme/lv_3... 2024-09-21T06:05:54.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:05:54.981 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:54.981 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:54.982 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:05:55.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:55.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:55.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:55.151 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:05:55.152 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:55.152 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:55.954 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:55 smithi017 ceph-mon[31080]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:56.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:55 smithi089 ceph-mon[33879]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:56.152 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:55 smithi081 ceph-mon[33870]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:56.284 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:05:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:05:55.950+0000 7f36925f5640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:05:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:56 smithi089 ceph-mon[33879]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:05:57.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:56 smithi017 ceph-mon[31080]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:05:57.253 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:56 smithi081 ceph-mon[33870]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:05:57.582 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:05:57.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-09-21T06:05:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:05:57.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:57 smithi081 ceph-mon[33870]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:05:57.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:57 smithi081 ceph-mon[33870]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:05:57.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:57 smithi081 ceph-mon[33870]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:05:57.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:57 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:57.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:57 smithi081 ceph-mon[33870]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:58.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:57 smithi089 ceph-mon[33879]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:05:58.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:57 smithi089 ceph-mon[33879]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:05:58.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:57 smithi089 ceph-mon[33879]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:05:58.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:57 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:58.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:57 smithi089 ceph-mon[33879]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:58.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:57 smithi017 ceph-mon[31080]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:05:58.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:57 smithi017 ceph-mon[31080]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:05:58.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:57 smithi017 ceph-mon[31080]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:05:58.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:57 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:58.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:57 smithi017 ceph-mon[31080]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:05:58.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/3063208536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 msgr2=0x7f9c5810a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/3063208536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5810a880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009ca0 tx=0x7f9c5002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/3063208536 shutdown_connections 2024-09-21T06:05:58.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/3063208536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5810a880 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/3063208536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c58105750 0x7f9c58107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/3063208536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c58102cf0 0x7f9c58105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/3063208536 >> 172.21.15.81:0/3063208536 conn(0x7f9c580fd770 msgr2=0x7f9c580ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/3063208536 shutdown_connections 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.352+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/3063208536 wait complete. 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 Processor -- start 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 -- start start 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c58102cf0 0x7f9c58199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c58105750 0x7f9c5819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5810e1e0 con 0x7f9c58105750 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5810e060 con 0x7f9c58108370 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5fb0e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5810e360 con 0x7f9c58102cf0 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5e0ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5e0ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5819b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37896/0 (socket says 172.21.15.81:37896) 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5e0ab640 1 -- 172.21.15.81:0/2708458148 learned_addr learned my addr 172.21.15.81:0/2708458148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.353+0000 7f9c5d0a9640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c58105750 0x7f9c5819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5d8aa640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c58102cf0 0x7f9c58199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5e0ab640 1 -- 172.21.15.81:0/2708458148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c58102cf0 msgr2=0x7f9c58199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5e0ab640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c58102cf0 0x7f9c58199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5e0ab640 1 -- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c58105750 msgr2=0x7f9c5819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:05:58.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5e0ab640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c58105750 0x7f9c5819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5e0ab640 1 -- 172.21.15.81:0/2708458148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5819b900 con 0x7f9c58108370 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5e0ab640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5819b0e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c50005e30 tx=0x7f9c50003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50032e90 con 0x7f9c58108370 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5819bb90 con 0x7f9c58108370 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c500044d0 con 0x7f9c58108370 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50030c70 con 0x7f9c58108370 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.354+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581a22f0 con 0x7f9c58108370 2024-09-21T06:05:58.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.355+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c58105c20 con 0x7f9c58108370 2024-09-21T06:05:58.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.357+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9c50004040 con 0x7f9c58108370 2024-09-21T06:05:58.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.357+0000 7f9c4effd640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9c440b6510 0x7f9c440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:05:58.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.358+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3389+0+0 (secure 0 0 0) 0x7f9c50107430 con 0x7f9c58108370 2024-09-21T06:05:58.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.358+0000 7f9c5d8aa640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9c440b6510 0x7f9c440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:05:58.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.358+0000 7f9c5d8aa640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9c440b6510 0x7f9c440b8a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009b60 tx=0x7f9c54005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:05:58.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.362+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c500cf000 con 0x7f9c58108370 2024-09-21T06:05:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:05:58.556+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9c58063800 con 0x7f9c440b6510 2024-09-21T06:05:58.637 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:05:58.302+0000 7f368e577640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:05:58.637 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:05:58.307+0000 7f368636d640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi017 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:59.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] boot 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:05:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi017 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] boot 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:05:59.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.161 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi017 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi017 to 8546M 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.162 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581]' entity='osd.3' 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:05:59.163 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: osd.3 [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] boot 2024-09-21T06:05:59.164 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:05:59.164 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:05:59.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:59 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:05:59.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:59 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:05:59.948 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:59 smithi081 ceph-mon[33870]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:05:59.949 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:05:59 smithi081 ceph-mon[33870]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:06:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:59 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:06:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:59 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:06:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:59 smithi089 ceph-mon[33879]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:05:59 smithi089 ceph-mon[33879]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:06:00.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:59 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:06:00.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:59 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:06:00.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:59 smithi017 ceph-mon[31080]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:00.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:05:59 smithi017 ceph-mon[31080]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/1364198981' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"} : dispatch 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"} : dispatch 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"}]': finished 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/3175426476' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T06:06:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/1364198981' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"} : dispatch 2024-09-21T06:06:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"} : dispatch 2024-09-21T06:06:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"}]': finished 2024-09-21T06:06:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:06:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/3175426476' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T06:06:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/1364198981' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"} : dispatch 2024-09-21T06:06:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"} : dispatch 2024-09-21T06:06:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1daaade6-5a17-4875-9622-9e9a5760a3cb"}]': finished 2024-09-21T06:06:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:06:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:02.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:02.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/3175426476' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:04.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:04 smithi017 ceph-mon[31080]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:04.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:04 smithi081 ceph-mon[33870]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:04.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:04 smithi089 ceph-mon[33879]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:06.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:06 smithi017 ceph-mon[31080]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:06:06.510 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:06 smithi081 ceph-mon[33870]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:06:06.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:06 smithi089 ceph-mon[33879]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:06:08.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:08 smithi081 ceph-mon[33870]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T06:06:08.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:08 smithi017 ceph-mon[31080]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T06:06:08.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:08 smithi089 ceph-mon[33879]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T06:06:10.290 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:10 smithi081 ceph-mon[33870]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T06:06:10.290 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:06:10.290 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:10.291 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:10 smithi081 ceph-mon[33870]: Deploying daemon osd.4 on smithi081 2024-09-21T06:06:10.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:10 smithi017 ceph-mon[31080]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T06:06:10.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:06:10.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:10.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:10 smithi017 ceph-mon[31080]: Deploying daemon osd.4 on smithi081 2024-09-21T06:06:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:10 smithi089 ceph-mon[33879]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T06:06:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:06:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:10 smithi089 ceph-mon[33879]: Deploying daemon osd.4 on smithi081 2024-09-21T06:06:12.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:12 smithi081 ceph-mon[33870]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:06:12.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:12 smithi017 ceph-mon[31080]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:06:12.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:12 smithi089 ceph-mon[33879]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:06:14.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:14 smithi017 ceph-mon[31080]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:06:14.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:14 smithi081 ceph-mon[33870]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:06:14.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:14 smithi089 ceph-mon[33879]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:06:16.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:16 smithi017 ceph-mon[31080]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:06:16.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:16.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:16.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:16.484 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:16 smithi081 ceph-mon[33870]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:06:16.484 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:16.484 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:16.484 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:16.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:16 smithi089 ceph-mon[33879]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:06:16.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:18.428 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:18 smithi081 ceph-mon[33870]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:18.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:18 smithi089 ceph-mon[33879]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:18 smithi017 ceph-mon[31080]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:19.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.477+0000 7f9c4effd640 1 -- 172.21.15.81:0/2708458148 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c58063800 con 0x7f9c440b6510 2024-09-21T06:06:19.479 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 4 on host 'smithi081' 2024-09-21T06:06:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9c440b6510 msgr2=0x7f9c440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9c440b6510 0x7f9c440b8a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009b60 tx=0x7f9c54005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 msgr2=0x7f9c5819b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5819b0e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c50005e30 tx=0x7f9c50003ba0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 shutdown_connections 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9c440b6510 0x7f9c440b8a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c58105750 0x7f9c5819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c58108370 0x7f9c5819b0e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 --2- 172.21.15.81:0/2708458148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c58102cf0 0x7f9c58199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 >> 172.21.15.81:0/2708458148 conn(0x7f9c580fd770 msgr2=0x7f9c580ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.479+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 shutdown_connections 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:06:19.480+0000 7f9c5fb0e640 1 -- 172.21.15.81:0/2708458148 wait complete. 2024-09-21T06:06:20.170 DEBUG:teuthology.orchestra.run.smithi081:osd.4> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T06:06:20.173 INFO:tasks.cephadm:Deploying osd.5 on smithi089 with /dev/vg_nvme/lv_3... 2024-09-21T06:06:20.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:06:20.429 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:06:20.726 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:20 smithi089 ceph-mon[33879]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:20.726 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.726 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.726 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.726 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.730 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:20 smithi081 ceph-mon[33870]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:20.730 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.730 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.730 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.730 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:20 smithi017 ceph-mon[31080]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:20.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:22 smithi081 ceph-mon[33870]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:22.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:22 smithi081 ceph-mon[33870]: from='osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:06:22.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:22 smithi081 ceph-mon[33870]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:06:22.764 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:06:22 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:06:22.383+0000 7f382c692640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:06:22.884 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:22 smithi089 ceph-mon[33879]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:22.884 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:22 smithi089 ceph-mon[33879]: from='osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:06:22.884 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:22 smithi089 ceph-mon[33879]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:06:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:22 smithi017 ceph-mon[31080]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:22 smithi017 ceph-mon[31080]: from='osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:06:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:22 smithi017 ceph-mon[31080]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:06:22.943 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:06:22.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-09-21T06:06:23.234 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:06:23.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:06:23.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:06:23.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:06:23.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:23.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:06:23.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:23 smithi089 ceph-mon[33879]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:06:23.757 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:06:23.482+0000 7f3828614640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:06:23.757 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:06:23.488+0000 7f3824412640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:23.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:23.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:23.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:23.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:23.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:23 smithi081 ceph-mon[33870]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 -- 172.21.15.89:0/3220458056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1094a0 msgr2=0x7f492c10b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 --2- 172.21.15.89:0/3220458056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1094a0 0x7f492c10b9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4924009ca0 tx=0x7f492402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 -- 172.21.15.89:0/3220458056 shutdown_connections 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 --2- 172.21.15.89:0/3220458056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492c1025a0 0x7f492c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 --2- 172.21.15.89:0/3220458056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1094a0 0x7f492c10b9b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 --2- 172.21.15.89:0/3220458056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492c101b70 0x7f492c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 -- 172.21.15.89:0/3220458056 >> 172.21.15.89:0/3220458056 conn(0x7f492c0fd760 msgr2=0x7f492c0ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 -- 172.21.15.89:0/3220458056 shutdown_connections 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.759+0000 7f4934719640 1 -- 172.21.15.89:0/3220458056 wait complete. 2024-09-21T06:06:23.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 Processor -- start 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 -- start start 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492c101b70 0x7f492c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 0x7f492c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492c1094a0 0x7f492c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10f2b0 con 0x7f492c1094a0 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10f130 con 0x7f492c101b70 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4934719640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10f430 con 0x7f492c1025a0 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 0x7f492c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 0x7f492c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39598/0 (socket says 172.21.15.89:39598) 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 -- 172.21.15.89:0/1616313003 learned_addr learned my addr 172.21.15.89:0/1616313003 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f49324b5640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492c101b70 0x7f492c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 -- 172.21.15.89:0/1616313003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492c101b70 msgr2=0x7f492c199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492c101b70 0x7f492c199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 -- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492c1094a0 msgr2=0x7f492c19b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492c1094a0 0x7f492c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 -- 172.21.15.89:0/1616313003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c19b820 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f4931cb4640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 0x7f492c19a4f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c920 tx=0x7f491c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.760+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c007c70 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.761+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c19bb10 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.761+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f491c007e10 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.761+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0186f0 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.761+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c1a22a0 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.762+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c0ff280 con 0x7f492c1025a0 2024-09-21T06:06:23.779 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.763+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f491c00f450 con 0x7f492c1025a0 2024-09-21T06:06:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.764+0000 7f49237fe640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49180b6510 0x7f49180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.764+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f491c0e6670 con 0x7f492c1025a0 2024-09-21T06:06:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.764+0000 7f49324b5640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49180b6510 0x7f49180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.765+0000 7f49324b5640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49180b6510 0x7f49180b8a20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4928009aa0 tx=0x7f4928005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:23.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.767+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f491c014030 con 0x7f492c1025a0 2024-09-21T06:06:23.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:06:23.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:23.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:23.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:23.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:23 smithi017 ceph-mon[31080]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:06:23.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:23.955+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f492c063800 con 0x7f49180b6510 2024-09-21T06:06:24.588 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:24.588 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi081 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:24.589 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi081 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi081 2024-09-21T06:06:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-21T06:06:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T06:06:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:06:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:06:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:25 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:06:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:25 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:06:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:25 smithi089 ceph-mon[33879]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:06:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:25 smithi089 ceph-mon[33879]: osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] boot 2024-09-21T06:06:25.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:25 smithi089 ceph-mon[33879]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:06:25.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:25 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:06:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:25 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:06:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:25 smithi081 ceph-mon[33870]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:06:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:25 smithi081 ceph-mon[33870]: osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] boot 2024-09-21T06:06:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:25 smithi081 ceph-mon[33870]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:06:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:25 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:06:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:25 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:06:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:25 smithi017 ceph-mon[31080]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:06:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:25 smithi017 ceph-mon[31080]: osd.4 [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] boot 2024-09-21T06:06:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:25 smithi017 ceph-mon[31080]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:06:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:06:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T06:06:26.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/1427566787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"} : dispatch 2024-09-21T06:06:26.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"} : dispatch 2024-09-21T06:06:26.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"}]': finished 2024-09-21T06:06:26.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:06:26.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/1427566787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"} : dispatch 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"} : dispatch 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"}]': finished 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:06:26.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/1427566787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"} : dispatch 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"} : dispatch 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0cf7ef-eab3-43dc-80e8-c2112eb30951"}]': finished 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:06:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:27.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:27 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/2931958328' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:27.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:27 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/2931958328' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:27.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:27 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/2931958328' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:28.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:28 smithi081 ceph-mon[33870]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:28.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:28 smithi089 ceph-mon[33879]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:28.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:28 smithi017 ceph-mon[31080]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:30.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:30 smithi089 ceph-mon[33879]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:30 smithi017 ceph-mon[31080]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:31.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:30 smithi081 ceph-mon[33870]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:32.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:32 smithi089 ceph-mon[33879]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:32.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:32 smithi017 ceph-mon[31080]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:33.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:32 smithi081 ceph-mon[33870]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:34.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:34 smithi089 ceph-mon[33879]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:34 smithi017 ceph-mon[31080]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:35.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:34 smithi081 ceph-mon[33870]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:35.776 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:06:35.776 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:35.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:06:35.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:36.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:06:36.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:36.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:36 smithi017 ceph-mon[31080]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:36.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:36 smithi017 ceph-mon[31080]: Deploying daemon osd.5 on smithi089 2024-09-21T06:06:36.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:36 smithi089 ceph-mon[33879]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:36.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:36 smithi089 ceph-mon[33879]: Deploying daemon osd.5 on smithi089 2024-09-21T06:06:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:36 smithi081 ceph-mon[33870]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:36 smithi081 ceph-mon[33870]: Deploying daemon osd.5 on smithi089 2024-09-21T06:06:38.825 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:38 smithi089 ceph-mon[33879]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:38.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:38 smithi017 ceph-mon[31080]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:39.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:38 smithi081 ceph-mon[33870]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:40.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:40 smithi089 ceph-mon[33879]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:40.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:40 smithi017 ceph-mon[31080]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:41.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:40 smithi081 ceph-mon[33870]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:42.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:42 smithi089 ceph-mon[33879]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:42.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:42.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:42.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:42.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:42 smithi017 ceph-mon[31080]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:42.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:42.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:42.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:43.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:42 smithi081 ceph-mon[33870]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:43.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:44 smithi089 ceph-mon[33879]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:44.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:44.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:44.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:44 smithi017 ceph-mon[31080]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:44 smithi081 ceph-mon[33870]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:45.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:45.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.658+0000 7f49237fe640 1 -- 172.21.15.89:0/1616313003 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f492c063800 con 0x7f49180b6510 2024-09-21T06:06:45.660 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 5 on host 'smithi089' 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49180b6510 msgr2=0x7f49180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49180b6510 0x7f49180b8a20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4928009aa0 tx=0x7f4928005f90 comp rx=0 tx=0).stop 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 msgr2=0x7f492c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 0x7f492c19a4f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c920 tx=0x7f491c00cde0 comp rx=0 tx=0).stop 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 shutdown_connections 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49180b6510 0x7f49180b8a20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492c1094a0 0x7f492c19b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f492c1025a0 0x7f492c19a4f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:45.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 --2- 172.21.15.89:0/1616313003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f492c101b70 0x7f492c199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:45.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 >> 172.21.15.89:0/1616313003 conn(0x7f492c0fd760 msgr2=0x7f492c107760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:45.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 shutdown_connections 2024-09-21T06:06:45.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:06:45.661+0000 7f4934719640 1 -- 172.21.15.89:0/1616313003 wait complete. 2024-09-21T06:06:46.384 DEBUG:teuthology.orchestra.run.smithi089:osd.5> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T06:06:46.386 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2024-09-21T06:06:46.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:06:46.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:46 smithi089 ceph-mon[33879]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:46.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:46.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:46.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:06:46.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:46 smithi017 ceph-mon[31080]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:46.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:46.774 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:46.775 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:47.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:46 smithi081 ceph-mon[33870]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:06:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:48.117 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:06:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:06:47.834+0000 7f53d3176640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:06:48.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:48 smithi017 ceph-mon[31080]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:48.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:48 smithi017 ceph-mon[31080]: from='osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:06:48.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:48 smithi017 ceph-mon[31080]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:06:48.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:48 smithi089 ceph-mon[33879]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:48.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:48 smithi089 ceph-mon[33879]: from='osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:06:48.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:48 smithi089 ceph-mon[33879]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:06:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:48 smithi081 ceph-mon[33870]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:48 smithi081 ceph-mon[33870]: from='osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:06:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:48 smithi081 ceph-mon[33870]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:06:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:06:49.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-09-21T06:06:49.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:06:49.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:06:49.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:49.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:49 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:06:49.866 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:06:49.557+0000 7f53cf0f8640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:06:49.867 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:06:49.566+0000 7f53caef6640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:49.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:49.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:49.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:49.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:49.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:49 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:50.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:06:50.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:06:50.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:50.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:06:50.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:50.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:06:50.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:49 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 -- 172.21.15.17:0/998233454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 msgr2=0x7fcd2c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 --2- 172.21.15.17:0/998233454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c102ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009900 tx=0x7fcd1c02a480 comp rx=0 tx=0).stop 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 -- 172.21.15.17:0/998233454 shutdown_connections 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 --2- 172.21.15.17:0/998233454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 0x7fcd2c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 --2- 172.21.15.17:0/998233454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 0x7fcd2c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 --2- 172.21.15.17:0/998233454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c102ab0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 -- 172.21.15.17:0/998233454 >> 172.21.15.17:0/998233454 conn(0x7fcd2c0fdfb0 msgr2=0x7fcd2c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 -- 172.21.15.17:0/998233454 shutdown_connections 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.191+0000 7fcd31cda640 1 -- 172.21.15.17:0/998233454 wait complete. 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 Processor -- start 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 -- start start 2024-09-21T06:06:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 0x7fcd2c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 0x7fcd2c1a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c10e110 con 0x7fcd2c102640 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c10df90 con 0x7fcd2c104070 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd31cda640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c10e290 con 0x7fcd2c1036d0 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd2b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd2b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32794/0 (socket says 172.21.15.17:32794) 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.192+0000 7fcd2b7fe640 1 -- 172.21.15.17:0/695510547 learned_addr learned my addr 172.21.15.17:0/695510547 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd22ffd640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 0x7fcd2c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2bfff640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 0x7fcd2c1a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2b7fe640 1 -- 172.21.15.17:0/695510547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 msgr2=0x7fcd2c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2b7fe640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 0x7fcd2c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2b7fe640 1 -- 172.21.15.17:0/695510547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 msgr2=0x7fcd2c1a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2b7fe640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 0x7fcd2c1a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2b7fe640 1 -- 172.21.15.17:0/695510547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c1a18b0 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd22ffd640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 0x7fcd2c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2bfff640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 0x7fcd2c1a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd2b7fe640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c06b6c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009230 tx=0x7fcd1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c03f030 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd1c003c90 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c1a1b40 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c035070 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.193+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c1a2020 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.194+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2c109820 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.196+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fcd1c042030 con 0x7fcd2c102640 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.197+0000 7fcd297fa640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcd180b6510 0x7fcd180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:06:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.197+0000 7fcd22ffd640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcd180b6510 0x7fcd180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:06:50.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.197+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7fcd1c106ff0 con 0x7fcd2c102640 2024-09-21T06:06:50.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.198+0000 7fcd22ffd640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcd180b6510 0x7fcd180b8a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400abe0 tx=0x7fcd1400a5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:06:50.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.201+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd1c0ce800 con 0x7fcd2c102640 2024-09-21T06:06:50.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:06:50.399+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcd2c063800 con 0x7fcd180b6510 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi089 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:50.795 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:06:50.796 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:06:50.796 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi089 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:50.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:50.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:06:50.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:06:50.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:51.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi089 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi089 to 8543M 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:06:51.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:06:51.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:06:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:06:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:06:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] boot 2024-09-21T06:06:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:06:51.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:51 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:51.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:06:51.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:06:51.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:06:51.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:51.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] boot 2024-09-21T06:06:51.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:06:51.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:51 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:52.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:06:52.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:06:52.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:06:52.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:52.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: osd.5 [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] boot 2024-09-21T06:06:52.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:06:52.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:51 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:06:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:52 smithi089 ceph-mon[33879]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:52 smithi089 ceph-mon[33879]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:06:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:52 smithi017 ceph-mon[31080]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:52 smithi017 ceph-mon[31080]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:06:53.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:52 smithi081 ceph-mon[33870]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:06:53.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:52 smithi081 ceph-mon[33870]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:06:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:53 smithi089 ceph-mon[33879]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T06:06:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:53 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1512031434' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a163a2eb-95c9-4fee-919f-3b378b3ffa2d"} : dispatch 2024-09-21T06:06:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:53 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1512031434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a163a2eb-95c9-4fee-919f-3b378b3ffa2d"}]': finished 2024-09-21T06:06:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:53 smithi089 ceph-mon[33879]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:06:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:06:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:53 smithi017 ceph-mon[31080]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T06:06:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:53 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1512031434' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a163a2eb-95c9-4fee-919f-3b378b3ffa2d"} : dispatch 2024-09-21T06:06:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:53 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1512031434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a163a2eb-95c9-4fee-919f-3b378b3ffa2d"}]': finished 2024-09-21T06:06:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:53 smithi017 ceph-mon[31080]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:06:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:06:54.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:53 smithi081 ceph-mon[33870]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T06:06:54.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:53 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1512031434' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a163a2eb-95c9-4fee-919f-3b378b3ffa2d"} : dispatch 2024-09-21T06:06:54.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:53 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1512031434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a163a2eb-95c9-4fee-919f-3b378b3ffa2d"}]': finished 2024-09-21T06:06:54.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:53 smithi081 ceph-mon[33870]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:06:54.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:06:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:54 smithi089 ceph-mon[33879]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:06:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:54 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2322740690' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:54 smithi017 ceph-mon[31080]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:06:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2322740690' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:55.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:54 smithi081 ceph-mon[33870]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:06:55.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:54 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2322740690' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:06:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:56 smithi089 ceph-mon[33879]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-21T06:06:56.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:56 smithi017 ceph-mon[31080]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-21T06:06:57.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:56 smithi081 ceph-mon[33870]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-21T06:06:58.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:06:58 smithi089 ceph-mon[33879]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:06:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:06:58 smithi017 ceph-mon[31080]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:06:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:06:58 smithi081 ceph-mon[33870]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:07:00.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:00 smithi089 ceph-mon[33879]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:07:00.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:00 smithi017 ceph-mon[31080]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:07:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:00 smithi081 ceph-mon[33870]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:07:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:02 smithi017 ceph-mon[31080]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:07:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:07:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:02 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:02.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:02 smithi089 ceph-mon[33879]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:07:02.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:07:02.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:02 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:02 smithi081 ceph-mon[33870]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:07:03.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:07:03.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:02 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:03.860 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:03 smithi017 ceph-mon[31080]: Deploying daemon osd.6 on smithi017 2024-09-21T06:07:03.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:03 smithi089 ceph-mon[33879]: Deploying daemon osd.6 on smithi017 2024-09-21T06:07:04.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:03 smithi081 ceph-mon[33870]: Deploying daemon osd.6 on smithi017 2024-09-21T06:07:04.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:04 smithi017 ceph-mon[31080]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:07:04.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:04 smithi089 ceph-mon[33879]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:07:05.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:04 smithi081 ceph-mon[33870]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:07:06.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:06 smithi089 ceph-mon[33879]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:07:06.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:06 smithi017 ceph-mon[31080]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:07:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:06 smithi081 ceph-mon[33870]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:07:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:08 smithi089 ceph-mon[33879]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:08 smithi017 ceph-mon[31080]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:08 smithi081 ceph-mon[33870]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:10.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:10 smithi089 ceph-mon[33879]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:10 smithi017 ceph-mon[31080]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:10 smithi081 ceph-mon[33870]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:12.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.148+0000 7fcd297fa640 1 -- 172.21.15.17:0/695510547 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcd2c063800 con 0x7fcd180b6510 2024-09-21T06:07:12.149 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcd180b6510 msgr2=0x7fcd180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcd180b6510 0x7fcd180b8a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400abe0 tx=0x7fcd1400a5c0 comp rx=0 tx=0).stop 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 msgr2=0x7fcd2c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c06b6c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009230 tx=0x7fcd1c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 shutdown_connections 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcd180b6510 0x7fcd180b8a20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2c104070 0x7fcd2c1a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2c1036d0 0x7fcd2c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 --2- 172.21.15.17:0/695510547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2c102640 0x7fcd2c06b6c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 >> 172.21.15.17:0/695510547 conn(0x7fcd2c0fdfb0 msgr2=0x7fcd2c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 shutdown_connections 2024-09-21T06:07:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:07:12.150+0000 7fcd31cda640 1 -- 172.21.15.17:0/695510547 wait complete. 2024-09-21T06:07:12.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:12.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:12.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:12.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:12.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:12 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:12 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:12 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:12.840 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T06:07:12.842 INFO:tasks.cephadm:Deploying osd.7 on smithi081 with /dev/vg_nvme/lv_2... 2024-09-21T06:07:12.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:07:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:07:14.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:14 smithi081 ceph-mon[33870]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:14.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:14 smithi017 ceph-mon[31080]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:14.590 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:07:14 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:07:14.504+0000 7fa5d8be4640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:07:14.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:14 smithi089 ceph-mon[33879]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:15.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:15 smithi081 ceph-mon[33870]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:07:15.573 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:15 smithi017 ceph-mon[31080]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:07:15.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:15 smithi089 ceph-mon[33879]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:07:15.902 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:07:15.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-09-21T06:07:16.185 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:07:16.603 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:16.603 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:07:16.603 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:07:16.603 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:07:16.603 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:16.603 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:16.604 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:16.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:16.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:07:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:07:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:07:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:16.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:16.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.694+0000 7f3828784640 1 -- 172.21.15.81:0/138366284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820106be0 msgr2=0x7f3820109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.694+0000 7f3828784640 1 --2- 172.21.15.81:0/138366284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820106be0 0x7f3820109000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3810009900 tx=0x7f381002a410 comp rx=0 tx=0).stop 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 -- 172.21.15.81:0/138366284 shutdown_connections 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 --2- 172.21.15.81:0/138366284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820109540 0x7f382010b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 --2- 172.21.15.81:0/138366284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820106be0 0x7f3820109000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 --2- 172.21.15.81:0/138366284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3820101b40 0x7f3820101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:16.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 -- 172.21.15.81:0/138366284 >> 172.21.15.81:0/138366284 conn(0x7f38200fd770 msgr2=0x7f38200ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 -- 172.21.15.81:0/138366284 shutdown_connections 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 -- 172.21.15.81:0/138366284 wait complete. 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 Processor -- start 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.695+0000 7f3828784640 1 -- start start 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3828784640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 0x7f3820199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3828784640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3820106be0 0x7f382019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3828784640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820109540 0x7f382019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3828784640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f382010f260 con 0x7f3820101b40 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3828784640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f382010f0e0 con 0x7f3820109540 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3828784640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f382010f3e0 con 0x7f3820106be0 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820109540 0x7f382019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826520640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 0x7f3820199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:16.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826520640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 0x7f3820199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.81:57748/0 (socket says 172.21.15.81:57748) 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3825d1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3820106be0 0x7f382019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826520640 1 -- 172.21.15.81:0/148428791 learned_addr learned my addr 172.21.15.81:0/148428791 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 -- 172.21.15.81:0/148428791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3820106be0 msgr2=0x7f382019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3820106be0 0x7f382019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 -- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 msgr2=0x7f3820199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 0x7f3820199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 -- 172.21.15.81:0/148428791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382019b880 con 0x7f3820109540 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826520640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 0x7f3820199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.696+0000 7f3826d21640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820109540 0x7f382019b0f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3818009fd0 tx=0x7f381800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.697+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381800ce20 con 0x7f3820109540 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.697+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3818005020 con 0x7f3820109540 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.697+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382019bb70 con 0x7f3820109540 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.697+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818010690 con 0x7f3820109540 2024-09-21T06:07:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.697+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38201a2130 con 0x7f3820109540 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.698+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38200ff290 con 0x7f3820109540 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.700+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f3818004a40 con 0x7f3820109540 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.701+0000 7f38177fe640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f380c0b6510 0x7f380c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.701+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f38180e6b90 con 0x7f3820109540 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.701+0000 7f3826520640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f380c0b6510 0x7f380c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.702+0000 7f3826520640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f380c0b6510 0x7f380c0b8a20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f381c00f4d0 tx=0x7f381c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.704+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38180ae250 con 0x7f3820109540 2024-09-21T06:07:16.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:16.895+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3820063800 con 0x7f380c0b6510 2024-09-21T06:07:17.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:07:16.787+0000 7fa5d537b640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:07:17.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:07:16 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:07:16.797+0000 7fa5cc95c640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi017 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:17 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:17.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi017 2024-09-21T06:07:17.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:07:17.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:17 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:17.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi017 2024-09-21T06:07:17.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi017 to 5697M 2024-09-21T06:07:17.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:07:17.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T06:07:17.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:17.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:17.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272]' entity='osd.6' 2024-09-21T06:07:17.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:07:17.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:07:17.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:17 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:18.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] boot 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:07:18.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] boot 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:07:18.629 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:07:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:07:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:07:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:07:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:18.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: osd.6 [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] boot 2024-09-21T06:07:18.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:07:18.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:07:20.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:20.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T06:07:20.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/3791367896' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"} : dispatch 2024-09-21T06:07:20.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"} : dispatch 2024-09-21T06:07:20.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"}]': finished 2024-09-21T06:07:20.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:07:20.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:20.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:20 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/546547549' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:07:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T06:07:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/3791367896' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"} : dispatch 2024-09-21T06:07:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"} : dispatch 2024-09-21T06:07:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"}]': finished 2024-09-21T06:07:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:07:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:20.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:20 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/546547549' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:07:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T06:07:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/3791367896' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"} : dispatch 2024-09-21T06:07:20.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"} : dispatch 2024-09-21T06:07:20.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ac915b5-3e8a-4938-bbd4-3566c15b6294"}]': finished 2024-09-21T06:07:20.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:07:20.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:20.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:20 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/546547549' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:07:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:22 smithi089 ceph-mon[33879]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:22 smithi017 ceph-mon[31080]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:22 smithi081 ceph-mon[33870]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:24 smithi089 ceph-mon[33879]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:24 smithi017 ceph-mon[31080]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:24.644 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:24 smithi081 ceph-mon[33870]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:26.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:26 smithi089 ceph-mon[33879]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:26.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:26 smithi017 ceph-mon[31080]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:26 smithi081 ceph-mon[33870]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:28.547 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:28 smithi081 ceph-mon[33870]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:28.547 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:07:28.547 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:28 smithi089 ceph-mon[33879]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:07:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:28 smithi017 ceph-mon[31080]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:07:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:29.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:29 smithi081 ceph-mon[33870]: Deploying daemon osd.7 on smithi081 2024-09-21T06:07:29.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:29 smithi017 ceph-mon[31080]: Deploying daemon osd.7 on smithi081 2024-09-21T06:07:29.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:29 smithi089 ceph-mon[33879]: Deploying daemon osd.7 on smithi081 2024-09-21T06:07:30.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:30 smithi017 ceph-mon[31080]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:30.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:30 smithi081 ceph-mon[33870]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:30.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:30 smithi089 ceph-mon[33879]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:32.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:32 smithi017 ceph-mon[31080]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:32.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:32 smithi081 ceph-mon[33870]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:32.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:32 smithi089 ceph-mon[33879]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:34 smithi017 ceph-mon[31080]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:34.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:34 smithi081 ceph-mon[33870]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:34.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:34.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:34.703 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:34.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:34 smithi089 ceph-mon[33879]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:34.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:34.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:34.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:36.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:36 smithi081 ceph-mon[33870]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:36.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:36 smithi017 ceph-mon[31080]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:36.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:36 smithi089 ceph-mon[33879]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.978+0000 7f38177fe640 1 -- 172.21.15.81:0/148428791 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3820063800 con 0x7f380c0b6510 2024-09-21T06:07:37.981 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 7 on host 'smithi081' 2024-09-21T06:07:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f380c0b6510 msgr2=0x7f380c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f380c0b6510 0x7f380c0b8a20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f381c00f4d0 tx=0x7f381c00a380 comp rx=0 tx=0).stop 2024-09-21T06:07:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820109540 msgr2=0x7f382019b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820109540 0x7f382019b0f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3818009fd0 tx=0x7f381800ef10 comp rx=0 tx=0).stop 2024-09-21T06:07:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 shutdown_connections 2024-09-21T06:07:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f380c0b6510 0x7f380c0b8a20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3820109540 0x7f382019b0f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3820106be0 0x7f382019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 --2- 172.21.15.81:0/148428791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3820101b40 0x7f3820199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.980+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 >> 172.21.15.81:0/148428791 conn(0x7f38200fd770 msgr2=0x7f3820107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.981+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 shutdown_connections 2024-09-21T06:07:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:07:37.981+0000 7f3828784640 1 -- 172.21.15.81:0/148428791 wait complete. 2024-09-21T06:07:38.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:37 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:37 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:37 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:38.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:37 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:38.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:37 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:37 smithi017 ceph-mon[31080]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:38.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:37 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:37 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:37 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:38.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:37 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:38.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:37 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:37 smithi081 ceph-mon[33870]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:38.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:37 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:37 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:37 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:38.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:37 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:38.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:37 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:38.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:37 smithi089 ceph-mon[33879]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:38.706 DEBUG:teuthology.orchestra.run.smithi081:osd.7> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T06:07:38.708 INFO:tasks.cephadm:Deploying osd.8 on smithi089 with /dev/vg_nvme/lv_2... 2024-09-21T06:07:38.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:07:38.962 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:07:39.083 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:39.083 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:39.084 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:39.207 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:39.207 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:39.207 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:39.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:07:39.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:39.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:40.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:39 smithi089 ceph-mon[33879]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:40.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:39 smithi081 ceph-mon[33870]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:40.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:39 smithi017 ceph-mon[31080]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:40.538 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:07:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:07:40.333+0000 7facfe889640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:07:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:40 smithi089 ceph-mon[33879]: from='osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:07:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:40 smithi089 ceph-mon[33879]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:07:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:40 smithi081 ceph-mon[33870]: from='osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:07:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:40 smithi081 ceph-mon[33870]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:07:41.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:40 smithi017 ceph-mon[31080]: from='osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:07:41.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:40 smithi017 ceph-mon[31080]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:07:41.510 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:07:41.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-09-21T06:07:41.791 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi081 2024-09-21T06:07:42.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:42.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:41 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi081 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:42.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:41 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 -- 172.21.15.89:0/886231047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8106930 msgr2=0x7f4bf8108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 --2- 172.21.15.89:0/886231047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8106930 0x7f4bf8108d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009860 tx=0x7f4be802a340 comp rx=0 tx=0).stop 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 -- 172.21.15.89:0/886231047 shutdown_connections 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 --2- 172.21.15.89:0/886231047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf8109470 0x7f4bf810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 --2- 172.21.15.89:0/886231047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8106930 0x7f4bf8108d50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 --2- 172.21.15.89:0/886231047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf806b920 0x7f4bf81063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 -- 172.21.15.89:0/886231047 >> 172.21.15.89:0/886231047 conn(0x7f4bf80fdfb0 msgr2=0x7f4bf8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 -- 172.21.15.89:0/886231047 shutdown_connections 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.278+0000 7f4c005bd640 1 -- 172.21.15.89:0/886231047 wait complete. 2024-09-21T06:07:42.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 Processor -- start 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 -- start start 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf806b920 0x7f4bf8199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf8106930 0x7f4bf819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 0x7f4bf819b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf810f230 con 0x7f4bf8106930 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf810f0b0 con 0x7f4bf806b920 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4c005bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf810f3b0 con 0x7f4bf8109470 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 0x7f4bf819b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfe359640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf806b920 0x7f4bf8199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 0x7f4bf819b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39618/0 (socket says 172.21.15.89:39618) 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 -- 172.21.15.89:0/2211156599 learned_addr learned my addr 172.21.15.89:0/2211156599 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 -- 172.21.15.89:0/2211156599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf806b920 msgr2=0x7f4bf8199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf806b920 0x7f4bf8199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfdb58640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf8106930 0x7f4bf819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 -- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf8106930 msgr2=0x7f4bf819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf8106930 0x7f4bf819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 -- 172.21.15.89:0/2211156599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf819b8f0 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.279+0000 7f4bfeb5a640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 0x7f4bf819b0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000eb10 tx=0x7f4bf000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.280+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000ce20 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.280+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4bf0005020 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.280+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf819bbe0 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.280+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0010690 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.280+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81a22e0 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.281+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf80ffad0 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.282+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4bf0004a40 con 0x7f4bf8109470 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.283+0000 7f4bef7fe640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4be40b6510 0x7f4be40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:07:42.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.283+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f4bf00e7230 con 0x7f4bf8109470 2024-09-21T06:07:42.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.284+0000 7f4bfe359640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4be40b6510 0x7f4be40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:07:42.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.284+0000 7f4bfe359640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4be40b6510 0x7f4be40b8a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005fd0 tx=0x7f4bf4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:07:42.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.286+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bf00ae6a0 con 0x7f4bf8109470 2024-09-21T06:07:42.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:07:42.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi081 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:07:42.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:41 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:07:42.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:07:42.482+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4bf8063800 con 0x7f4be40b6510 2024-09-21T06:07:42.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:07:42.388+0000 7facfa80b640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:07:42.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:07:42.397+0000 7facf2601640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:07:43.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:07:43.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T06:07:43.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:43.097 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:43.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='osd.7 ' entity='osd.7' 2024-09-21T06:07:43.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:07:43.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:07:43.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:07:43.098 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='osd.7 ' entity='osd.7' 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:07:43.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:43.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:07:43.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T06:07:43.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:43.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:43.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='osd.7 ' entity='osd.7' 2024-09-21T06:07:43.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:07:43.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:07:43.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:07:43.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:44.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:43 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:07:44.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:43 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:07:44.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:43 smithi089 ceph-mon[33879]: osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] boot 2024-09-21T06:07:44.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:43 smithi089 ceph-mon[33879]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:07:44.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:43 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:44.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:43 smithi089 ceph-mon[33879]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:44.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:43 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:07:44.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:43 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:07:44.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:43 smithi081 ceph-mon[33870]: osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] boot 2024-09-21T06:07:44.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:43 smithi081 ceph-mon[33870]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:07:44.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:43 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:44.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:43 smithi081 ceph-mon[33870]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:44.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:43 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:07:44.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:43 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:07:44.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:43 smithi017 ceph-mon[31080]: osd.7 [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] boot 2024-09-21T06:07:44.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:43 smithi017 ceph-mon[31080]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:07:44.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:43 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:07:44.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:43 smithi017 ceph-mon[31080]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:45.230 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:44 smithi089 ceph-mon[33879]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T06:07:45.230 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:44 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/87067109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"} : dispatch 2024-09-21T06:07:45.230 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:44 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"} : dispatch 2024-09-21T06:07:45.230 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:44 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"}]': finished 2024-09-21T06:07:45.230 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:44 smithi089 ceph-mon[33879]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:07:45.230 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:07:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:44 smithi081 ceph-mon[33870]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T06:07:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:44 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/87067109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"} : dispatch 2024-09-21T06:07:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:44 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"} : dispatch 2024-09-21T06:07:45.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:44 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"}]': finished 2024-09-21T06:07:45.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:44 smithi081 ceph-mon[33870]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:07:45.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:07:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:44 smithi017 ceph-mon[31080]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T06:07:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:44 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/87067109' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"} : dispatch 2024-09-21T06:07:45.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:44 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"} : dispatch 2024-09-21T06:07:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:44 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0758ec6-f4cd-41ac-a4d7-90cb888f86a9"}]': finished 2024-09-21T06:07:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:44 smithi017 ceph-mon[31080]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:07:45.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:07:46.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:45 smithi081 ceph-mon[33870]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:46.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:45 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/845887218' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:07:46.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:45 smithi089 ceph-mon[33879]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:46.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:45 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/845887218' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:07:46.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:45 smithi017 ceph-mon[31080]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:46.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:45 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/845887218' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:07:48.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:48 smithi081 ceph-mon[33870]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:48.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:48 smithi089 ceph-mon[33879]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:48 smithi017 ceph-mon[31080]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:07:50.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:50 smithi089 ceph-mon[33879]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:07:50.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:50 smithi081 ceph-mon[33870]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:07:50.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:50 smithi017 ceph-mon[31080]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-21T06:07:52.413 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:52 smithi089 ceph-mon[33879]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:07:52.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:52 smithi081 ceph-mon[33870]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:07:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:52 smithi017 ceph-mon[31080]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:07:54.283 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:54 smithi089 ceph-mon[33879]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:07:54.283 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:07:54.283 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:54.283 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:54 smithi089 ceph-mon[33879]: Deploying daemon osd.8 on smithi089 2024-09-21T06:07:54.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:54 smithi081 ceph-mon[33870]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:07:54.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:07:54.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:54.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:54 smithi081 ceph-mon[33870]: Deploying daemon osd.8 on smithi089 2024-09-21T06:07:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:54 smithi017 ceph-mon[31080]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T06:07:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:07:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:07:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:54 smithi017 ceph-mon[31080]: Deploying daemon osd.8 on smithi089 2024-09-21T06:07:56.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:56 smithi081 ceph-mon[33870]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:07:56.539 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:56 smithi089 ceph-mon[33879]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:07:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:56 smithi017 ceph-mon[31080]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:07:58.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:07:58 smithi089 ceph-mon[33879]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:07:58.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:07:58 smithi081 ceph-mon[33870]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:07:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:07:58 smithi017 ceph-mon[31080]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:00.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:00 smithi089 ceph-mon[33879]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:00.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:00.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:00.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:00.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:00 smithi081 ceph-mon[33870]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:00.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:00.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:00.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:00 smithi017 ceph-mon[31080]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:02.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:02 smithi089 ceph-mon[33879]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:02.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:02 smithi081 ceph-mon[33870]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:02 smithi017 ceph-mon[31080]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:02.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.842+0000 7f4bef7fe640 1 -- 172.21.15.89:0/2211156599 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4bf8063800 con 0x7f4be40b6510 2024-09-21T06:08:02.844 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 8 on host 'smithi089' 2024-09-21T06:08:02.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4be40b6510 msgr2=0x7f4be40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:02.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4be40b6510 0x7f4be40b8a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4005fd0 tx=0x7f4bf4009260 comp rx=0 tx=0).stop 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 msgr2=0x7f4bf819b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 0x7f4bf819b0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000eb10 tx=0x7f4bf000ef10 comp rx=0 tx=0).stop 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 shutdown_connections 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4be40b6510 0x7f4be40b8a20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf8106930 0x7f4bf819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bf8109470 0x7f4bf819b0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 --2- 172.21.15.89:0/2211156599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bf806b920 0x7f4bf8199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.844+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 >> 172.21.15.89:0/2211156599 conn(0x7f4bf80fdfb0 msgr2=0x7f4bf8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.845+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 shutdown_connections 2024-09-21T06:08:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:02.845+0000 7f4c005bd640 1 -- 172.21.15.89:0/2211156599 wait complete. 2024-09-21T06:08:03.569 DEBUG:teuthology.orchestra.run.smithi089:osd.8> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T06:08:03.571 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2024-09-21T06:08:03.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:08:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:08:03.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:03 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:03.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:03 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:03.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:03 smithi017 ceph-mon[31080]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:03.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:03 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:03.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:03 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:03 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:03 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:03 smithi089 ceph-mon[33879]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:04.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:03 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:03 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:03 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:03 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:03 smithi081 ceph-mon[33870]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:04.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:03 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:04.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:03 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:05.258 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:05 smithi089 ceph-mon[33879]: from='osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:08:05.258 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:05 smithi089 ceph-mon[33879]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:08:05.258 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:08:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:08:04.978+0000 7ff005854640 -1 osd.8 0 log_to_monitors true 2024-09-21T06:08:05.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:05 smithi017 ceph-mon[31080]: from='osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:08:05.261 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:05 smithi017 ceph-mon[31080]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:08:05.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:05 smithi081 ceph-mon[33870]: from='osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:08:05.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:05 smithi081 ceph-mon[33870]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: from='osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:08:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:06 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:06.366 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:08:06.046+0000 7ff0017d6640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T06:08:06.367 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:08:06.056+0000 7feffd5d4640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: from='osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:08:06.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:06 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:06.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: from='osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:08:06.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:06 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:08:06.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2024-09-21T06:08:07.024 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:08:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] boot 2024-09-21T06:08:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:07.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.308 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] boot 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:07.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:07.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:07.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:07.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: osd.8 [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] boot 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:07.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 -- 172.21.15.17:0/3078127023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c1068e0 msgr2=0x7f362c108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 --2- 172.21.15.17:0/3078127023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c1068e0 0x7f362c108d40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3620009900 tx=0x7f362002a410 comp rx=0 tx=0).stop 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 -- 172.21.15.17:0/3078127023 shutdown_connections 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 --2- 172.21.15.17:0/3078127023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c1068e0 0x7f362c108d40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 --2- 172.21.15.17:0/3078127023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c109480 0x7f362c10b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 --2- 172.21.15.17:0/3078127023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c06c600 0x7f362c1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 -- 172.21.15.17:0/3078127023 >> 172.21.15.17:0/3078127023 conn(0x7f362c0fdfa0 msgr2=0x7f362c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 -- 172.21.15.17:0/3078127023 shutdown_connections 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.534+0000 7f36341d3640 1 -- 172.21.15.17:0/3078127023 wait complete. 2024-09-21T06:08:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 Processor -- start 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 -- start start 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c06c600 0x7f362c1039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c1068e0 0x7f362c1022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 0x7f362c1027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f362c10f240 con 0x7f362c109480 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f362c10f0c0 con 0x7f362c06c600 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f36341d3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f362c10f3c0 con 0x7f362c1068e0 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.535+0000 7f3632770640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 0x7f362c1027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 0x7f362c1027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58550/0 (socket says 172.21.15.17:58550) 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 -- 172.21.15.17:0/891420971 learned_addr learned my addr 172.21.15.17:0/891420971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f363176e640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c1068e0 0x7f362c1022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3631f6f640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c06c600 0x7f362c1039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 -- 172.21.15.17:0/891420971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c1068e0 msgr2=0x7f362c1022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c1068e0 0x7f362c1022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 -- 172.21.15.17:0/891420971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c06c600 msgr2=0x7f362c1039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c06c600 0x7f362c1039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 -- 172.21.15.17:0/891420971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c102e50 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f363176e640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c1068e0 0x7f362c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f3632770640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 0x7f362c1027e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f362400c970 tx=0x7f362400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624007bb0 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3624007d50 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c1a3fe0 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624018660 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.536+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c1a4380 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.537+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c106d30 con 0x7f362c109480 2024-09-21T06:08:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.539+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f362400f970 con 0x7f362c109480 2024-09-21T06:08:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.540+0000 7f362affd640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f36140b6510 0x7f36140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.540+0000 7f3631f6f640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f36140b6510 0x7f36140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.540+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5862+0+0 (secure 0 0 0) 0x7f36240e6b60 con 0x7f362c109480 2024-09-21T06:08:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.541+0000 7f3631f6f640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f36140b6510 0x7f36140b8a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f361c005fd0 tx=0x7f361c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.543+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3624056710 con 0x7f362c109480 2024-09-21T06:08:07.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:07.744+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f362c063800 con 0x7f36140b6510 2024-09-21T06:08:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi089 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:08.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:08 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:08.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:08:08.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:08:08.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi089 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:08.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:08 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi089 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi089 to 5695M 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:09.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:08 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:09.783 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:09 smithi017 ceph-mon[31080]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:08:09.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:09 smithi089 ceph-mon[33879]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:08:10.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:09 smithi081 ceph-mon[33870]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:08:10.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:10 smithi089 ceph-mon[33879]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:10.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:10 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3244948591' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40"} : dispatch 2024-09-21T06:08:10.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:10 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3244948591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40"}]': finished 2024-09-21T06:08:10.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:10 smithi089 ceph-mon[33879]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:08:10.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:10 smithi017 ceph-mon[31080]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:10 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3244948591' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40"} : dispatch 2024-09-21T06:08:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:10 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3244948591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40"}]': finished 2024-09-21T06:08:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:10 smithi017 ceph-mon[31080]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:08:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:10 smithi081 ceph-mon[33870]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:11.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:10 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3244948591' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40"} : dispatch 2024-09-21T06:08:11.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:10 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3244948591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40"}]': finished 2024-09-21T06:08:11.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:10 smithi081 ceph-mon[33870]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:08:11.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:11.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:11 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2964982165' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:08:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:11 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2964982165' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:08:12.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:11 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2964982165' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:08:12.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:12 smithi089 ceph-mon[33879]: pgmap v209: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:12.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:12 smithi017 ceph-mon[31080]: pgmap v209: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:13.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:12 smithi081 ceph-mon[33870]: pgmap v209: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:14.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:14 smithi017 ceph-mon[31080]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:08:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:14 smithi081 ceph-mon[33870]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:08:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:14 smithi089 ceph-mon[33879]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:08:16.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:16 smithi017 ceph-mon[31080]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:08:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:16 smithi081 ceph-mon[33870]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:08:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:16 smithi089 ceph-mon[33879]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:08:18.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:18 smithi017 ceph-mon[31080]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:08:19.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:18 smithi081 ceph-mon[33870]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:08:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:18 smithi089 ceph-mon[33879]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:08:19.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:08:19.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:20.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:08:20.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:08:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:20 smithi017 ceph-mon[31080]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:08:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:20 smithi017 ceph-mon[31080]: Deploying daemon osd.9 on smithi017 2024-09-21T06:08:21.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:20 smithi081 ceph-mon[33870]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:08:21.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:20 smithi081 ceph-mon[33870]: Deploying daemon osd.9 on smithi017 2024-09-21T06:08:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:20 smithi089 ceph-mon[33879]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:08:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:20 smithi089 ceph-mon[33879]: Deploying daemon osd.9 on smithi017 2024-09-21T06:08:22.870 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:22 smithi017 ceph-mon[31080]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T06:08:23.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:22 smithi081 ceph-mon[33870]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T06:08:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:22 smithi089 ceph-mon[33879]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T06:08:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:24 smithi017 ceph-mon[31080]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:25.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:24 smithi081 ceph-mon[33870]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:24 smithi089 ceph-mon[33879]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:08:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:25.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:26.018 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:26.018 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:26.018 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:26.785 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:26 smithi017 ceph-mon[31080]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:27.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:26 smithi081 ceph-mon[33870]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:26 smithi089 ceph-mon[33879]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:28.267 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2024-09-21T06:08:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.264+0000 7f362affd640 1 -- 172.21.15.17:0/891420971 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f362c063800 con 0x7f36140b6510 2024-09-21T06:08:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f36140b6510 msgr2=0x7f36140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f36140b6510 0x7f36140b8a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f361c005fd0 tx=0x7f361c009500 comp rx=0 tx=0).stop 2024-09-21T06:08:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 msgr2=0x7f362c1027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 0x7f362c1027e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f362400c970 tx=0x7f362400ce30 comp rx=0 tx=0).stop 2024-09-21T06:08:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 shutdown_connections 2024-09-21T06:08:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f36140b6510 0x7f36140b8a20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f362c109480 0x7f362c1027e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f362c1068e0 0x7f362c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 --2- 172.21.15.17:0/891420971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f362c06c600 0x7f362c1039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.267+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 >> 172.21.15.17:0/891420971 conn(0x7f362c0fdfa0 msgr2=0x7f362c104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.268+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 shutdown_connections 2024-09-21T06:08:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:08:28.268+0000 7f36341d3640 1 -- 172.21.15.17:0/891420971 wait complete. 2024-09-21T06:08:28.945 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:28 smithi017 ceph-mon[31080]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:28.945 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:28.945 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:28 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:28.977 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T06:08:28.979 INFO:tasks.cephadm:Deploying osd.10 on smithi081 with /dev/vg_nvme/lv_1... 2024-09-21T06:08:28.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:08:29.003 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:28 smithi081 ceph-mon[33870]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:29.003 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:29.003 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:28 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:28 smithi089 ceph-mon[33879]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:29.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:28 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:29.241 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:08:30.382 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:30 smithi081 ceph-mon[33870]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:30.383 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:30.383 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:30 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:30.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:30 smithi017 ceph-mon[31080]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:30.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:30 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:30.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:30 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:30 smithi089 ceph-mon[33879]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:30 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:30.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:30 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:31.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:08:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:08:31.245+0000 7f5774c49640 -1 osd.9 0 log_to_monitors true 2024-09-21T06:08:32.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:08:32.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-09-21T06:08:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:08:32.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:32 smithi017 ceph-mon[31080]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:32.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:32 smithi017 ceph-mon[31080]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:08:32.481 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:32 smithi081 ceph-mon[33870]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:32.481 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:32 smithi081 ceph-mon[33870]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:08:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:32 smithi089 ceph-mon[33879]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:32 smithi089 ceph-mon[33879]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:08:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 -- 172.21.15.81:0/3934282004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8104070 msgr2=0x7fc0a810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/3934282004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8104070 0x7fc0a810aa10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009ca0 tx=0x7fc0a002a950 comp rx=0 tx=0).stop 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 -- 172.21.15.81:0/3934282004 shutdown_connections 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/3934282004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8104070 0x7fc0a810aa10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/3934282004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a81036d0 0x7fc0a8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/3934282004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8102640 0x7fc0a8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 -- 172.21.15.81:0/3934282004 >> 172.21.15.81:0/3934282004 conn(0x7fc0a80fdfb0 msgr2=0x7fc0a8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 -- 172.21.15.81:0/3934282004 shutdown_connections 2024-09-21T06:08:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 -- 172.21.15.81:0/3934282004 wait complete. 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 Processor -- start 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.841+0000 7fc0ae15c640 1 -- start start 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8102640 0x7fc0a8199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 0x7fc0a819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8104070 0x7fc0a819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810e190 con 0x7fc0a8104070 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810e010 con 0x7fc0a81036d0 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a810e310 con 0x7fc0a8102640 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 0x7fc0a819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 0x7fc0a819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34260/0 (socket says 172.21.15.81:34260) 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 -- 172.21.15.81:0/415964213 learned_addr learned my addr 172.21.15.81:0/415964213 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0a7fff640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8104070 0x7fc0a819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0a77fe640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8102640 0x7fc0a8199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 -- 172.21.15.81:0/415964213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8102640 msgr2=0x7fc0a8199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8102640 0x7fc0a8199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 -- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8104070 msgr2=0x7fc0a819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8104070 0x7fc0a819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 -- 172.21.15.81:0/415964213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a819b830 con 0x7fc0a81036d0 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0a7fff640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8104070 0x7fc0a819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc09ffff640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 0x7fc0a819a500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c970 tx=0x7fc09000cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090007bb0 con 0x7fc0a81036d0 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a819bb20 con 0x7fc0a81036d0 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc090007d50 con 0x7fc0a81036d0 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.842+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090004d80 con 0x7fc0a81036d0 2024-09-21T06:08:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.843+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81a22b0 con 0x7fc0a81036d0 2024-09-21T06:08:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.843+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a81a2480 con 0x7fc0a81036d0 2024-09-21T06:08:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.845+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc090004f20 con 0x7fc0a81036d0 2024-09-21T06:08:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.846+0000 7fc0a57fa640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc0940b6590 0x7fc0940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.846+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5965+0+0 (secure 0 0 0) 0x7fc0900e6a50 con 0x7fc0a81036d0 2024-09-21T06:08:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.846+0000 7fc0a77fe640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc0940b6590 0x7fc0940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.846+0000 7fc0a77fe640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc0940b6590 0x7fc0940b8aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc09800abe0 tx=0x7fc09800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:32.849+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc090014030 con 0x7fc0a81036d0 2024-09-21T06:08:33.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:33.038+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc0a806b570 con 0x7fc0940b6590 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi017 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.421 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:33.422 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi017 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:33.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi017 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:33.619 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi017 to 4273M 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:33.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:33.887 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:08:33.615+0000 7f5770bcb640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T06:08:33.887 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:08:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:08:33.630+0000 7f57689c1640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:08:34.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:08:34.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:34.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:08:34.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:08:34.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:34.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:34.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:34 smithi081 ceph-mon[33870]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' 2024-09-21T06:08:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:08:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:08:34.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:08:34.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:34.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:34.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:34 smithi089 ceph-mon[33879]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' 2024-09-21T06:08:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:08:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-21T06:08:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:08:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:34.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:34 smithi017 ceph-mon[31080]: from='osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071]' entity='osd.9' 2024-09-21T06:08:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:35 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:08:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:35 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:08:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:35.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:35 smithi081 ceph-mon[33870]: osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] boot 2024-09-21T06:08:35.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:35 smithi081 ceph-mon[33870]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:08:35.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:35 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:35.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:35 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:08:35.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:35 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:08:35.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:35.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:35 smithi089 ceph-mon[33879]: osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] boot 2024-09-21T06:08:35.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:35 smithi089 ceph-mon[33879]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:08:35.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:35 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:35.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:35 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:08:35.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:35 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:08:35.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:35.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:35 smithi017 ceph-mon[31080]: osd.9 [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] boot 2024-09-21T06:08:35.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:35 smithi017 ceph-mon[31080]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:08:35.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:35 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:08:36.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:36.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/3945941690' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"} : dispatch 2024-09-21T06:08:36.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"} : dispatch 2024-09-21T06:08:36.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"}]': finished 2024-09-21T06:08:36.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:08:36.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:36.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:36 smithi017 ceph-mon[31080]: from='client.? 172.21.15.81:0/3143254119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/3945941690' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"} : dispatch 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"} : dispatch 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"}]': finished 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:37.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:36 smithi081 ceph-mon[33870]: from='client.? 172.21.15.81:0/3143254119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:08:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:08:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/3945941690' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"} : dispatch 2024-09-21T06:08:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"} : dispatch 2024-09-21T06:08:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef256d78-3f6d-4e30-989e-11eb7aba5c58"}]': finished 2024-09-21T06:08:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:08:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:37.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:36 smithi089 ceph-mon[33879]: from='client.? 172.21.15.81:0/3143254119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:08:38.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:38 smithi017 ceph-mon[31080]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:39.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:38 smithi081 ceph-mon[33870]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:38 smithi089 ceph-mon[33879]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:41.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:40 smithi081 ceph-mon[33870]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:40 smithi089 ceph-mon[33879]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:41.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:40 smithi017 ceph-mon[31080]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:42.886 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:42 smithi081 ceph-mon[33870]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:42 smithi089 ceph-mon[33879]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:42 smithi017 ceph-mon[31080]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:44.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:44 smithi081 ceph-mon[33870]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:44.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:08:44.814 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:44 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:44 smithi089 ceph-mon[33879]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:08:45.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:44 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:44 smithi017 ceph-mon[31080]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:08:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:44 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:45.906 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:45 smithi081 ceph-mon[33870]: Deploying daemon osd.10 on smithi081 2024-09-21T06:08:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:45 smithi089 ceph-mon[33879]: Deploying daemon osd.10 on smithi081 2024-09-21T06:08:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:45 smithi017 ceph-mon[31080]: Deploying daemon osd.10 on smithi081 2024-09-21T06:08:47.003 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:46 smithi081 ceph-mon[33870]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:46 smithi089 ceph-mon[33879]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:46 smithi017 ceph-mon[31080]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:49.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:48 smithi081 ceph-mon[33870]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:48 smithi089 ceph-mon[33879]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:49.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:48 smithi017 ceph-mon[31080]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:50.926 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:50 smithi081 ceph-mon[33870]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:50.927 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:50.927 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:50.927 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:50 smithi089 ceph-mon[33879]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:50 smithi017 ceph-mon[31080]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:52.924 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:52 smithi081 ceph-mon[33870]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:52 smithi089 ceph-mon[33879]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:53.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:52 smithi017 ceph-mon[31080]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:54.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.102+0000 7fc0a57fa640 1 -- 172.21.15.81:0/415964213 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc0a806b570 con 0x7fc0940b6590 2024-09-21T06:08:54.105 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 10 on host 'smithi081' 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc0940b6590 msgr2=0x7fc0940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc0940b6590 0x7fc0940b8aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc09800abe0 tx=0x7fc09800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 msgr2=0x7fc0a819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 0x7fc0a819a500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c970 tx=0x7fc09000cd70 comp rx=0 tx=0).stop 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 shutdown_connections 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc0940b6590 0x7fc0940b8aa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a8104070 0x7fc0a819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a81036d0 0x7fc0a819a500 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 --2- 172.21.15.81:0/415964213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0a8102640 0x7fc0a8199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 >> 172.21.15.81:0/415964213 conn(0x7fc0a80fdfb0 msgr2=0x7fc0a806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 shutdown_connections 2024-09-21T06:08:54.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:08:54.105+0000 7fc0ae15c640 1 -- 172.21.15.81:0/415964213 wait complete. 2024-09-21T06:08:54.482 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:54.482 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.482 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.482 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:54.482 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:54.482 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.483 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:54.483 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.483 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:54 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:54 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:54 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:54.844 DEBUG:teuthology.orchestra.run.smithi081:osd.10> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T06:08:54.847 INFO:tasks.cephadm:Deploying osd.11 on smithi089 with /dev/vg_nvme/lv_1... 2024-09-21T06:08:54.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:08:55.104 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:08:56.471 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:56 smithi081 ceph-mon[33870]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:56.499 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:56 smithi089 ceph-mon[33879]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:56 smithi017 ceph-mon[31080]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:56.758 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:08:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:08:56.474+0000 7f7e61d13640 -1 osd.10 0 log_to_monitors true 2024-09-21T06:08:57.428 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:57 smithi089 ceph-mon[33879]: from='osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:08:57.428 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:57 smithi089 ceph-mon[33879]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:08:57.500 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:57 smithi081 ceph-mon[33870]: from='osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:08:57.501 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:57 smithi081 ceph-mon[33870]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:08:57.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:57 smithi017 ceph-mon[31080]: from='osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:08:57.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:57 smithi017 ceph-mon[31080]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:08:57.823 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:08:57.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_1 2024-09-21T06:08:58.102 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:08:58.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:58.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:58.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.526 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:58.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:58.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 -- 172.21.15.89:0/549121767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 msgr2=0x7f16dc10aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 --2- 172.21.15.89:0/549121767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc10aa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009ca0 tx=0x7f16d402a950 comp rx=0 tx=0).stop 2024-09-21T06:08:58.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 -- 172.21.15.89:0/549121767 shutdown_connections 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 --2- 172.21.15.89:0/549121767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16dc103710 0x7f16dc103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 --2- 172.21.15.89:0/549121767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc10aa50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 --2- 172.21.15.89:0/549121767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc102680 0x7f16dc102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 -- 172.21.15.89:0/549121767 >> 172.21.15.89:0/549121767 conn(0x7f16dc0fdff0 msgr2=0x7f16dc1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 -- 172.21.15.89:0/549121767 shutdown_connections 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 -- 172.21.15.89:0/549121767 wait complete. 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.617+0000 7f16e3209640 1 Processor -- start 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 -- start start 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16dc102680 0x7f16dc06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc103710 0x7f16dc19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc1a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc10e180 con 0x7f16dc102680 2024-09-21T06:08:58.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc10e000 con 0x7f16dc103710 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e3209640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc10e300 con 0x7f16dc1040b0 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e17a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc1a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e17a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc1a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33550/0 (socket says 172.21.15.89:33550) 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e17a6640 1 -- 172.21.15.89:0/2174485544 learned_addr learned my addr 172.21.15.89:0/2174485544 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc103710 0x7f16dc19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e0fa5640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16dc102680 0x7f16dc06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 -- 172.21.15.89:0/2174485544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 msgr2=0x7f16dc1a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc1a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 -- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16dc102680 msgr2=0x7f16dc06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16dc102680 0x7f16dc06c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 -- 172.21.15.89:0/2174485544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16dc1a1980 con 0x7f16dc103710 2024-09-21T06:08:58.634 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16e17a6640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.618+0000 7f16dbfff640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc103710 0x7f16dc19ec30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16d000d6d0 tx=0x7f16d000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.619+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0017070 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.619+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16dc1a1c70 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.619+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16d0009820 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.619+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0004bc0 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.619+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16dc1a21b0 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.620+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16dc109860 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.621+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f16d0005220 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.622+0000 7f16d9ffb640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f16c40b6510 0x7f16c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.622+0000 7f16e0fa5640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f16c40b6510 0x7f16c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.622+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6414+0+0 (secure 0 0 0) 0x7f16d00e66b0 con 0x7f16dc103710 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.623+0000 7f16e0fa5640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f16c40b6510 0x7f16c40b8a20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009bd0 tx=0x7f16cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:08:58.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.626+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16d00b1a70 con 0x7f16dc103710 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T06:08:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:08:58.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:08:58.818 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:08:58.816+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f16dc063800 con 0x7f16c40b6510 2024-09-21T06:08:59.007 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:08:58.631+0000 7f7e5e4aa640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T06:08:59.008 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:08:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:08:58.644+0000 7f7e55a8b640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi081 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:59.486 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='osd.10 ' entity='osd.10' 2024-09-21T06:08:59.487 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:59.487 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:59.487 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:08:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:59.527 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi081 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='osd.10 ' entity='osd.10' 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:59.528 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:08:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:08:59.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi081 2024-09-21T06:08:59.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-21T06:08:59.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='osd.10 ' entity='osd.10' 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:08:59.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:08:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] boot 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:09:00.477 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] boot 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:09:00.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:09:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:09:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:09:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:09:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:09:00.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: osd.10 [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] boot 2024-09-21T06:09:00.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:09:00.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:09:01.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:01 smithi089 ceph-mon[33879]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:09:01.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/2728645490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"} : dispatch 2024-09-21T06:09:01.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:01 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"} : dispatch 2024-09-21T06:09:01.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:01 smithi089 ceph-mon[33879]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"}]': finished 2024-09-21T06:09:01.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:01 smithi089 ceph-mon[33879]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:09:01.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:01 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:02.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:01 smithi081 ceph-mon[33870]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:09:02.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/2728645490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"} : dispatch 2024-09-21T06:09:02.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:01 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"} : dispatch 2024-09-21T06:09:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:01 smithi081 ceph-mon[33870]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"}]': finished 2024-09-21T06:09:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:01 smithi081 ceph-mon[33870]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:09:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:01 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:01 smithi017 ceph-mon[31080]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:09:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/2728645490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"} : dispatch 2024-09-21T06:09:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:01 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"} : dispatch 2024-09-21T06:09:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:01 smithi017 ceph-mon[31080]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8307455c-8674-4fb4-b0f4-2ab076db2a4a"}]': finished 2024-09-21T06:09:02.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:01 smithi017 ceph-mon[31080]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:09:02.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:01 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:02 smithi081 ceph-mon[33870]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:03.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:02 smithi081 ceph-mon[33870]: from='client.? 172.21.15.89:0/3808160127' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:09:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:02 smithi089 ceph-mon[33879]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:02 smithi089 ceph-mon[33879]: from='client.? 172.21.15.89:0/3808160127' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:09:03.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:02 smithi017 ceph-mon[31080]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:03.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:02 smithi017 ceph-mon[31080]: from='client.? 172.21.15.89:0/3808160127' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:09:05.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:04 smithi081 ceph-mon[33870]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-21T06:09:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:04 smithi089 ceph-mon[33879]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-21T06:09:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:04 smithi017 ceph-mon[31080]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-21T06:09:06.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:06 smithi089 ceph-mon[33879]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:09:06.940 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:06 smithi017 ceph-mon[31080]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:09:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:06 smithi081 ceph-mon[33870]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:09:08.985 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:08 smithi089 ceph-mon[33879]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:09:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:08 smithi081 ceph-mon[33870]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:09:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:08 smithi017 ceph-mon[31080]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T06:09:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:10 smithi081 ceph-mon[33870]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:09:11.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:09:11.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:11.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:10 smithi089 ceph-mon[33879]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:09:11.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:09:11.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:11.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:10 smithi017 ceph-mon[31080]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:09:11.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:09:11.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:11.946 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:11 smithi089 ceph-mon[33879]: Deploying daemon osd.11 on smithi089 2024-09-21T06:09:12.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:11 smithi081 ceph-mon[33870]: Deploying daemon osd.11 on smithi089 2024-09-21T06:09:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:11 smithi017 ceph-mon[31080]: Deploying daemon osd.11 on smithi089 2024-09-21T06:09:12.751 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:12 smithi089 ceph-mon[33879]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:09:13.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:12 smithi081 ceph-mon[33870]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:09:13.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:12 smithi017 ceph-mon[31080]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:09:14.774 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:14 smithi089 ceph-mon[33879]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T06:09:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:14 smithi081 ceph-mon[33870]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T06:09:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:14 smithi017 ceph-mon[31080]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T06:09:16.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:16 smithi089 ceph-mon[33879]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:16.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:16.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:16.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:16 smithi081 ceph-mon[33870]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:16 smithi017 ceph-mon[31080]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:19.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:18 smithi081 ceph-mon[33870]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:19.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:18 smithi089 ceph-mon[33879]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:18 smithi017 ceph-mon[31080]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:19.720 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 11 on host 'smithi089' 2024-09-21T06:09:19.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.717+0000 7f16d9ffb640 1 -- 172.21.15.89:0/2174485544 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f16dc063800 con 0x7f16c40b6510 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f16c40b6510 msgr2=0x7f16c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f16c40b6510 0x7f16c40b8a20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009bd0 tx=0x7f16cc005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc103710 msgr2=0x7f16dc19ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc103710 0x7f16dc19ec30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16d000d6d0 tx=0x7f16d000db90 comp rx=0 tx=0).stop 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 shutdown_connections 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f16c40b6510 0x7f16c40b8a20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16dc1040b0 0x7f16dc1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16dc103710 0x7f16dc19ec30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 --2- 172.21.15.89:0/2174485544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16dc102680 0x7f16dc06c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 >> 172.21.15.89:0/2174485544 conn(0x7f16dc0fdff0 msgr2=0x7f16dc106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:19.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 shutdown_connections 2024-09-21T06:09:19.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:19.720+0000 7f16e3209640 1 -- 172.21.15.89:0/2174485544 wait complete. 2024-09-21T06:09:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:20.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:20.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:20.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:20.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:20.424 DEBUG:teuthology.orchestra.run.smithi089:osd.11> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T06:09:20.427 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T06:09:20.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:09:20.698 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 -- 172.21.15.17:0/3288166438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0108cd0 msgr2=0x7f99f010b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3288166438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0108cd0 0x7f99f010b0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009900 tx=0x7f99e002a410 comp rx=0 tx=0).stop 2024-09-21T06:09:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 -- 172.21.15.17:0/3288166438 shutdown_connections 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3288166438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0108cd0 0x7f99f010b0f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3288166438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f010b680 0x7f99f010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3288166438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f006b7b0 0x7f99f0108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 -- 172.21.15.17:0/3288166438 >> 172.21.15.17:0/3288166438 conn(0x7f99f00fdfb0 msgr2=0x7f99f0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 -- 172.21.15.17:0/3288166438 shutdown_connections 2024-09-21T06:09:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.315+0000 7f99f7f66640 1 -- 172.21.15.17:0/3288166438 wait complete. 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.316+0000 7f99f7f66640 1 Processor -- start 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.316+0000 7f99f7f66640 1 -- start start 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f7f66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 0x7f99f019c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f7f66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f0108cd0 0x7f99f019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f7f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f010b680 0x7f99f019d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f7f66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99f0111440 con 0x7f99f006b7b0 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f7f66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99f01112c0 con 0x7f99f010b680 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f7f66640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f99f01115c0 con 0x7f99f0108cd0 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 0x7f99f019c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 0x7f99f019c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34596/0 (socket says 172.21.15.17:34596) 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 -- 172.21.15.17:0/3866323133 learned_addr learned my addr 172.21.15.17:0/3866323133 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f6503640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f010b680 0x7f99f019d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5501640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f0108cd0 0x7f99f019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 -- 172.21.15.17:0/3866323133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f0108cd0 msgr2=0x7f99f019c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f0108cd0 0x7f99f019c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 -- 172.21.15.17:0/3866323133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f010b680 msgr2=0x7f99f019d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f010b680 0x7f99f019d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 -- 172.21.15.17:0/3866323133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f019daf0 con 0x7f99f006b7b0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5501640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f0108cd0 0x7f99f019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f6503640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f010b680 0x7f99f019d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.317+0000 7f99f5d02640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 0x7f99f019c0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00d950 tx=0x7f99ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.318+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec017070 con 0x7f99f006b7b0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.318+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99ec009c30 con 0x7f99f006b7b0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.318+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f019dde0 con 0x7f99f006b7b0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.318+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00f620 con 0x7f99f006b7b0 2024-09-21T06:09:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.318+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f01a44e0 con 0x7f99f006b7b0 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.319+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f00ffad0 con 0x7f99f006b7b0 2024-09-21T06:09:21.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.321+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f99ec010460 con 0x7f99f006b7b0 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.322+0000 7f99e6ffd640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f99dc0b6510 0x7f99dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.322+0000 7f99f5501640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f99dc0b6510 0x7f99dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.322+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7f99ec0e6960 con 0x7f99f006b7b0 2024-09-21T06:09:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.322+0000 7f99f5501640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f99dc0b6510 0x7f99dc0b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f99e0000c00 tx=0x7f99e0031420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:21.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.325+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99ec0ad7b0 con 0x7f99f006b7b0 2024-09-21T06:09:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.515+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f99f002e810 con 0x7f99f006b7b0 2024-09-21T06:09:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.515+0000 7f99e6ffd640 1 -- 172.21.15.17:0/3866323133 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f99ec009de0 con 0x7f99f006b7b0 2024-09-21T06:09:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f99dc0b6510 msgr2=0x7f99dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f99dc0b6510 0x7f99dc0b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f99e0000c00 tx=0x7f99e0031420 comp rx=0 tx=0).stop 2024-09-21T06:09:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 msgr2=0x7f99f019c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 0x7f99f019c0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00d950 tx=0x7f99ec00de10 comp rx=0 tx=0).stop 2024-09-21T06:09:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 shutdown_connections 2024-09-21T06:09:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f99dc0b6510 0x7f99dc0b8a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99f010b680 0x7f99f019d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99f0108cd0 0x7f99f019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 --2- 172.21.15.17:0/3866323133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f006b7b0 0x7f99f019c0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.517+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 >> 172.21.15.17:0/3866323133 conn(0x7f99f00fdfb0 msgr2=0x7f99f0109be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.518+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 shutdown_connections 2024-09-21T06:09:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:21.518+0000 7f99f7f66640 1 -- 172.21.15.17:0/3866323133 wait complete. 2024-09-21T06:09:22.232 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726898939,"num_in_osds":12,"osd_in_since":1726898941,"num_remapped_pgs":0} 2024-09-21T06:09:22.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:22 smithi017 ceph-mon[31080]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:22.429 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:22 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3866323133' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:22.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:22 smithi081 ceph-mon[33870]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:22.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:22 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3866323133' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:22 smithi089 ceph-mon[33879]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:22.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:22 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3866323133' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:22.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:09:22 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:09:22.224+0000 7f201230b640 -1 osd.11 0 log_to_monitors true 2024-09-21T06:09:23.169 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:23 smithi017 ceph-mon[31080]: from='osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:09:23.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:09:23.349 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:23 smithi089 ceph-mon[33879]: from='osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:09:23.349 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:23 smithi089 ceph-mon[33879]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:09:23.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:23 smithi081 ceph-mon[33870]: from='osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:09:23.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:23 smithi081 ceph-mon[33870]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:09:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:23.631 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:23 smithi017 ceph-mon[31080]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 -- 172.21.15.17:0/3777386339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9038103750 msgr2=0x7f9038103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 --2- 172.21.15.17:0/3777386339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9038103750 0x7f9038103bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9028009900 tx=0x7f902802a480 comp rx=0 tx=0).stop 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 -- 172.21.15.17:0/3777386339 shutdown_connections 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 --2- 172.21.15.17:0/3777386339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9038105180 0x7f903810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 --2- 172.21.15.17:0/3777386339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90381047e0 0x7f9038104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 --2- 172.21.15.17:0/3777386339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9038103750 0x7f9038103bc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 -- 172.21.15.17:0/3777386339 >> 172.21.15.17:0/3777386339 conn(0x7f90380ff0c0 msgr2=0x7f9038101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 -- 172.21.15.17:0/3777386339 shutdown_connections 2024-09-21T06:09:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.123+0000 7f903cb24640 1 -- 172.21.15.17:0/3777386339 wait complete. 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 Processor -- start 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 -- start start 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9038103750 0x7f9038199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 0x7f903819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9038105180 0x7f903819b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f903810f2a0 con 0x7f90381047e0 2024-09-21T06:09:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f903810f120 con 0x7f9038105180 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903cb24640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f903810f420 con 0x7f9038103750 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f9035d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 0x7f903819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f9035d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 0x7f903819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34608/0 (socket says 172.21.15.17:34608) 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f9035d9b640 1 -- 172.21.15.17:0/2025553668 learned_addr learned my addr 172.21.15.17:0/2025553668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f903659c640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9038103750 0x7f9038199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.124+0000 7f9036d9d640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9038105180 0x7f903819b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f9035d9b640 1 -- 172.21.15.17:0/2025553668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9038103750 msgr2=0x7f9038199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f9035d9b640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9038103750 0x7f9038199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f9035d9b640 1 -- 172.21.15.17:0/2025553668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9038105180 msgr2=0x7f903819b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f9035d9b640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9038105180 0x7f903819b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f9035d9b640 1 -- 172.21.15.17:0/2025553668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903819b8d0 con 0x7f90381047e0 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f9035d9b640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 0x7f903819a5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c920 tx=0x7f902c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c007c70 con 0x7f90381047e0 2024-09-21T06:09:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903819bbc0 con 0x7f90381047e0 2024-09-21T06:09:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f902c007e10 con 0x7f90381047e0 2024-09-21T06:09:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c018710 con 0x7f90381047e0 2024-09-21T06:09:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.125+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90381a2350 con 0x7f90381047e0 2024-09-21T06:09:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.126+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903810a930 con 0x7f90381047e0 2024-09-21T06:09:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.128+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f902c00f450 con 0x7f90381047e0 2024-09-21T06:09:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.128+0000 7f90277fe640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90200b6590 0x7f90200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.129+0000 7f903659c640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90200b6590 0x7f90200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.129+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6831+0+0 (secure 0 0 0) 0x7f902c0e6dd0 con 0x7f90381047e0 2024-09-21T06:09:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.129+0000 7f903659c640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90200b6590 0x7f90200b8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90280057c0 tx=0x7f9028000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:24.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.133+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f902c014030 con 0x7f90381047e0 2024-09-21T06:09:24.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.322+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9038063fc0 con 0x7f90381047e0 2024-09-21T06:09:24.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.323+0000 7f90277fe640 1 -- 172.21.15.17:0/2025553668 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f902c0adc30 con 0x7f90381047e0 2024-09-21T06:09:24.325 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:24.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90200b6590 msgr2=0x7f90200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90200b6590 0x7f90200b8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90280057c0 tx=0x7f9028000bc0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 msgr2=0x7f903819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 0x7f903819a5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f902c00c920 tx=0x7f902c00cde0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 shutdown_connections 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90200b6590 0x7f90200b8aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90381047e0 0x7f903819a5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9038105180 0x7f903819b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 --2- 172.21.15.17:0/2025553668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9038103750 0x7f9038199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 >> 172.21.15.17:0/2025553668 conn(0x7f90380ff0c0 msgr2=0x7f9038107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 shutdown_connections 2024-09-21T06:09:24.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:24.325+0000 7f903cb24640 1 -- 172.21.15.17:0/2025553668 wait complete. 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: Detected new or changed devices on smithi089 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-21T06:09:24.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:24.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:24.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:09:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: Detected new or changed devices on smithi089 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:24.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:24.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:09:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:09:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: Detected new or changed devices on smithi089 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi089 to 4271M 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:24.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:24.639 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:25.070 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726898939,"num_in_osds":12,"osd_in_since":1726898941,"num_remapped_pgs":0} 2024-09-21T06:09:25.116 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:09:24.648+0000 7f200e28d640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T06:09:25.116 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:09:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:09:24.661+0000 7f2006083640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:09:25.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:25 smithi017 ceph-mon[31080]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:09:25.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:25 smithi017 ceph-mon[31080]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:09:25.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:25.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:25.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:25 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2025553668' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:25.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:25 smithi017 ceph-mon[31080]: from='osd.11 ' entity='osd.11' 2024-09-21T06:09:25.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:25 smithi081 ceph-mon[33870]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:09:25.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:25 smithi081 ceph-mon[33870]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:09:25.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:25.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:25.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:25 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2025553668' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:25.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:25 smithi081 ceph-mon[33870]: from='osd.11 ' entity='osd.11' 2024-09-21T06:09:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:25 smithi089 ceph-mon[33879]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T06:09:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:25 smithi089 ceph-mon[33879]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:09:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:25.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:25.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:25 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2025553668' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:25.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:25 smithi089 ceph-mon[33879]: from='osd.11 ' entity='osd.11' 2024-09-21T06:09:26.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:09:26.340 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:26.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: purged_snaps scrub starts 2024-09-21T06:09:26.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: purged_snaps scrub ok 2024-09-21T06:09:26.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:26.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:26.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] boot 2024-09-21T06:09:26.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T06:09:26.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:26.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: purged_snaps scrub starts 2024-09-21T06:09:26.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: purged_snaps scrub ok 2024-09-21T06:09:26.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:26.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:26.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] boot 2024-09-21T06:09:26.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T06:09:26.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:26.518 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: purged_snaps scrub starts 2024-09-21T06:09:26.518 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: purged_snaps scrub ok 2024-09-21T06:09:26.518 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:09:26.518 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:26.518 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: osd.11 [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] boot 2024-09-21T06:09:26.518 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T06:09:26.519 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:09:26.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 -- 172.21.15.17:0/2410814798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4381095a0 msgr2=0x7fb43810b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:26.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 --2- 172.21.15.17:0/2410814798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4381095a0 0x7fb43810b9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb430009900 tx=0x7fb43002a410 comp rx=0 tx=0).stop 2024-09-21T06:09:26.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 -- 172.21.15.17:0/2410814798 shutdown_connections 2024-09-21T06:09:26.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 --2- 172.21.15.17:0/2410814798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4381095a0 0x7fb43810b9c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 --2- 172.21.15.17:0/2410814798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438106c40 0x7fb438109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 --2- 172.21.15.17:0/2410814798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb438101ae0 0x7fb438101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 -- 172.21.15.17:0/2410814798 >> 172.21.15.17:0/2410814798 conn(0x7fb4380fd770 msgr2=0x7fb4380ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 -- 172.21.15.17:0/2410814798 shutdown_connections 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.781+0000 7fb43f254640 1 -- 172.21.15.17:0/2410814798 wait complete. 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.782+0000 7fb43f254640 1 Processor -- start 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.782+0000 7fb43f254640 1 -- start start 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43f254640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438101ae0 0x7fb438199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43f254640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 0x7fb43819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43f254640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4381095a0 0x7fb43819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43f254640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810f230 con 0x7fb438106c40 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43f254640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810f0b0 con 0x7fb438101ae0 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43f254640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810f3b0 con 0x7fb4381095a0 2024-09-21T06:09:26.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 0x7fb43819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 0x7fb43819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34638/0 (socket says 172.21.15.17:34638) 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 -- 172.21.15.17:0/1469165087 learned_addr learned my addr 172.21.15.17:0/1469165087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43d7f1640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4381095a0 0x7fb43819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43cff0640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438101ae0 0x7fb438199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 -- 172.21.15.17:0/1469165087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4381095a0 msgr2=0x7fb43819b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4381095a0 0x7fb43819b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 -- 172.21.15.17:0/1469165087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438101ae0 msgr2=0x7fb438199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438101ae0 0x7fb438199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 -- 172.21.15.17:0/1469165087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43819b890 con 0x7fb438106c40 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb43cff0640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438101ae0 0x7fb438199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb437fff640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 0x7fb43819a4d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb42800db80 tx=0x7fb42800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.783+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428017070 con 0x7fb438106c40 2024-09-21T06:09:26.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.784+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43819bb80 con 0x7fb438106c40 2024-09-21T06:09:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.784+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb428004020 con 0x7fb438106c40 2024-09-21T06:09:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.784+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42800be60 con 0x7fb438106c40 2024-09-21T06:09:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.784+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4381a2280 con 0x7fb438106c40 2024-09-21T06:09:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.785+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb438101ef0 con 0x7fb438106c40 2024-09-21T06:09:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.786+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb4280044b0 con 0x7fb438106c40 2024-09-21T06:09:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.787+0000 7fb435ffb640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4240b6510 0x7fb4240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.787+0000 7fb43cff0640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4240b6510 0x7fb4240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.787+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb4280e6c10 con 0x7fb438106c40 2024-09-21T06:09:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.788+0000 7fb43cff0640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4240b6510 0x7fb4240b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb420009c20 tx=0x7fb420005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:26.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.790+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4280ad940 con 0x7fb438106c40 2024-09-21T06:09:26.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.979+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb438063fc0 con 0x7fb438106c40 2024-09-21T06:09:26.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.979+0000 7fb435ffb640 1 -- 172.21.15.17:0/1469165087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fb4280b1d20 con 0x7fb438106c40 2024-09-21T06:09:26.982 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4240b6510 msgr2=0x7fb4240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4240b6510 0x7fb4240b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb420009c20 tx=0x7fb420005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 msgr2=0x7fb43819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 0x7fb43819a4d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb42800db80 tx=0x7fb42800b630 comp rx=0 tx=0).stop 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 shutdown_connections 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4240b6510 0x7fb4240b8a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb438106c40 0x7fb43819a4d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4381095a0 0x7fb43819b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 --2- 172.21.15.17:0/1469165087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb438101ae0 0x7fb438199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 >> 172.21.15.17:0/1469165087 conn(0x7fb4380fd770 msgr2=0x7fb438107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 shutdown_connections 2024-09-21T06:09:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:26.982+0000 7fb43f254640 1 -- 172.21.15.17:0/1469165087 wait complete. 2024-09-21T06:09:27.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:27 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1469165087' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:27.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:27 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1469165087' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:27.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:27 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1469165087' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:09:27.787 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726898965,"num_in_osds":12,"osd_in_since":1726898941,"num_remapped_pgs":0} 2024-09-21T06:09:27.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:09:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:28.427 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:28 smithi017 ceph-mon[31080]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:28.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:28 smithi017 ceph-mon[31080]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:09:28.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:28 smithi081 ceph-mon[33870]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:28.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:28 smithi081 ceph-mon[33870]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:09:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 -- 172.21.15.17:0/285798106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 msgr2=0x7fab0810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 --2- 172.21.15.17:0/285798106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0810f520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab00009ca0 tx=0x7fab0002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 -- 172.21.15.17:0/285798106 shutdown_connections 2024-09-21T06:09:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 --2- 172.21.15.17:0/285798106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0810f520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 --2- 172.21.15.17:0/285798106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab081083a0 0x7fab081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 --2- 172.21.15.17:0/285798106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab08102a60 0x7fab08102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 -- 172.21.15.17:0/285798106 >> 172.21.15.17:0/285798106 conn(0x7fab08079730 msgr2=0x7fab08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 -- 172.21.15.17:0/285798106 shutdown_connections 2024-09-21T06:09:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.517+0000 7fab0fe74640 1 -- 172.21.15.17:0/285798106 wait complete. 2024-09-21T06:09:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 Processor -- start 2024-09-21T06:09:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 -- start start 2024-09-21T06:09:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab08102a60 0x7fab0819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab081083a0 0x7fab0819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fab08113960 con 0x7fab08108cf0 2024-09-21T06:09:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab081137e0 con 0x7fab08102a60 2024-09-21T06:09:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0fe74640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fab08113ae0 con 0x7fab081083a0 2024-09-21T06:09:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0e411640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0e411640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0819fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34654/0 (socket says 172.21.15.17:34654) 2024-09-21T06:09:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0e411640 1 -- 172.21.15.17:0/309218479 learned_addr learned my addr 172.21.15.17:0/309218479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:28.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0dc10640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab08102a60 0x7fab0819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.518+0000 7fab0d40f640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab081083a0 0x7fab0819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0e411640 1 -- 172.21.15.17:0/309218479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab081083a0 msgr2=0x7fab0819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0e411640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab081083a0 0x7fab0819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0e411640 1 -- 172.21.15.17:0/309218479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab08102a60 msgr2=0x7fab0819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0e411640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab08102a60 0x7fab0819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0e411640 1 -- 172.21.15.17:0/309218479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab081a0280 con 0x7fab08108cf0 2024-09-21T06:09:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0e411640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0819fb50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab00005cc0 tx=0x7fab00003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00032c10 con 0x7fab08108cf0 2024-09-21T06:09:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab00032db0 con 0x7fab08108cf0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab081a0510 con 0x7fab08108cf0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00030a60 con 0x7fab08108cf0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.519+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab081a6cd0 con 0x7fab08108cf0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.520+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab08102e70 con 0x7fab08108cf0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.522+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fab00030c00 con 0x7fab08108cf0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.523+0000 7faafeffd640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7faaf40b6510 0x7faaf40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.523+0000 7fab0dc10640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7faaf40b6510 0x7faaf40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.523+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fab00108100 con 0x7fab08108cf0 2024-09-21T06:09:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.523+0000 7fab0dc10640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7faaf40b6510 0x7faaf40b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab040095f0 tx=0x7fab04005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.526+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab000ced90 con 0x7fab08108cf0 2024-09-21T06:09:28.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:28 smithi089 ceph-mon[33879]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:28.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:28 smithi089 ceph-mon[33879]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:09:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.715+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab0819b440 con 0x7fab08108cf0 2024-09-21T06:09:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.716+0000 7faafeffd640 1 -- 172.21.15.17:0/309218479 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18410 (secure 0 0 0) 0x7fab0819b440 con 0x7fab08108cf0 2024-09-21T06:09:28.719 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":69,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:09:27.176157+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:09:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7faaf40b6510 msgr2=0x7faaf40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7faaf40b6510 0x7faaf40b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab040095f0 tx=0x7fab04005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 msgr2=0x7fab0819fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0819fb50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab00005cc0 tx=0x7fab00003f90 comp rx=0 tx=0).stop 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 shutdown_connections 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7faaf40b6510 0x7faaf40b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab08108cf0 0x7fab0819fb50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab081083a0 0x7fab0819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 --2- 172.21.15.17:0/309218479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab08102a60 0x7fab0819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.718+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 >> 172.21.15.17:0/309218479 conn(0x7fab08079730 msgr2=0x7fab081043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.719+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 shutdown_connections 2024-09-21T06:09:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:28.719+0000 7fab0fe74640 1 -- 172.21.15.17:0/309218479 wait complete. 2024-09-21T06:09:29.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:29 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/309218479' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:09:29.507 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:05:35.514229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:09:29.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T06:09:29.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:29 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/309218479' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:09:29.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:29 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/309218479' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:09:29.766 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 -- 172.21.15.17:0/2611643711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 msgr2=0x7f0034102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 --2- 172.21.15.17:0/2611643711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f0034102640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0024009ca0 tx=0x7f002402a8e0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 -- 172.21.15.17:0/2611643711 shutdown_connections 2024-09-21T06:09:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 --2- 172.21.15.17:0/2611643711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00341084c0 0x7f003410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 --2- 172.21.15.17:0/2611643711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0034107b70 0x7f0034107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 --2- 172.21.15.17:0/2611643711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f0034102640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 -- 172.21.15.17:0/2611643711 >> 172.21.15.17:0/2611643711 conn(0x7f0034079e40 msgr2=0x7f003407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:30.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 -- 172.21.15.17:0/2611643711 shutdown_connections 2024-09-21T06:09:30.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.263+0000 7f003c710640 1 -- 172.21.15.17:0/2611643711 wait complete. 2024-09-21T06:09:30.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 Processor -- start 2024-09-21T06:09:30.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 -- start start 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f003419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0034107b70 0x7f003419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00341084c0 0x7f003419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0034112070 con 0x7f0034102230 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0034111ef0 con 0x7f00341084c0 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003c710640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f00341121f0 con 0x7f0034107b70 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003a4ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f003419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003a4ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f003419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35580/0 (socket says 172.21.15.17:35580) 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.264+0000 7f003a4ac640 1 -- 172.21.15.17:0/3048460400 learned_addr learned my addr 172.21.15.17:0/3048460400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003acad640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00341084c0 0x7f003419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f0039cab640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0034107b70 0x7f003419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003a4ac640 1 -- 172.21.15.17:0/3048460400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0034107b70 msgr2=0x7f003419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003a4ac640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0034107b70 0x7f003419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003a4ac640 1 -- 172.21.15.17:0/3048460400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00341084c0 msgr2=0x7f003419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003a4ac640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00341084c0 0x7f003419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003a4ac640 1 -- 172.21.15.17:0/3048460400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00341a64d0 con 0x7f0034102230 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003a4ac640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f003419b2d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f002402ae00 tx=0x7f0024003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024004450 con 0x7f0034102230 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00341a6760 con 0x7f0034102230 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f002403f070 con 0x7f0034102230 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024044470 con 0x7f0034102230 2024-09-21T06:09:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.265+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00341990c0 con 0x7f0034102230 2024-09-21T06:09:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.267+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0034102640 con 0x7f0034102230 2024-09-21T06:09:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.268+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0024004710 con 0x7f0034102230 2024-09-21T06:09:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.269+0000 7f00337fe640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f001c0ba950 0x7f001c0bce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.269+0000 7f0039cab640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f001c0ba950 0x7f001c0bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.269+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f00241083b0 con 0x7f0034102230 2024-09-21T06:09:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.269+0000 7f0039cab640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f001c0ba950 0x7f001c0bce60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f003406b940 tx=0x7f0028008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.273+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00240cf040 con 0x7f0034102230 2024-09-21T06:09:30.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.460+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00341994c0 con 0x7f0034102230 2024-09-21T06:09:30.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:30 smithi017 ceph-mon[31080]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:30.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.460+0000 7f00337fe640 1 -- 172.21.15.17:0/3048460400 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f00240d3420 con 0x7f0034102230 2024-09-21T06:09:30.463 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-21T06:09:30.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f001c0ba950 msgr2=0x7f001c0bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f001c0ba950 0x7f001c0bce60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f003406b940 tx=0x7f0028008040 comp rx=0 tx=0).stop 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 msgr2=0x7f003419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f003419b2d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f002402ae00 tx=0x7f0024003ce0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 shutdown_connections 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f001c0ba950 0x7f001c0bce60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00341084c0 0x7f003419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0034107b70 0x7f003419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 --2- 172.21.15.17:0/3048460400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0034102230 0x7f003419b2d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.462+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 >> 172.21.15.17:0/3048460400 conn(0x7f0034079e40 msgr2=0x7f0034100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.463+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 shutdown_connections 2024-09-21T06:09:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:30.463+0000 7f003c710640 1 -- 172.21.15.17:0/3048460400 wait complete. 2024-09-21T06:09:30.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:30 smithi081 ceph-mon[33870]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:30 smithi089 ceph-mon[33879]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.a on smithi017 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.d on smithi017 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.g on smithi017 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.j on smithi017 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.b on smithi081 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.e on smithi081 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.h on smithi081 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.k on smithi081 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.c on smithi089 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.f on smithi089 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.i on smithi089 2024-09-21T06:09:31.072 INFO:tasks.cephadm:Adding mds.l on smithi089 2024-09-21T06:09:31.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l' 2024-09-21T06:09:31.335 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:09:31.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:31 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3048460400' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:09:31.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:31 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3048460400' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:09:31.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:31 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3048460400' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:09:31.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 -- 172.21.15.89:0/1925975817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c1047e0 msgr2=0x7f0f5c104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:31.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 --2- 172.21.15.89:0/1925975817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c1047e0 0x7f0f5c104bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009900 tx=0x7f0f5002a480 comp rx=0 tx=0).stop 2024-09-21T06:09:31.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 -- 172.21.15.89:0/1925975817 shutdown_connections 2024-09-21T06:09:31.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 --2- 172.21.15.89:0/1925975817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c105180 0x7f0f5c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 --2- 172.21.15.89:0/1925975817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c1047e0 0x7f0f5c104bf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 --2- 172.21.15.89:0/1925975817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c103750 0x7f0f5c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 -- 172.21.15.89:0/1925975817 >> 172.21.15.89:0/1925975817 conn(0x7f0f5c0ff0c0 msgr2=0x7f0f5c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 -- 172.21.15.89:0/1925975817 shutdown_connections 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.827+0000 7f0f60830640 1 -- 172.21.15.89:0/1925975817 wait complete. 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 Processor -- start 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 -- start start 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c103750 0x7f0f5c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c1047e0 0x7f0f5c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 0x7f0f5c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:31.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10f2d0 con 0x7f0f5c103750 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10f150 con 0x7f0f5c1047e0 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f60830640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10f450 con 0x7f0f5c105180 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f5ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 0x7f0f5c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f5ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 0x7f0f5c19b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38048/0 (socket says 172.21.15.89:38048) 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.828+0000 7f0f5ad9d640 1 -- 172.21.15.89:0/976869048 learned_addr learned my addr 172.21.15.89:0/976869048 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f59d9b640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c1047e0 0x7f0f5c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5a59c640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c103750 0x7f0f5c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5ad9d640 1 -- 172.21.15.89:0/976869048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c1047e0 msgr2=0x7f0f5c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5ad9d640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c1047e0 0x7f0f5c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5ad9d640 1 -- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c103750 msgr2=0x7f0f5c199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5ad9d640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c103750 0x7f0f5c199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5ad9d640 1 -- 172.21.15.89:0/976869048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c19b9b0 con 0x7f0f5c105180 2024-09-21T06:09:31.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5a59c640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c103750 0x7f0f5c199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f5ad9d640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 0x7f0f5c19b190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400b970 tx=0x7f0f5400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54019070 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f54014440 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c19bca0 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540075d0 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.829+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1a23a0 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.830+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c10a930 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.831+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0f5401c070 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.832+0000 7f0f4b7fe640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f0f440b6590 0x7f0f440b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.832+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f0f540e67a0 con 0x7f0f5c105180 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.832+0000 7f0f5a59c640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f0f440b6590 0x7f0f440b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:31.839 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.833+0000 7f0f5a59c640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f0f440b6590 0x7f0f440b8aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009b40 tx=0x7f0f4c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:31.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:31.835+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f540ad4d0 con 0x7f0f5c105180 2024-09-21T06:09:32.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.022+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l", "target": ["mon-mgr", ""]}) -- 0x7f0f5c063900 con 0x7f0f440b6590 2024-09-21T06:09:32.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.031+0000 7f0f4b7fe640 1 -- 172.21.15.89:0/976869048 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0f5c063900 con 0x7f0f440b6590 2024-09-21T06:09:32.032 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled mds.all update... 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f0f440b6590 msgr2=0x7f0f440b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f0f440b6590 0x7f0f440b8aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009b40 tx=0x7f0f4c005e50 comp rx=0 tx=0).stop 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 msgr2=0x7f0f5c19b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 0x7f0f5c19b190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400b970 tx=0x7f0f5400be30 comp rx=0 tx=0).stop 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 shutdown_connections 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f0f440b6590 0x7f0f440b8aa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c105180 0x7f0f5c19b190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:32.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f5c1047e0 0x7f0f5c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:32.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 --2- 172.21.15.89:0/976869048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c103750 0x7f0f5c199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:32.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 >> 172.21.15.89:0/976869048 conn(0x7f0f5c0ff0c0 msgr2=0x7f0f5c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:32.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 shutdown_connections 2024-09-21T06:09:32.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:09:32.033+0000 7f0f60830640 1 -- 172.21.15.89:0/976869048 wait complete. 2024-09-21T06:09:32.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:32 smithi089 ceph-mon[33879]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:32.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:32.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:32 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:32.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:32 smithi017 ceph-mon[31080]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:32.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:32.498 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:32 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:32.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:32 smithi081 ceph-mon[33870]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:32.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:32.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:32 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:32.875 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T06:09:32.877 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T06:09:32.920 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T06:09:32.963 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T06:09:33.006 DEBUG:teuthology.orchestra.run.smithi081:mds.b> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T06:09:33.009 DEBUG:teuthology.orchestra.run.smithi081:mds.e> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T06:09:33.052 DEBUG:teuthology.orchestra.run.smithi081:mds.h> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T06:09:33.096 DEBUG:teuthology.orchestra.run.smithi081:mds.k> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T06:09:33.138 DEBUG:teuthology.orchestra.run.smithi089:mds.c> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T06:09:33.141 DEBUG:teuthology.orchestra.run.smithi089:mds.f> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T06:09:33.183 DEBUG:teuthology.orchestra.run.smithi089:mds.i> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T06:09:33.227 DEBUG:teuthology.orchestra.run.smithi089:mds.l> sudo journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T06:09:33.270 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T06:09:33.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:33.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:33.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l;count:12 2024-09-21T06:09:33.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:33.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:33.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:33.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:33.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:33.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:33.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:33 smithi089 ceph-mon[33879]: Deploying daemon mds.l on smithi089 2024-09-21T06:09:33.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l;count:12 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:33.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:33 smithi081 ceph-mon[33870]: Deploying daemon mds.l on smithi089 2024-09-21T06:09:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:33.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:33.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l;count:12 2024-09-21T06:09:33.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:33.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:09:33.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:33.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:33.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:33.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:33.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:33 smithi017 ceph-mon[31080]: Deploying daemon mds.l on smithi089 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1075917962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f4109df0 msgr2=0x7fe9f4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1075917962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f4109df0 0x7fe9f4110620 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009900 tx=0x7fe9ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1075917962 shutdown_connections 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1075917962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f4109df0 0x7fe9f4110620 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1075917962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f41094a0 0x7fe9f41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1075917962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f4103b60 0x7fe9f4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1075917962 >> 172.21.15.17:0/1075917962 conn(0x7fe9f407b850 msgr2=0x7fe9f407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1075917962 shutdown_connections 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1075917962 wait complete. 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.027+0000 7fe9fb5eb640 1 Processor -- start 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 -- start start 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f4103b60 0x7fe9f419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 0x7fe9f419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f4109df0 0x7fe9f419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4113960 con 0x7fe9f41094a0 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41137e0 con 0x7fe9f4103b60 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9fb5eb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4113ae0 con 0x7fe9f4109df0 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 0x7fe9f419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 0x7fe9f419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35610/0 (socket says 172.21.15.17:35610) 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 -- 172.21.15.17:0/1619114645 learned_addr learned my addr 172.21.15.17:0/1619114645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f9b88640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f4109df0 0x7fe9f419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f9387640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f4103b60 0x7fe9f419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 -- 172.21.15.17:0/1619114645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f4109df0 msgr2=0x7fe9f419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f4109df0 0x7fe9f419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 -- 172.21.15.17:0/1619114645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f4103b60 msgr2=0x7fe9f419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f4103b60 0x7fe9f419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.028+0000 7fe9f8b86640 1 -- 172.21.15.17:0/1619114645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f41a02e0 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.029+0000 7fe9f8b86640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 0x7fe9f419a910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800d750 tx=0x7fe9e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.029+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8017070 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.029+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e80054b0 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.029+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f41a05d0 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.029+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8004bc0 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.029+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f41a6d30 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.030+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f4103f70 con 0x7fe9f41094a0 2024-09-21T06:09:34.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.031+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe9e8009c30 con 0x7fe9f41094a0 2024-09-21T06:09:34.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.032+0000 7fe9f27fc640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe9dc0b6510 0x7fe9dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:34.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.032+0000 7fe9f9387640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe9dc0b6510 0x7fe9dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:34.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.032+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe9e80e67e0 con 0x7fe9f41094a0 2024-09-21T06:09:34.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.033+0000 7fe9f9387640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe9dc0b6510 0x7fe9dc0b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4005c40 tx=0x7fe9e400a590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:34.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.037+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9e80b18f0 con 0x7fe9f41094a0 2024-09-21T06:09:34.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.266+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9f410bc40 con 0x7fe9f41094a0 2024-09-21T06:09:34.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.267+0000 7fe9f27fc640 1 -- 172.21.15.17:0/1619114645 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fe9e80cee20 con 0x7fe9f41094a0 2024-09-21T06:09:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:34.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"btime":"2024-09-21T06:01:54:962031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T06:09:34.270 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe9dc0b6510 msgr2=0x7fe9dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe9dc0b6510 0x7fe9dc0b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4005c40 tx=0x7fe9e400a590 comp rx=0 tx=0).stop 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 msgr2=0x7fe9f419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 0x7fe9f419a910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800d750 tx=0x7fe9e800dc10 comp rx=0 tx=0).stop 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 shutdown_connections 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe9dc0b6510 0x7fe9dc0b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f41094a0 0x7fe9f419a910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f4109df0 0x7fe9f419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 --2- 172.21.15.17:0/1619114645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f4103b60 0x7fe9f419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:34.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.269+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 >> 172.21.15.17:0/1619114645 conn(0x7fe9f407b850 msgr2=0x7fe9f4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:34.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.270+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 shutdown_connections 2024-09-21T06:09:34.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:34.270+0000 7fe9fb5eb640 1 -- 172.21.15.17:0/1619114645 wait complete. 2024-09-21T06:09:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:34 smithi017 ceph-mon[31080]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:34 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1619114645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:34.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:34 smithi081 ceph-mon[33870]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:34.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:34 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1619114645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:34.785 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:34 smithi089 ceph-mon[33879]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:34.785 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:34 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1619114645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:34.785 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:34 smithi089 systemd[1]: Starting Ceph mds.l for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:35.056 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:34 smithi089 podman[61826]: 2024-09-21 06:09:34.686201926 +0000 UTC m=+0.015513892 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:35.056 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:34 smithi089 podman[61826]: 2024-09-21 06:09:34.806084673 +0000 UTC m=+0.135396639 container create f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:09:35.366 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:35 smithi089 podman[61826]: 2024-09-21 06:09:35.054938622 +0000 UTC m=+0.384250596 container init f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:09:35.366 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:35 smithi089 podman[61826]: 2024-09-21 06:09:35.057745375 +0000 UTC m=+0.387057347 container start f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:09:35.366 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:35 smithi089 ceph-mds[61845]: -- 172.21.15.89:0/849052298 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b62655860 con 0x561b667fd600 2024-09-21T06:09:35.366 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:35 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l[61841]: starting mds.l at 2024-09-21T06:09:35.367 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:35 smithi089 bash[61826]: f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae 2024-09-21T06:09:35.367 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:09:35 smithi089 systemd[1]: Started Ceph mds.l for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6832/838110195,v1:172.21.15.89:6833/838110195] up:boot 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: fsmap 1 up:standby 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:36.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:36.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:36.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:36 smithi081 ceph-mon[33870]: Deploying daemon mds.k on smithi081 2024-09-21T06:09:36.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6832/838110195,v1:172.21.15.89:6833/838110195] up:boot 2024-09-21T06:09:36.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: fsmap 1 up:standby 2024-09-21T06:09:36.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:36.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:36 smithi089 ceph-mon[33879]: Deploying daemon mds.k on smithi081 2024-09-21T06:09:36.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6832/838110195,v1:172.21.15.89:6833/838110195] up:boot 2024-09-21T06:09:36.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: fsmap 1 up:standby 2024-09-21T06:09:36.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:09:36.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:36.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:36.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:36.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:36.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:36.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:36 smithi017 ceph-mon[31080]: Deploying daemon mds.k on smithi081 2024-09-21T06:09:36.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:37.387 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 systemd[1]: Starting Ceph mds.k for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:37.656 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 podman[61030]: 2024-09-21 06:09:37.288554286 +0000 UTC m=+0.015615696 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:37.656 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 podman[61030]: 2024-09-21 06:09:37.401905317 +0000 UTC m=+0.128966725 container create d6924a8e2637c99e56ed77340668dac22e35a99b312250d971da099c98bacedf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:09:37.656 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 podman[61030]: 2024-09-21 06:09:37.655102902 +0000 UTC m=+0.382164302 container init d6924a8e2637c99e56ed77340668dac22e35a99b312250d971da099c98bacedf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:09:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.703+0000 7fa004cc1640 1 -- 172.21.15.17:0/128057462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 msgr2=0x7fa0001098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.703+0000 7fa004cc1640 1 --2- 172.21.15.17:0/128057462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa0001098b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009900 tx=0x7f9ff402a410 comp rx=0 tx=0).stop 2024-09-21T06:09:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 -- 172.21.15.17:0/128057462 shutdown_connections 2024-09-21T06:09:37.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 --2- 172.21.15.17:0/128057462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa0001098b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 --2- 172.21.15.17:0/128057462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa000109df0 0x7fa000110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 --2- 172.21.15.17:0/128057462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000103b60 0x7fa000103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 -- 172.21.15.17:0/128057462 >> 172.21.15.17:0/128057462 conn(0x7fa00007b850 msgr2=0x7fa00007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 -- 172.21.15.17:0/128057462 shutdown_connections 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.704+0000 7fa004cc1640 1 -- 172.21.15.17:0/128057462 wait complete. 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 Processor -- start 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 -- start start 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa000103b60 0x7fa00019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa00019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000109df0 0x7fa00019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa000113980 con 0x7fa0001094a0 2024-09-21T06:09:37.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa000113800 con 0x7fa000103b60 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7fa004cc1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa000113b00 con 0x7fa000109df0 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa00019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa00019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35620/0 (socket says 172.21.15.17:35620) 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffdd9b640 1 -- 172.21.15.17:0/1561191844 learned_addr learned my addr 172.21.15.17:0/1561191844 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffe59c640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa000103b60 0x7fa00019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffed9d640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000109df0 0x7fa00019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffdd9b640 1 -- 172.21.15.17:0/1561191844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000109df0 msgr2=0x7fa00019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.705+0000 7f9ffdd9b640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000109df0 0x7fa00019fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9ffdd9b640 1 -- 172.21.15.17:0/1561191844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa000103b60 msgr2=0x7fa00019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9ffdd9b640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa000103b60 0x7fa00019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9ffdd9b640 1 -- 172.21.15.17:0/1561191844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0001a03c0 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9ffdd9b640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa00019a9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4005940 tx=0x7f9ff40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff403f030 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ff4003a80 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0001a0650 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4035070 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.706+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0001a6e10 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.707+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa000103f70 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.708+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9ff4042030 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.709+0000 7f9fef7fe640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9fe80b6590 0x7f9fe80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.709+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f9ff41072e0 con 0x7fa0001094a0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.709+0000 7f9ffe59c640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9fe80b6590 0x7f9fe80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.710+0000 7f9ffe59c640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9fe80b6590 0x7f9fe80b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009990 tx=0x7f9ff0009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.714+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ff40ce010 con 0x7fa0001094a0 2024-09-21T06:09:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.942+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa00002e640 con 0x7fa0001094a0 2024-09-21T06:09:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.942+0000 7f9fef7fe640 1 -- 172.21.15.17:0/1561191844 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1432 (secure 0 0 0) 0x7f9ff40d23f0 con 0x7fa0001094a0 2024-09-21T06:09:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-09-21T06:09:37.945 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:37.946 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"btime":"2024-09-21T06:09:35:096335+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:09:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.944+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9fe80b6590 msgr2=0x7f9fe80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.944+0000 7fa004cc1640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9fe80b6590 0x7f9fe80b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009990 tx=0x7f9ff0009110 comp rx=0 tx=0).stop 2024-09-21T06:09:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.944+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 msgr2=0x7fa00019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.944+0000 7fa004cc1640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa00019a9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4005940 tx=0x7f9ff40040e0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 shutdown_connections 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9fe80b6590 0x7f9fe80b8aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0001094a0 0x7fa00019a9f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa000109df0 0x7fa00019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 --2- 172.21.15.17:0/1561191844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa000103b60 0x7fa00019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 >> 172.21.15.17:0/1561191844 conn(0x7fa00007b850 msgr2=0x7fa0001075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 shutdown_connections 2024-09-21T06:09:37.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:37.945+0000 7fa004cc1640 1 -- 172.21.15.17:0/1561191844 wait complete. 2024-09-21T06:09:38.007 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 podman[61030]: 2024-09-21 06:09:37.658064572 +0000 UTC m=+0.385125973 container start d6924a8e2637c99e56ed77340668dac22e35a99b312250d971da099c98bacedf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:09:38.008 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 ceph-mds[61049]: -- 172.21.15.81:0/630065924 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560db7233860 con 0x560dbb3dba80 2024-09-21T06:09:38.008 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k[61045]: starting mds.k at 2024-09-21T06:09:38.008 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 bash[61030]: d6924a8e2637c99e56ed77340668dac22e35a99b312250d971da099c98bacedf 2024-09-21T06:09:38.008 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:09:37 smithi081 systemd[1]: Started Ceph mds.k for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:39.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: Deploying daemon mds.j on smithi017 2024-09-21T06:09:39.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1561191844' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:39.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6832/4192055797,v1:172.21.15.81:6833/4192055797] up:boot 2024-09-21T06:09:39.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: fsmap 2 up:standby 2024-09-21T06:09:39.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:38 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:09:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: Deploying daemon mds.j on smithi017 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1561191844' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:39.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6832/4192055797,v1:172.21.15.81:6833/4192055797] up:boot 2024-09-21T06:09:39.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: fsmap 2 up:standby 2024-09-21T06:09:39.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:38 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: Deploying daemon mds.j on smithi017 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1561191844' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6832/4192055797,v1:172.21.15.81:6833/4192055797] up:boot 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: fsmap 2 up:standby 2024-09-21T06:09:39.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:38 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:09:40.637 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 systemd[1]: Starting Ceph mds.j for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:40.712 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:40.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:40 smithi017 ceph-mon[31080]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:40.933 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 podman[71407]: 2024-09-21 06:09:40.58487361 +0000 UTC m=+0.016881430 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:40.934 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 podman[71407]: 2024-09-21 06:09:40.687521169 +0000 UTC m=+0.119529039 container create da7564de0be741302203e84fe0c3ae48e77f94e7238eda953358d5b77bee730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T06:09:40.934 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 podman[71407]: 2024-09-21 06:09:40.932332615 +0000 UTC m=+0.364340436 container init da7564de0be741302203e84fe0c3ae48e77f94e7238eda953358d5b77bee730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:09:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:40 smithi089 ceph-mon[33879]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:41.234 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 podman[71407]: 2024-09-21 06:09:40.936024441 +0000 UTC m=+0.368032253 container start da7564de0be741302203e84fe0c3ae48e77f94e7238eda953358d5b77bee730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:09:41.234 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 ceph-mds[71456]: -- 172.21.15.17:0/847170786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d06ee9860 con 0x560d0b091600 2024-09-21T06:09:41.234 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:40 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j[71440]: starting mds.j at 2024-09-21T06:09:41.234 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:41 smithi017 bash[71407]: da7564de0be741302203e84fe0c3ae48e77f94e7238eda953358d5b77bee730f 2024-09-21T06:09:41.234 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:09:41 smithi017 systemd[1]: Started Ceph mds.j for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:40 smithi081 ceph-mon[33870]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/362434265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec109e10 msgr2=0x7ffbec110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/362434265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec109e10 0x7ffbec110640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009ca0 tx=0x7ffbe402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/362434265 shutdown_connections 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/362434265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec109e10 0x7ffbec110640 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/362434265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbec1094c0 0x7ffbec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/362434265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec103b80 0x7ffbec103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/362434265 >> 172.21.15.17:0/362434265 conn(0x7ffbec0ff610 msgr2=0x7ffbec101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/362434265 shutdown_connections 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/362434265 wait complete. 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.646+0000 7ffbf2b5a640 1 Processor -- start 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 -- start start 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbec103b80 0x7ffbec19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 0x7ffbec19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec109e10 0x7ffbec19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1139d0 con 0x7ffbec1094c0 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec113850 con 0x7ffbec103b80 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf2b5a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec113b50 con 0x7ffbec109e10 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 0x7ffbec19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 0x7ffbec19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60768/0 (socket says 172.21.15.17:60768) 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 -- 172.21.15.17:0/2665627942 learned_addr learned my addr 172.21.15.17:0/2665627942 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf08f6640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbec103b80 0x7ffbec19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbf10f7640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec109e10 0x7ffbec19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 -- 172.21.15.17:0/2665627942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec109e10 msgr2=0x7ffbec19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec109e10 0x7ffbec19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 -- 172.21.15.17:0/2665627942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbec103b80 msgr2=0x7ffbec19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbec103b80 0x7ffbec19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 -- 172.21.15.17:0/2665627942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec1a02b0 con 0x7ffbec1094c0 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.647+0000 7ffbebfff640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 0x7ffbec19a8e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800e970 tx=0x7ffbd800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.648+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800cd80 con 0x7ffbec1094c0 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.648+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbd80035f0 con 0x7ffbec1094c0 2024-09-21T06:09:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.648+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8010690 con 0x7ffbec1094c0 2024-09-21T06:09:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.648+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec1a05a0 con 0x7ffbec1094c0 2024-09-21T06:09:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.648+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec1a6d00 con 0x7ffbec1094c0 2024-09-21T06:09:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.649+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec104e00 con 0x7ffbec1094c0 2024-09-21T06:09:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.652+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ffbd8004000 con 0x7ffbec1094c0 2024-09-21T06:09:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.652+0000 7ffbe9ffb640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffbdc0b6590 0x7ffbdc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:41.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.652+0000 7ffbf08f6640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffbdc0b6590 0x7ffbdc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:41.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.652+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7ffbd80e7130 con 0x7ffbec1094c0 2024-09-21T06:09:41.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.653+0000 7ffbf08f6640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffbdc0b6590 0x7ffbdc0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0005d00 tx=0x7ffbe000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:41.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.656+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffbd80ade60 con 0x7ffbec1094c0 2024-09-21T06:09:41.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.891+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbec103f90 con 0x7ffbec1094c0 2024-09-21T06:09:41.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.891+0000 7ffbe9ffb640 1 -- 172.21.15.17:0/2665627942 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3079 (secure 0 0 0) 0x7ffbd80b2240 con 0x7ffbec1094c0 2024-09-21T06:09:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:41.893 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"btime":"2024-09-21T06:09:41:806008+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:09:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffbdc0b6590 msgr2=0x7ffbdc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffbdc0b6590 0x7ffbdc0b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0005d00 tx=0x7ffbe000b410 comp rx=0 tx=0).stop 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 msgr2=0x7ffbec19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 0x7ffbec19a8e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800e970 tx=0x7ffbd800ee30 comp rx=0 tx=0).stop 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 shutdown_connections 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffbdc0b6590 0x7ffbdc0b8aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbec1094c0 0x7ffbec19a8e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbec109e10 0x7ffbec19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 --2- 172.21.15.17:0/2665627942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbec103b80 0x7ffbec19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.893+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 >> 172.21.15.17:0/2665627942 conn(0x7ffbec0ff610 msgr2=0x7ffbec101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.894+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 shutdown_connections 2024-09-21T06:09:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:41.894+0000 7ffbf2b5a640 1 -- 172.21.15.17:0/2665627942 wait complete. 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: Deploying daemon mds.d on smithi017 2024-09-21T06:09:42.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.17:6834/426359055,v1:172.21.15.17:6835/426359055] up:boot 2024-09-21T06:09:42.368 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: fsmap 3 up:standby 2024-09-21T06:09:42.368 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:09:42.368 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:42 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2665627942' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:42.380 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.380 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.380 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.380 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:42.380 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:42.380 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:42.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:42.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: Deploying daemon mds.d on smithi017 2024-09-21T06:09:42.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.17:6834/426359055,v1:172.21.15.17:6835/426359055] up:boot 2024-09-21T06:09:42.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: fsmap 3 up:standby 2024-09-21T06:09:42.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:09:42.381 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:42 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2665627942' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:42.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: Deploying daemon mds.d on smithi017 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.17:6834/426359055,v1:172.21.15.17:6835/426359055] up:boot 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: fsmap 3 up:standby 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:09:42.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:42 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2665627942' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:44.137 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 systemd[1]: Starting Ceph mds.d for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:44.494 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:44 smithi017 ceph-mon[31080]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:44.497 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 podman[71794]: 2024-09-21 06:09:44.148602228 +0000 UTC m=+0.016280362 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:44.497 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 podman[71794]: 2024-09-21 06:09:44.248260145 +0000 UTC m=+0.115938263 container create 4e44f0cdd5d8ea7dc149cdaf81ba9f4fc92207d541cecfdfdda6480cec39d4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:09:44.497 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 podman[71794]: 2024-09-21 06:09:44.492934803 +0000 UTC m=+0.360612930 container init 4e44f0cdd5d8ea7dc149cdaf81ba9f4fc92207d541cecfdfdda6480cec39d4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T06:09:44.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:44 smithi081 ceph-mon[33870]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:44.621 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:44 smithi089 ceph-mon[33879]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:44.888 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 podman[71794]: 2024-09-21 06:09:44.496005473 +0000 UTC m=+0.363683591 container start 4e44f0cdd5d8ea7dc149cdaf81ba9f4fc92207d541cecfdfdda6480cec39d4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:09:44.888 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 ceph-mds[71813]: -- 172.21.15.17:0/3597993146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd3ab13860 con 0x55cd3ecbb180 2024-09-21T06:09:44.888 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d[71809]: starting mds.d at 2024-09-21T06:09:44.888 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 bash[71794]: 4e44f0cdd5d8ea7dc149cdaf81ba9f4fc92207d541cecfdfdda6480cec39d4a8 2024-09-21T06:09:44.888 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:09:44 smithi017 systemd[1]: Started Ceph mds.d for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:45.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:45.798 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:45.798 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: Deploying daemon mds.e on smithi081 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.17:6836/154694548,v1:172.21.15.17:6837/154694548] up:boot 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: fsmap 4 up:standby 2024-09-21T06:09:45.799 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:09:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 -- 172.21.15.17:0/2907912381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 msgr2=0x7fda4c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 --2- 172.21.15.17:0/2907912381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c1087d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fda34009900 tx=0x7fda3402a410 comp rx=0 tx=0).stop 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 -- 172.21.15.17:0/2907912381 shutdown_connections 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 --2- 172.21.15.17:0/2907912381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c1087d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 --2- 172.21.15.17:0/2907912381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c108d10 0x7fda4c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 --2- 172.21.15.17:0/2907912381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda4c102a80 0x7fda4c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 -- 172.21.15.17:0/2907912381 >> 172.21.15.17:0/2907912381 conn(0x7fda4c079740 msgr2=0x7fda4c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 -- 172.21.15.17:0/2907912381 shutdown_connections 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.890+0000 7fda52378640 1 -- 172.21.15.17:0/2907912381 wait complete. 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.891+0000 7fda52378640 1 Processor -- start 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.891+0000 7fda52378640 1 -- start start 2024-09-21T06:09:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.891+0000 7fda52378640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c102a80 0x7fda4c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.891+0000 7fda52378640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda52378640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda4c108d10 0x7fda4c19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda52378640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c113950 con 0x7fda4c1083c0 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda52378640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c1137d0 con 0x7fda4c102a80 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda52378640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c113ad0 con 0x7fda4c108d10 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c19a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60794/0 (socket says 172.21.15.17:60794) 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 -- 172.21.15.17:0/1288222569 learned_addr learned my addr 172.21.15.17:0/1288222569 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda50915640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda4c108d10 0x7fda4c19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4bfff640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c102a80 0x7fda4c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 -- 172.21.15.17:0/1288222569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda4c108d10 msgr2=0x7fda4c19fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda4c108d10 0x7fda4c19fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 -- 172.21.15.17:0/1288222569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c102a80 msgr2=0x7fda4c19a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c102a80 0x7fda4c19a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 -- 172.21.15.17:0/1288222569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4c1a0310 con 0x7fda4c1083c0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4bfff640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c102a80 0x7fda4c19a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda4b7fe640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c19a940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fda34005940 tx=0x7fda34004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.892+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3403f030 con 0x7fda4c1083c0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.893+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4c1a05a0 con 0x7fda4c1083c0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.893+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda34004440 con 0x7fda4c1083c0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.893+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34035070 con 0x7fda4c1083c0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.893+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda4c1a6d60 con 0x7fda4c1083c0 2024-09-21T06:09:45.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.894+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c103d00 con 0x7fda4c1083c0 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.895+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fda34042030 con 0x7fda4c1083c0 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.896+0000 7fda497fa640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fda380b6510 0x7fda380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.896+0000 7fda4bfff640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fda380b6510 0x7fda380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.896+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fda341076c0 con 0x7fda4c1083c0 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.897+0000 7fda4bfff640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fda380b6510 0x7fda380b8a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda3c005d00 tx=0x7fda3c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:45.900+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda340ce3f0 con 0x7fda4c1083c0 2024-09-21T06:09:46.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:46.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: Deploying daemon mds.e on smithi081 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.17:6836/154694548,v1:172.21.15.17:6837/154694548] up:boot 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: fsmap 4 up:standby 2024-09-21T06:09:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:09:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: Deploying daemon mds.e on smithi081 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.17:6836/154694548,v1:172.21.15.17:6837/154694548] up:boot 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: fsmap 4 up:standby 2024-09-21T06:09:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:09:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.123+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda4c102e90 con 0x7fda4c1083c0 2024-09-21T06:09:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.124+0000 7fda497fa640 1 -- 172.21.15.17:0/1288222569 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3901 (secure 0 0 0) 0x7fda340d27d0 con 0x7fda4c1083c0 2024-09-21T06:09:46.126 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:46.126 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"btime":"2024-09-21T06:09:45:165103+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:09:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fda380b6510 msgr2=0x7fda380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fda380b6510 0x7fda380b8a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda3c005d00 tx=0x7fda3c005c70 comp rx=0 tx=0).stop 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 msgr2=0x7fda4c19a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c19a940 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fda34005940 tx=0x7fda34004040 comp rx=0 tx=0).stop 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 shutdown_connections 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fda380b6510 0x7fda380b8a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda4c1083c0 0x7fda4c19a940 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda4c108d10 0x7fda4c19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 --2- 172.21.15.17:0/1288222569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda4c102a80 0x7fda4c19a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 >> 172.21.15.17:0/1288222569 conn(0x7fda4c079740 msgr2=0x7fda4c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 shutdown_connections 2024-09-21T06:09:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:46.126+0000 7fda52378640 1 -- 172.21.15.17:0/1288222569 wait complete. 2024-09-21T06:09:46.811 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:46 smithi017 ceph-mon[31080]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:46.811 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:46 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1288222569' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:46.908 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:46 smithi081 ceph-mon[33870]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:46.908 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:46 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1288222569' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:46.908 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:46 smithi081 systemd[1]: Starting Ceph mds.e for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:46 smithi089 ceph-mon[33879]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:46 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1288222569' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:47.204 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:46 smithi081 podman[61312]: 2024-09-21 06:09:46.809075242 +0000 UTC m=+0.015873259 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:47.204 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:46 smithi081 podman[61312]: 2024-09-21 06:09:46.950370466 +0000 UTC m=+0.157168521 container create 97a6e2837c7195944204a5bbb5d757a14d487dc259cd93de51fd82c1a4d8a681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:09:47.507 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:47 smithi081 podman[61312]: 2024-09-21 06:09:47.203009688 +0000 UTC m=+0.409807703 container init 97a6e2837c7195944204a5bbb5d757a14d487dc259cd93de51fd82c1a4d8a681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:09:47.508 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:47 smithi081 podman[61312]: 2024-09-21 06:09:47.206093011 +0000 UTC m=+0.412891018 container start 97a6e2837c7195944204a5bbb5d757a14d487dc259cd93de51fd82c1a4d8a681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:09:47.508 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:47 smithi081 ceph-mds[61331]: -- 172.21.15.81:0/1117639587 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc26669860 con 0x55dc2a811180 2024-09-21T06:09:47.508 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:47 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e[61327]: starting mds.e at 2024-09-21T06:09:47.508 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:47 smithi081 bash[61312]: 97a6e2837c7195944204a5bbb5d757a14d487dc259cd93de51fd82c1a4d8a681 2024-09-21T06:09:47.508 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:09:47 smithi081 systemd[1]: Started Ceph mds.e for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:48.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: Deploying daemon mds.f on smithi089 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6834/1978692137,v1:172.21.15.81:6835/1978692137] up:boot 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: fsmap 5 up:standby 2024-09-21T06:09:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:48 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:09:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: Deploying daemon mds.f on smithi089 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6834/1978692137,v1:172.21.15.81:6835/1978692137] up:boot 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: fsmap 5 up:standby 2024-09-21T06:09:48.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:48 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:09:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: Deploying daemon mds.f on smithi089 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6834/1978692137,v1:172.21.15.81:6835/1978692137] up:boot 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: fsmap 5 up:standby 2024-09-21T06:09:48.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:48 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:09:48.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:49.367 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 systemd[1]: Starting Ceph mds.f for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 -- 172.21.15.17:0/687504344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e8103990 msgr2=0x7f39e8103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/687504344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e8103990 0x7f39e8103da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009900 tx=0x7f39d802a410 comp rx=0 tx=0).stop 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 -- 172.21.15.17:0/687504344 shutdown_connections 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/687504344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8109c20 0x7f39e8110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/687504344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e81092d0 0x7f39e81096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/687504344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e8103990 0x7f39e8103da0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 -- 172.21.15.17:0/687504344 >> 172.21.15.17:0/687504344 conn(0x7f39e80ff3e0 msgr2=0x7f39e8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 -- 172.21.15.17:0/687504344 shutdown_connections 2024-09-21T06:09:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.605+0000 7f39ecb9d640 1 -- 172.21.15.17:0/687504344 wait complete. 2024-09-21T06:09:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 Processor -- start 2024-09-21T06:09:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 -- start start 2024-09-21T06:09:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8103990 0x7f39e819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 0x7f39e819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8109c20 0x7f39e819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8113790 con 0x7f39e81092d0 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8113610 con 0x7f39e8103990 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39ecb9d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8113910 con 0x7f39e8109c20 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 0x7f39e819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39e77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8103990 0x7f39e819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 0x7f39e819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53016/0 (socket says 172.21.15.17:53016) 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39deffd640 1 -- 172.21.15.17:0/3723894025 learned_addr learned my addr 172.21.15.17:0/3723894025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.606+0000 7f39e7fff640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8109c20 0x7f39e819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39deffd640 1 -- 172.21.15.17:0/3723894025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8109c20 msgr2=0x7f39e819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39deffd640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8109c20 0x7f39e819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39deffd640 1 -- 172.21.15.17:0/3723894025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8103990 msgr2=0x7f39e819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39deffd640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8103990 0x7f39e819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39deffd640 1 -- 172.21.15.17:0/3723894025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e81a0170 con 0x7f39e81092d0 2024-09-21T06:09:49.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39deffd640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 0x7f39e819a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c970 tx=0x7f39d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0007bb0 con 0x7f39e81092d0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39d0007d50 con 0x7f39e81092d0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e81a0460 con 0x7f39e81092d0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0004da0 con 0x7f39e81092d0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.607+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e81a6bc0 con 0x7f39e81092d0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.609+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e8103da0 con 0x7f39e81092d0 2024-09-21T06:09:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.610+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f39d0004f40 con 0x7f39e81092d0 2024-09-21T06:09:49.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.611+0000 7f39e57fa640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d40b6590 0x7f39d40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:49.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.611+0000 7f39e77fe640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d40b6590 0x7f39d40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:49.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.611+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f39d00e6a90 con 0x7f39e81092d0 2024-09-21T06:09:49.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.611+0000 7f39e77fe640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d40b6590 0x7f39d40b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39d80057c0 tx=0x7f39d80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.615+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39d0014030 con 0x7f39e81092d0 2024-09-21T06:09:49.777 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 podman[62095]: 2024-09-21 06:09:49.398690293 +0000 UTC m=+0.015833556 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:49.777 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 podman[62095]: 2024-09-21 06:09:49.523466409 +0000 UTC m=+0.140609704 container create c689eb1a1d81ad8aff2b956cbfde15b4c8897204bed24eab5fe414551a37d5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:09:49.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.840+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39e802e640 con 0x7f39e81092d0 2024-09-21T06:09:49.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.841+0000 7f39e57fa640 1 -- 172.21.15.17:0/3723894025 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7f39d00b1ba0 con 0x7f39e81092d0 2024-09-21T06:09:49.843 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:49.843 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"btime":"2024-09-21T06:09:47:669711+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T06:09:49.843 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d40b6590 msgr2=0x7f39d40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d40b6590 0x7f39d40b8aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39d80057c0 tx=0x7f39d80058d0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 msgr2=0x7f39e819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 0x7f39e819a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c970 tx=0x7f39d000ce30 comp rx=0 tx=0).stop 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 shutdown_connections 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d40b6590 0x7f39d40b8aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81092d0 0x7f39e819a7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8109c20 0x7f39e819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 --2- 172.21.15.17:0/3723894025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8103990 0x7f39e819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 >> 172.21.15.17:0/3723894025 conn(0x7f39e80ff3e0 msgr2=0x7f39e8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 shutdown_connections 2024-09-21T06:09:49.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:49.843+0000 7f39ecb9d640 1 -- 172.21.15.17:0/3723894025 wait complete. 2024-09-21T06:09:50.116 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 podman[62095]: 2024-09-21 06:09:49.776461891 +0000 UTC m=+0.393605141 container init c689eb1a1d81ad8aff2b956cbfde15b4c8897204bed24eab5fe414551a37d5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T06:09:50.116 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 podman[62095]: 2024-09-21 06:09:49.779444527 +0000 UTC m=+0.396587786 container start c689eb1a1d81ad8aff2b956cbfde15b4c8897204bed24eab5fe414551a37d5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T06:09:50.117 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 ceph-mds[62114]: -- 172.21.15.89:0/3152363137 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563faab83860 con 0x563faed2b180 2024-09-21T06:09:50.117 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f[62110]: starting mds.f at 2024-09-21T06:09:50.117 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 bash[62095]: c689eb1a1d81ad8aff2b956cbfde15b4c8897204bed24eab5fe414551a37d5cf 2024-09-21T06:09:50.117 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:09:49 smithi089 systemd[1]: Started Ceph mds.f for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:50.519 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3723894025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:50.520 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:50 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:50.576 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:50.576 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3723894025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:50.576 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.576 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.576 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.576 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:50.577 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:50.577 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:50 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3723894025' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:50.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:50 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:51.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:51 smithi017 ceph-mon[31080]: Deploying daemon mds.c on smithi089 2024-09-21T06:09:51.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:51 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6834/1688371803,v1:172.21.15.89:6835/1688371803] up:boot 2024-09-21T06:09:51.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:51 smithi017 ceph-mon[31080]: fsmap 6 up:standby 2024-09-21T06:09:51.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:51 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:09:51.695 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:51 smithi089 ceph-mon[33879]: Deploying daemon mds.c on smithi089 2024-09-21T06:09:51.696 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:51 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6834/1688371803,v1:172.21.15.89:6835/1688371803] up:boot 2024-09-21T06:09:51.696 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:51 smithi089 ceph-mon[33879]: fsmap 6 up:standby 2024-09-21T06:09:51.696 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:51 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:09:51.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:51 smithi081 ceph-mon[33870]: Deploying daemon mds.c on smithi089 2024-09-21T06:09:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:51 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6834/1688371803,v1:172.21.15.89:6835/1688371803] up:boot 2024-09-21T06:09:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:51 smithi081 ceph-mon[33870]: fsmap 6 up:standby 2024-09-21T06:09:51.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:51 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:09:52.092 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:51 smithi089 systemd[1]: Starting Ceph mds.c for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:52.366 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 podman[62366]: 2024-09-21 06:09:51.993519351 +0000 UTC m=+0.015820764 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:52.367 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 podman[62366]: 2024-09-21 06:09:52.121563666 +0000 UTC m=+0.143865066 container create 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:09:52.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:52 smithi017 ceph-mon[31080]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:52 smithi081 ceph-mon[33870]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:52 smithi089 ceph-mon[33879]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:52.867 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 podman[62366]: 2024-09-21 06:09:52.391034704 +0000 UTC m=+0.413336117 container init 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:09:52.867 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 podman[62366]: 2024-09-21 06:09:52.393937522 +0000 UTC m=+0.416238923 container start 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:09:52.867 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 ceph-mds[62385]: -- 172.21.15.89:0/1068247501 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5628fa18fc20 con 0x5628fe337a80 2024-09-21T06:09:52.867 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c[62381]: starting mds.c at 2024-09-21T06:09:52.867 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 bash[62366]: 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 2024-09-21T06:09:52.867 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:09:52 smithi089 systemd[1]: Started Ceph mds.c for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:53.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 -- 172.21.15.17:0/2277796680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 msgr2=0x7fef98107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2277796680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef98107620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fef88009930 tx=0x7fef8802a420 comp rx=0 tx=0).stop 2024-09-21T06:09:53.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 -- 172.21.15.17:0/2277796680 shutdown_connections 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2277796680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef98107620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2277796680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98107be0 0x7fef981080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2277796680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef981027a0 0x7fef98102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 -- 172.21.15.17:0/2277796680 >> 172.21.15.17:0/2277796680 conn(0x7fef98079730 msgr2=0x7fef98079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 -- 172.21.15.17:0/2277796680 shutdown_connections 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.316+0000 7fef9fe54640 1 -- 172.21.15.17:0/2277796680 wait complete. 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 Processor -- start 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 -- start start 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 0x7fef981a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef981a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef98107be0 0x7fef981a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fef98119f90 con 0x7fef981030f0 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef98119e10 con 0x7fef981027a0 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.317+0000 7fef9fe54640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fef9811a110 con 0x7fef98107be0 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 0x7fef981a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9d3ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef981a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 0x7fef981a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:56930/0 (socket says 172.21.15.17:56930) 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 -- 172.21.15.17:0/2044613106 learned_addr learned my addr 172.21.15.17:0/2044613106 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9d3ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef981a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53034/0 (socket says 172.21.15.17:53034) 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9e3f1640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef98107be0 0x7fef981a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 -- 172.21.15.17:0/2044613106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef98107be0 msgr2=0x7fef981a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef98107be0 0x7fef981a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 -- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 msgr2=0x7fef981a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef981a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 -- 172.21.15.17:0/2044613106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef981a69b0 con 0x7fef981027a0 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9d3ef640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef981a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9e3f1640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef98107be0 0x7fef981a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.318+0000 7fef9dbf0640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 0x7fef981a0b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b450 tx=0x7fef9400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.319+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94015020 con 0x7fef981027a0 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.319+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef94011d20 con 0x7fef981027a0 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.319+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94010e10 con 0x7fef981027a0 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.319+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef981a6ca0 con 0x7fef981027a0 2024-09-21T06:09:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.319+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef981a7160 con 0x7fef981027a0 2024-09-21T06:09:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.320+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef98107620 con 0x7fef981027a0 2024-09-21T06:09:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.321+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fef94018020 con 0x7fef981027a0 2024-09-21T06:09:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.322+0000 7fef8effd640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef840b65c0 0x7fef840b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.322+0000 7fef9d3ef640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef840b65c0 0x7fef840b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.322+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fef940e6c40 con 0x7fef981027a0 2024-09-21T06:09:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.323+0000 7fef9d3ef640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef840b65c0 0x7fef840b8ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef88009900 tx=0x7fef880058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.325+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef9401f020 con 0x7fef981027a0 2024-09-21T06:09:53.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.562+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef981a1c30 con 0x7fef981027a0 2024-09-21T06:09:53.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.563+0000 7fef8effd640 1 -- 172.21.15.17:0/2044613106 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6373 (secure 0 0 0) 0x7fef981a1c30 con 0x7fef981027a0 2024-09-21T06:09:53.564 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:53.564 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"btime":"2024-09-21T06:09:53:368476+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T06:09:53.565 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef840b65c0 msgr2=0x7fef840b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef840b65c0 0x7fef840b8ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef88009900 tx=0x7fef880058d0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 msgr2=0x7fef981a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 0x7fef981a0b00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b450 tx=0x7fef9400b910 comp rx=0 tx=0).stop 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 shutdown_connections 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef840b65c0 0x7fef840b8ad0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef981030f0 0x7fef981a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef98107be0 0x7fef981a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 --2- 172.21.15.17:0/2044613106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef981027a0 0x7fef981a0b00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 >> 172.21.15.17:0/2044613106 conn(0x7fef98079730 msgr2=0x7fef981055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 shutdown_connections 2024-09-21T06:09:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:53.565+0000 7fef9fe54640 1 -- 172.21.15.17:0/2044613106 wait complete. 2024-09-21T06:09:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: Deploying daemon mds.h on smithi081 2024-09-21T06:09:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] up:boot 2024-09-21T06:09:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: fsmap 7 up:standby 2024-09-21T06:09:53.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:53 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:09:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: Deploying daemon mds.h on smithi081 2024-09-21T06:09:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] up:boot 2024-09-21T06:09:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: fsmap 7 up:standby 2024-09-21T06:09:53.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:53 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:09:53.983 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.983 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.983 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:53.983 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:53.983 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:53.984 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:53.984 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: Deploying daemon mds.h on smithi081 2024-09-21T06:09:53.984 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] up:boot 2024-09-21T06:09:53.984 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: fsmap 7 up:standby 2024-09-21T06:09:53.984 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:53 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:09:54.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:54 smithi081 ceph-mon[33870]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:54.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:54 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2044613106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:54.758 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:54 smithi081 systemd[1]: Starting Ceph mds.h for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:54 smithi089 ceph-mon[33879]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:54 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2044613106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:54 smithi017 ceph-mon[31080]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2044613106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:55.102 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:54 smithi081 podman[61581]: 2024-09-21 06:09:54.692949908 +0000 UTC m=+0.015829402 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:55.102 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:54 smithi081 podman[61581]: 2024-09-21 06:09:54.823675673 +0000 UTC m=+0.146555151 container create f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:09:55.102 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:55 smithi081 podman[61581]: 2024-09-21 06:09:55.101430841 +0000 UTC m=+0.424310326 container init f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:09:55.507 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:55 smithi081 podman[61581]: 2024-09-21 06:09:55.104317428 +0000 UTC m=+0.427196907 container start f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:09:55.508 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:55 smithi081 ceph-mds[61600]: -- 172.21.15.81:0/485765030 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561987d47860 con 0x56198beef180 2024-09-21T06:09:55.508 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h[61596]: starting mds.h at 2024-09-21T06:09:55.508 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:55 smithi081 bash[61581]: f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b 2024-09-21T06:09:55.508 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:09:55 smithi081 systemd[1]: Started Ceph mds.h for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:56.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:09:56.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: Deploying daemon mds.i on smithi089 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6836/3289455904,v1:172.21.15.81:6837/3289455904] up:boot 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: fsmap 8 up:standby 2024-09-21T06:09:56.508 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:56 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:09:56.547 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:56.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:56.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: Deploying daemon mds.i on smithi089 2024-09-21T06:09:56.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6836/3289455904,v1:172.21.15.81:6837/3289455904] up:boot 2024-09-21T06:09:56.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: fsmap 8 up:standby 2024-09-21T06:09:56.618 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:56 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: Deploying daemon mds.i on smithi089 2024-09-21T06:09:56.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6836/3289455904,v1:172.21.15.81:6837/3289455904] up:boot 2024-09-21T06:09:56.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: fsmap 8 up:standby 2024-09-21T06:09:56.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:56 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:09:57.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 -- 172.21.15.17:0/903894965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5741094a0 msgr2=0x7fe5741098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 --2- 172.21.15.17:0/903894965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5741094a0 0x7fe5741098b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009900 tx=0x7fe55c02a410 comp rx=0 tx=0).stop 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 -- 172.21.15.17:0/903894965 shutdown_connections 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 --2- 172.21.15.17:0/903894965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5741094a0 0x7fe5741098b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 --2- 172.21.15.17:0/903894965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574109df0 0x7fe574110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 --2- 172.21.15.17:0/903894965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe574103b60 0x7fe574103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 -- 172.21.15.17:0/903894965 >> 172.21.15.17:0/903894965 conn(0x7fe57407b850 msgr2=0x7fe57407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 -- 172.21.15.17:0/903894965 shutdown_connections 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.048+0000 7fe57a273640 1 -- 172.21.15.17:0/903894965 wait complete. 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 Processor -- start 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 -- start start 2024-09-21T06:09:57.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574103b60 0x7fe574075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5741094a0 0x7fe574075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 0x7fe574076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe574113960 con 0x7fe574109df0 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5741137e0 con 0x7fe574103b60 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe57a273640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe574113ae0 con 0x7fe5741094a0 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe578810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 0x7fe574076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe578810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 0x7fe574076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53050/0 (socket says 172.21.15.17:53050) 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.049+0000 7fe578810640 1 -- 172.21.15.17:0/3132846605 learned_addr learned my addr 172.21.15.17:0/3132846605 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe573fff640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574103b60 0x7fe574075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe56bfff640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5741094a0 0x7fe574075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe578810640 1 -- 172.21.15.17:0/3132846605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5741094a0 msgr2=0x7fe574075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe578810640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5741094a0 0x7fe574075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe578810640 1 -- 172.21.15.17:0/3132846605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574103b60 msgr2=0x7fe574075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe578810640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574103b60 0x7fe574075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe578810640 1 -- 172.21.15.17:0/3132846605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5741a86f0 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe578810640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 0x7fe574076190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009fd0 tx=0x7fe56c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c017070 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe56c003e00 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5741a89e0 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c010460 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.050+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5741a8ef0 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.051+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe574103f70 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.053+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe56c003970 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.054+0000 7fe571ffb640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5600b6590 0x7fe5600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.054+0000 7fe573fff640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5600b6590 0x7fe5600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.054+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe56c0e6e00 con 0x7fe574109df0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.054+0000 7fe573fff640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5600b6590 0x7fe5600b8aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe574077160 tx=0x7fe564005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:09:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.057+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe56c0b1f90 con 0x7fe574109df0 2024-09-21T06:09:57.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.285+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe57402e640 con 0x7fe574109df0 2024-09-21T06:09:57.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.286+0000 7fe571ffb640 1 -- 172.21.15.17:0/3132846605 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7198 (secure 0 0 0) 0x7fe56c0b6ed0 con 0x7fe574109df0 2024-09-21T06:09:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:09:57.288 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-21T06:09:55:553541+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T06:09:57.288 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-21T06:09:57.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5600b6590 msgr2=0x7fe5600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5600b6590 0x7fe5600b8aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe574077160 tx=0x7fe564005f90 comp rx=0 tx=0).stop 2024-09-21T06:09:57.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 msgr2=0x7fe574076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 0x7fe574076190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009fd0 tx=0x7fe56c00b260 comp rx=0 tx=0).stop 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 shutdown_connections 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5600b6590 0x7fe5600b8aa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe574109df0 0x7fe574076190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5741094a0 0x7fe574075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 --2- 172.21.15.17:0/3132846605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe574103b60 0x7fe574075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.289+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 >> 172.21.15.17:0/3132846605 conn(0x7fe57407b850 msgr2=0x7fe5741055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.290+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 shutdown_connections 2024-09-21T06:09:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:09:57.290+0000 7fe57a273640 1 -- 172.21.15.17:0/3132846605 wait complete. 2024-09-21T06:09:57.366 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 systemd[1]: Starting Ceph mds.i for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:57.657 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:57 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3132846605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:57.657 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 podman[62635]: 2024-09-21 06:09:57.300581573 +0000 UTC m=+0.016128962 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:09:57.657 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 podman[62635]: 2024-09-21 06:09:57.446092251 +0000 UTC m=+0.161639640 container create 7ce077b0c2ebb8a8473480c72d176a38e8ef6f7070dec0d17b4e1bfc71654f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:09:57.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:57 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3132846605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:58.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:57 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3132846605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:09:58.116 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 podman[62635]: 2024-09-21 06:09:57.6970452 +0000 UTC m=+0.412592596 container init 7ce077b0c2ebb8a8473480c72d176a38e8ef6f7070dec0d17b4e1bfc71654f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:09:58.116 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 podman[62635]: 2024-09-21 06:09:57.700485912 +0000 UTC m=+0.416033302 container start 7ce077b0c2ebb8a8473480c72d176a38e8ef6f7070dec0d17b4e1bfc71654f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:09:58.117 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 ceph-mds[62662]: -- 172.21.15.89:0/3386909142 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f548c3860 con 0x561f58a6b180 2024-09-21T06:09:58.117 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i[62652]: starting mds.i at 2024-09-21T06:09:58.117 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 bash[62635]: 7ce077b0c2ebb8a8473480c72d176a38e8ef6f7070dec0d17b4e1bfc71654f8f 2024-09-21T06:09:58.117 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:09:57 smithi089 systemd[1]: Started Ceph mds.i for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:09:58.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:58.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:58.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:58.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:58.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:58.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:58.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:58 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:58 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:09:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:09:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:09:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:09:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:58 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:59 smithi017 ceph-mon[31080]: Deploying daemon mds.g on smithi017 2024-09-21T06:09:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:59 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] up:boot 2024-09-21T06:09:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:59 smithi017 ceph-mon[31080]: fsmap 9 up:standby 2024-09-21T06:09:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:09:59 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:09:59.888 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:09:59 smithi017 systemd[1]: Starting Ceph mds.g for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:09:59.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:10:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:59 smithi081 ceph-mon[33870]: Deploying daemon mds.g on smithi017 2024-09-21T06:10:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:59 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] up:boot 2024-09-21T06:10:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:59 smithi081 ceph-mon[33870]: fsmap 9 up:standby 2024-09-21T06:10:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:09:59 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:10:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:59 smithi089 ceph-mon[33879]: Deploying daemon mds.g on smithi017 2024-09-21T06:10:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:59 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] up:boot 2024-09-21T06:10:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:59 smithi089 ceph-mon[33879]: fsmap 9 up:standby 2024-09-21T06:10:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:09:59 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:10:00.360 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 podman[72532]: 2024-09-21 06:09:59.977758111 +0000 UTC m=+0.017340598 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:10:00.360 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 podman[72532]: 2024-09-21 06:10:00.097185742 +0000 UTC m=+0.136768215 container create 12434fbd55d0a11ae776f96990bc84815fd1a65d89a3824b6f4d8718aa2837f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:10:00.360 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 podman[72532]: 2024-09-21 06:10:00.358636512 +0000 UTC m=+0.398218993 container init 12434fbd55d0a11ae776f96990bc84815fd1a65d89a3824b6f4d8718aa2837f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:10:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:00.622 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 podman[72532]: 2024-09-21 06:10:00.361865323 +0000 UTC m=+0.401447804 container start 12434fbd55d0a11ae776f96990bc84815fd1a65d89a3824b6f4d8718aa2837f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-21T06:10:00.622 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mds[72596]: -- 172.21.15.17:0/296838058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da5f3c5860 con 0x55da6356d600 2024-09-21T06:10:00.622 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g[72580]: starting mds.g at 2024-09-21T06:10:00.622 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 bash[72532]: 12434fbd55d0a11ae776f96990bc84815fd1a65d89a3824b6f4d8718aa2837f1 2024-09-21T06:10:00.622 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:10:00 smithi017 systemd[1]: Started Ceph mds.g for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:10:00.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:00.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: overall HEALTH_OK 2024-09-21T06:10:00.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:00.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:00.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:00.880 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:10:00.881 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:10:00.881 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:00 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.972+0000 7fd440e4b640 1 -- 172.21.15.17:0/2113756509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 msgr2=0x7fd43c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.972+0000 7fd440e4b640 1 --2- 172.21.15.17:0/2113756509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c110620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ca0 tx=0x7fd43402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 -- 172.21.15.17:0/2113756509 shutdown_connections 2024-09-21T06:10:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 --2- 172.21.15.17:0/2113756509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c110620 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 --2- 172.21.15.17:0/2113756509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd43c1094a0 0x7fd43c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 --2- 172.21.15.17:0/2113756509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c103b60 0x7fd43c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 -- 172.21.15.17:0/2113756509 >> 172.21.15.17:0/2113756509 conn(0x7fd43c07b850 msgr2=0x7fd43c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 -- 172.21.15.17:0/2113756509 shutdown_connections 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.973+0000 7fd440e4b640 1 -- 172.21.15.17:0/2113756509 wait complete. 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 Processor -- start 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 -- start start 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd43c103b60 0x7fd43c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c1094a0 0x7fd43c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1139b0 con 0x7fd43c109df0 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c113830 con 0x7fd43c1094a0 2024-09-21T06:10:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.974+0000 7fd440e4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c113b30 con 0x7fd43c103b60 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c19fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48442/0 (socket says 172.21.15.17:48442) 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 -- 172.21.15.17:0/3678929639 learned_addr learned my addr 172.21.15.17:0/3678929639 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd439d9b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c1094a0 0x7fd43c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43a59c640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd43c103b60 0x7fd43c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 -- 172.21.15.17:0/3678929639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd43c103b60 msgr2=0x7fd43c19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd43c103b60 0x7fd43c19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 -- 172.21.15.17:0/3678929639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c1094a0 msgr2=0x7fd43c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c1094a0 0x7fd43c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 -- 172.21.15.17:0/3678929639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c1a0230 con 0x7fd43c109df0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd43ad9d640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c19fbc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd434031040 tx=0x7fd434003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434032c90 con 0x7fd43c109df0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c1a04c0 con 0x7fd43c109df0 2024-09-21T06:10:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd434032e30 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.975+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434030a30 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.976+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c1a0a00 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.977+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c103f70 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.978+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd434030bd0 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.980+0000 7fd4337fe640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4280b6540 0x7fd4280b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.980+0000 7fd43a59c640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4280b6540 0x7fd4280b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.980+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fd434108190 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.980+0000 7fd43a59c640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4280b6540 0x7fd4280b8a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00abe0 tx=0x7fd42c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:00.983+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4340cee60 con 0x7fd43c109df0 2024-09-21T06:10:01.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: overall HEALTH_OK 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:10:01.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:00 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: overall HEALTH_OK 2024-09-21T06:10:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:01.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:01.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:10:01.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:10:01.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:00 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.216+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd43c10bc40 con 0x7fd43c109df0 2024-09-21T06:10:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.217+0000 7fd4337fe640 1 -- 172.21.15.17:0/3678929639 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8848 (secure 0 0 0) 0x7fd4340d3240 con 0x7fd43c109df0 2024-09-21T06:10:01.219 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:01.219 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"btime":"2024-09-21T06:10:00:639401+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:10:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4280b6540 msgr2=0x7fd4280b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4280b6540 0x7fd4280b8a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00abe0 tx=0x7fd42c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 msgr2=0x7fd43c19fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c19fbc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd434031040 tx=0x7fd434003f80 comp rx=0 tx=0).stop 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 shutdown_connections 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4280b6540 0x7fd4280b8a50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43c109df0 0x7fd43c19fbc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd43c1094a0 0x7fd43c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 --2- 172.21.15.17:0/3678929639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd43c103b60 0x7fd43c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 >> 172.21.15.17:0/3678929639 conn(0x7fd43c07b850 msgr2=0x7fd43c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 shutdown_connections 2024-09-21T06:10:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:01.219+0000 7fd440e4b640 1 -- 172.21.15.17:0/3678929639 wait complete. 2024-09-21T06:10:01.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:01 smithi017 ceph-mon[31080]: Deploying daemon mds.a on smithi017 2024-09-21T06:10:01.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:01 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.17:6838/4125758530,v1:172.21.15.17:6839/4125758530] up:boot 2024-09-21T06:10:01.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:01 smithi017 ceph-mon[31080]: fsmap 10 up:standby 2024-09-21T06:10:01.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:01 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:10:01.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3678929639' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:01 smithi081 ceph-mon[33870]: Deploying daemon mds.a on smithi017 2024-09-21T06:10:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:01 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.17:6838/4125758530,v1:172.21.15.17:6839/4125758530] up:boot 2024-09-21T06:10:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:01 smithi081 ceph-mon[33870]: fsmap 10 up:standby 2024-09-21T06:10:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:01 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:10:02.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3678929639' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:01 smithi089 ceph-mon[33879]: Deploying daemon mds.a on smithi017 2024-09-21T06:10:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:01 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.17:6838/4125758530,v1:172.21.15.17:6839/4125758530] up:boot 2024-09-21T06:10:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:01 smithi089 ceph-mon[33879]: fsmap 10 up:standby 2024-09-21T06:10:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:01 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:10:02.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3678929639' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:02.861 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:02 smithi017 ceph-mon[31080]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:02 smithi081 ceph-mon[33870]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:02 smithi089 ceph-mon[33879]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:03.575 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 systemd[1]: Starting Ceph mds.a for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:10:03.854 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 podman[72918]: 2024-09-21 06:10:03.47692582 +0000 UTC m=+0.016125561 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:10:03.854 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 podman[72918]: 2024-09-21 06:10:03.595790975 +0000 UTC m=+0.134990722 container create 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:10:03.854 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 podman[72918]: 2024-09-21 06:10:03.852602816 +0000 UTC m=+0.391802569 container init 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:10:03.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:10:04.137 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 podman[72918]: 2024-09-21 06:10:03.855732144 +0000 UTC m=+0.394931885 container start 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:10:04.137 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 ceph-mds[72936]: -- 172.21.15.17:0/2507062426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600af809860 con 0x5600b39b1a80 2024-09-21T06:10:04.137 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a[72932]: starting mds.a at 2024-09-21T06:10:04.137 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 bash[72918]: 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c 2024-09-21T06:10:04.137 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:10:03 smithi017 systemd[1]: Started Ceph mds.a for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:10:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:04.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 -- 172.21.15.17:0/3135363576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060108cf0 msgr2=0x7fb06010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 --2- 172.21.15.17:0/3135363576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060108cf0 0x7fb06010f520 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb058009ca0 tx=0x7fb05802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 -- 172.21.15.17:0/3135363576 shutdown_connections 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 --2- 172.21.15.17:0/3135363576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060108cf0 0x7fb06010f520 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 --2- 172.21.15.17:0/3135363576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0601083a0 0x7fb0601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 --2- 172.21.15.17:0/3135363576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb060102a60 0x7fb060102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 -- 172.21.15.17:0/3135363576 >> 172.21.15.17:0/3135363576 conn(0x7fb060079730 msgr2=0x7fb060079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 -- 172.21.15.17:0/3135363576 shutdown_connections 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.700+0000 7fb065e86640 1 -- 172.21.15.17:0/3135363576 wait complete. 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 Processor -- start 2024-09-21T06:10:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 -- start start 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 0x7fb06019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0601083a0 0x7fb06019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb060108cf0 0x7fb0601a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb060112860 con 0x7fb060102a60 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0601126e0 con 0x7fb060108cf0 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb065e86640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb0601129e0 con 0x7fb0601083a0 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb05f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 0x7fb06019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb05f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 0x7fb06019c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48482/0 (socket says 172.21.15.17:48482) 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.701+0000 7fb05f7fe640 1 -- 172.21.15.17:0/150234016 learned_addr learned my addr 172.21.15.17:0/150234016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:04.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05ffff640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb060108cf0 0x7fb0601a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05effd640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0601083a0 0x7fb06019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05f7fe640 1 -- 172.21.15.17:0/150234016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0601083a0 msgr2=0x7fb06019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05f7fe640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0601083a0 0x7fb06019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05f7fe640 1 -- 172.21.15.17:0/150234016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb060108cf0 msgr2=0x7fb0601a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05f7fe640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb060108cf0 0x7fb0601a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05f7fe640 1 -- 172.21.15.17:0/150234016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0601a2510 con 0x7fb060102a60 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05effd640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0601083a0 0x7fb06019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05f7fe640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 0x7fb06019c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb05000d950 tx=0x7fb05000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050017030 con 0x7fb060102a60 2024-09-21T06:10:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb050004020 con 0x7fb060102a60 2024-09-21T06:10:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500055d0 con 0x7fb060102a60 2024-09-21T06:10:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0601a2800 con 0x7fb060102a60 2024-09-21T06:10:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.702+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0601a8f60 con 0x7fb060102a60 2024-09-21T06:10:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.703+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb060102e70 con 0x7fb060102a60 2024-09-21T06:10:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.705+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb050009a30 con 0x7fb060102a60 2024-09-21T06:10:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.706+0000 7fb05cff9640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0480b6510 0x7fb0480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.706+0000 7fb05effd640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0480b6510 0x7fb0480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.706+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fb0500e6ed0 con 0x7fb060102a60 2024-09-21T06:10:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.707+0000 7fb05effd640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0480b6510 0x7fb0480b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb060079cd0 tx=0x7fb054005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.710+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0500adc00 con 0x7fb060102a60 2024-09-21T06:10:04.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:04.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:04.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:04.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:04.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:10:04.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:10:04.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:04 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:04.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.934+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb06019d6d0 con 0x7fb060102a60 2024-09-21T06:10:04.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.935+0000 7fb05cff9640 1 -- 172.21.15.17:0/150234016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9674 (secure 0 0 0) 0x7fb0500b1fe0 con 0x7fb060102a60 2024-09-21T06:10:04.937 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:04.937 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"btime":"2024-09-21T06:10:04:654714+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:10:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0480b6510 msgr2=0x7fb0480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0480b6510 0x7fb0480b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb060079cd0 tx=0x7fb054005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 msgr2=0x7fb06019c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 0x7fb06019c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb05000d950 tx=0x7fb05000de10 comp rx=0 tx=0).stop 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 shutdown_connections 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0480b6510 0x7fb0480b8a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb060108cf0 0x7fb0601a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0601083a0 0x7fb06019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 --2- 172.21.15.17:0/150234016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb060102a60 0x7fb06019c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 >> 172.21.15.17:0/150234016 conn(0x7fb060079730 msgr2=0x7fb06006b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 shutdown_connections 2024-09-21T06:10:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:04.937+0000 7fb065e86640 1 -- 172.21.15.17:0/150234016 wait complete. 2024-09-21T06:10:05.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:05.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:05.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:05.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:05.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:10:05.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:10:05.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:04 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:05.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:05.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:05.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:05.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:10:05.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:10:05.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:04 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:05.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:05 smithi081 ceph-mon[33870]: Deploying daemon mds.b on smithi081 2024-09-21T06:10:05.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:05 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.17:6840/3494298881,v1:172.21.15.17:6841/3494298881] up:boot 2024-09-21T06:10:05.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:05 smithi081 ceph-mon[33870]: fsmap 11 up:standby 2024-09-21T06:10:05.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:05 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:10:05.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:05 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/150234016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:06.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:05 smithi089 ceph-mon[33879]: Deploying daemon mds.b on smithi081 2024-09-21T06:10:06.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:05 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.17:6840/3494298881,v1:172.21.15.17:6841/3494298881] up:boot 2024-09-21T06:10:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:05 smithi089 ceph-mon[33879]: fsmap 11 up:standby 2024-09-21T06:10:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:05 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:10:06.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:05 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/150234016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:06.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:05 smithi017 ceph-mon[31080]: Deploying daemon mds.b on smithi081 2024-09-21T06:10:06.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:05 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.17:6840/3494298881,v1:172.21.15.17:6841/3494298881] up:boot 2024-09-21T06:10:06.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:05 smithi017 ceph-mon[31080]: fsmap 11 up:standby 2024-09-21T06:10:06.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:05 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:10:06.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:05 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/150234016' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:06.453 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 systemd[1]: Starting Ceph mds.b for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:10:06.742 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:06 smithi081 ceph-mon[33870]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:06.743 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 podman[61867]: 2024-09-21 06:10:06.354277556 +0000 UTC m=+0.016163626 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:10:06.743 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 podman[61867]: 2024-09-21 06:10:06.480324905 +0000 UTC m=+0.142210956 container create 680df72977827e1a98454c75d85553f4d1aa1b74060cc4e1e2d39b8362fe98a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:10:06.743 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 podman[61867]: 2024-09-21 06:10:06.741660433 +0000 UTC m=+0.403546503 container init 680df72977827e1a98454c75d85553f4d1aa1b74060cc4e1e2d39b8362fe98a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:10:06.933 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:06 smithi017 ceph-mon[31080]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:07.007 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 podman[61867]: 2024-09-21 06:10:06.744483063 +0000 UTC m=+0.406369122 container start 680df72977827e1a98454c75d85553f4d1aa1b74060cc4e1e2d39b8362fe98a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:10:07.007 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 ceph-mds[61886]: -- 172.21.15.81:0/1001231086 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bc0dcd860 con 0x559bc4f75180 2024-09-21T06:10:07.008 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: starting mds.b at 2024-09-21T06:10:07.008 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 bash[61867]: 680df72977827e1a98454c75d85553f4d1aa1b74060cc4e1e2d39b8362fe98a9 2024-09-21T06:10:07.008 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:06 smithi081 systemd[1]: Started Ceph mds.b for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:10:07.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:06 smithi089 ceph-mon[33879]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:07.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:10:07.894 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] up:boot 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: fsmap 12 up:standby 2024-09-21T06:10:07.895 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:07 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:10:08.073 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:08.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] up:boot 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: fsmap 12 up:standby 2024-09-21T06:10:08.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:07 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:10:08.195 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.195 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.195 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.195 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] up:boot 2024-09-21T06:10:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: fsmap 12 up:standby 2024-09-21T06:10:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:07 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:10:08.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 -- 172.21.15.17:0/3102726487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48581049b0 msgr2=0x7f4858104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3102726487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48581049b0 0x7f4858104dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4850009900 tx=0x7f485002a410 comp rx=0 tx=0).stop 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 -- 172.21.15.17:0/3102726487 shutdown_connections 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3102726487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485810de10 0x7f4858110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3102726487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4858105300 0x7f485810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3102726487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48581049b0 0x7f4858104dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 -- 172.21.15.17:0/3102726487 >> 172.21.15.17:0/3102726487 conn(0x7f4858079730 msgr2=0x7f4858079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 -- 172.21.15.17:0/3102726487 shutdown_connections 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.600+0000 7f485d0eb640 1 -- 172.21.15.17:0/3102726487 wait complete. 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.601+0000 7f485d0eb640 1 Processor -- start 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.601+0000 7f485d0eb640 1 -- start start 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485d0eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48581049b0 0x7f48581026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485d0eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 0x7f4858102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485d0eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485810de10 0x7f4858103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485d0eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4858113920 con 0x7f4858105300 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485d0eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48581137a0 con 0x7f485810de10 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485d0eb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4858113aa0 con 0x7f48581049b0 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 0x7f4858102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 0x7f4858102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35398/0 (socket says 172.21.15.17:35398) 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 -- 172.21.15.17:0/3992215700 learned_addr learned my addr 172.21.15.17:0/3992215700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f4856d9d640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48581049b0 0x7f48581026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485759e640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485810de10 0x7f4858103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 -- 172.21.15.17:0/3992215700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48581049b0 msgr2=0x7f48581026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48581049b0 0x7f48581026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 -- 172.21.15.17:0/3992215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485810de10 msgr2=0x7f4858103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485810de10 0x7f4858103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 -- 172.21.15.17:0/3992215700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48581a86b0 con 0x7f4858105300 2024-09-21T06:10:08.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f485659c640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 0x7f4858102c30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f484000d950 tx=0x7f484000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.602+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840017070 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.603+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4840009c30 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.603+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48581a89a0 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.603+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48400047a0 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.603+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48581a8eb0 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.604+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4858104dc0 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.605+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4840004020 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.606+0000 7f484ffff640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f48440b6510 0x7f48440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.606+0000 7f4856d9d640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f48440b6510 0x7f48440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.606+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f48400e6ff0 con 0x7f4858105300 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.607+0000 7f4856d9d640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f48440b6510 0x7f48440b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4850004770 tx=0x7f48500058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:08.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.610+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4840020020 con 0x7f4858105300 2024-09-21T06:10:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.859+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f485802e640 con 0x7f4858105300 2024-09-21T06:10:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.860+0000 7f484ffff640 1 -- 172.21.15.17:0/3992215700 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10494 (secure 0 0 0) 0x7f48400adca0 con 0x7f4858105300 2024-09-21T06:10:08.861 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:08.862 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"btime":"2024-09-21T06:10:07:668755+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24656,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T06:10:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f48440b6510 msgr2=0x7f48440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f48440b6510 0x7f48440b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4850004770 tx=0x7f48500058d0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 msgr2=0x7f4858102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 0x7f4858102c30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f484000d950 tx=0x7f484000de10 comp rx=0 tx=0).stop 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 shutdown_connections 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f48440b6510 0x7f48440b8a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4858105300 0x7f4858102c30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485810de10 0x7f4858103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 --2- 172.21.15.17:0/3992215700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48581049b0 0x7f48581026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.862+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 >> 172.21.15.17:0/3992215700 conn(0x7f4858079730 msgr2=0x7f48580ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.863+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 shutdown_connections 2024-09-21T06:10:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:08.863+0000 7f485d0eb640 1 -- 172.21.15.17:0/3992215700 wait complete. 2024-09-21T06:10:09.565 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.565 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.566 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.566 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.566 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3992215700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:09.566 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.566 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:09 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T06:10:09.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3992215700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:09.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:09 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3992215700' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:09.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:09 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:10.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 -- 172.21.15.17:0/2074601273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400109e40 msgr2=0x7f7400110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 --2- 172.21.15.17:0/2074601273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400109e40 0x7f7400110670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009ca0 tx=0x7f73f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 -- 172.21.15.17:0/2074601273 shutdown_connections 2024-09-21T06:10:10.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 --2- 172.21.15.17:0/2074601273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400109e40 0x7f7400110670 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 --2- 172.21.15.17:0/2074601273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74001094f0 0x7f7400109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 --2- 172.21.15.17:0/2074601273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7400103bb0 0x7f7400103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 -- 172.21.15.17:0/2074601273 >> 172.21.15.17:0/2074601273 conn(0x7f74000ff600 msgr2=0x7f7400101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:10.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 -- 172.21.15.17:0/2074601273 shutdown_connections 2024-09-21T06:10:10.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.360+0000 7f74076d8640 1 -- 172.21.15.17:0/2074601273 wait complete. 2024-09-21T06:10:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.361+0000 7f74076d8640 1 Processor -- start 2024-09-21T06:10:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.361+0000 7f74076d8640 1 -- start start 2024-09-21T06:10:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f74076d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 0x7f7400075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f74076d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001094f0 0x7f7400075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f74076d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7400109e40 0x7f7400076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f74076d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7400113a00 con 0x7f7400103bb0 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f74076d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7400113880 con 0x7f7400109e40 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f74076d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7400113b80 con 0x7f74001094f0 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 0x7f7400075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 0x7f7400075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35422/0 (socket says 172.21.15.17:35422) 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 -- 172.21.15.17:0/1573926369 learned_addr learned my addr 172.21.15.17:0/1573926369 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405c75640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7400109e40 0x7f7400076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7404c73640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001094f0 0x7f7400075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 -- 172.21.15.17:0/1573926369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001094f0 msgr2=0x7f7400075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001094f0 0x7f7400075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 -- 172.21.15.17:0/1573926369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7400109e40 msgr2=0x7f7400076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7400109e40 0x7f7400076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 -- 172.21.15.17:0/1573926369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74001a8690 con 0x7f7400103bb0 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405c75640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7400109e40 0x7f7400076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:10.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.362+0000 7f7405474640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 0x7f7400075710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00e9f0 tx=0x7f73fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:10.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.363+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00cd80 con 0x7f7400103bb0 2024-09-21T06:10:10.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.363+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74001a8980 con 0x7f7400103bb0 2024-09-21T06:10:10.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.363+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f73fc0054b0 con 0x7f7400103bb0 2024-09-21T06:10:10.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.363+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc010430 con 0x7f7400103bb0 2024-09-21T06:10:10.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.363+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74001a8ec0 con 0x7f7400103bb0 2024-09-21T06:10:10.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.365+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7400103fc0 con 0x7f7400103bb0 2024-09-21T06:10:10.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.365+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f73fc0046c0 con 0x7f7400103bb0 2024-09-21T06:10:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.366+0000 7f73f67fc640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f73ec0b6510 0x7f73ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.366+0000 7f7404c73640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f73ec0b6510 0x7f73ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.366+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f73fc0e71e0 con 0x7f7400103bb0 2024-09-21T06:10:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.367+0000 7f7404c73640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f73ec0b6510 0x7f73ec0b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7400106ed0 tx=0x7f73f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.371+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73fc0adf10 con 0x7f7400103bb0 2024-09-21T06:10:10.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.595+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f740010b6a0 con 0x7f7400103bb0 2024-09-21T06:10:10.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:10 smithi017 ceph-mon[31080]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:10.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:10.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:10.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:10.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:10 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:10.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.596+0000 7f73f67fc640 1 -- 172.21.15.17:0/1573926369 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f73fc0b22f0 con 0x7f7400103bb0 2024-09-21T06:10:10.598 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:10.598 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-21T06:10:10.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:10:10.598 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-21T06:10:10.598 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-21T06:10:10.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:10:10.599 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-21T06:10:10.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f73ec0b6510 msgr2=0x7f73ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f73ec0b6510 0x7f73ec0b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7400106ed0 tx=0x7f73f0005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 msgr2=0x7f7400075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 0x7f7400075710 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00e9f0 tx=0x7f73fc00edf0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 shutdown_connections 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f73ec0b6510 0x7f73ec0b8a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7400109e40 0x7f7400076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74001094f0 0x7f7400075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 --2- 172.21.15.17:0/1573926369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400103bb0 0x7f7400075710 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 >> 172.21.15.17:0/1573926369 conn(0x7f74000ff600 msgr2=0x7f7400101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 shutdown_connections 2024-09-21T06:10:10.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:10.598+0000 7f74076d8640 1 -- 172.21.15.17:0/1573926369 wait complete. 2024-09-21T06:10:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:10 smithi089 ceph-mon[33879]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:10.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:10 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:10 smithi081 ceph-mon[33870]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:10.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:10 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:11.526 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:10:11.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:10:11.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:11 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:11 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1573926369' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:10:11.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:11 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:11 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:11 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:11 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:11 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:11 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1573926369' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:10:11.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:11 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:11 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:11 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:11 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:11 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:11 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1573926369' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:10:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:11 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:11 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:11 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:11 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 -- 172.21.15.17:0/2909313405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da01094a0 msgr2=0x7f7da01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/2909313405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da01094a0 0x7f7da01098b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009900 tx=0x7f7d9402a410 comp rx=0 tx=0).stop 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 -- 172.21.15.17:0/2909313405 shutdown_connections 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/2909313405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da01094a0 0x7f7da01098b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/2909313405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da0109df0 0x7f7da0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/2909313405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da0103b60 0x7f7da0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 -- 172.21.15.17:0/2909313405 >> 172.21.15.17:0/2909313405 conn(0x7f7da007b850 msgr2=0x7f7da007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 -- 172.21.15.17:0/2909313405 shutdown_connections 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.470+0000 7f7da5bb9640 1 -- 172.21.15.17:0/2909313405 wait complete. 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.471+0000 7f7da5bb9640 1 Processor -- start 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.471+0000 7f7da5bb9640 1 -- start start 2024-09-21T06:10:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7da5bb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da0103b60 0x7f7da0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7da5bb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da01094a0 0x7f7da0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7da5bb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 0x7f7da0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7da5bb9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01139b0 con 0x7f7da0109df0 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7da5bb9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113830 con 0x7f7da0103b60 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7da5bb9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113b30 con 0x7f7da01094a0 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 0x7f7da0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 0x7f7da0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35442/0 (socket says 172.21.15.17:35442) 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 -- 172.21.15.17:0/1040537918 learned_addr learned my addr 172.21.15.17:0/1040537918 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9f7fe640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da0103b60 0x7f7da0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9effd640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da01094a0 0x7f7da0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 -- 172.21.15.17:0/1040537918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da01094a0 msgr2=0x7f7da0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da01094a0 0x7f7da0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 -- 172.21.15.17:0/1040537918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da0103b60 msgr2=0x7f7da0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da0103b60 0x7f7da0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 -- 172.21.15.17:0/1040537918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da01a8680 con 0x7f7da0109df0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9ffff640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 0x7f7da0076190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800eaa0 tx=0x7f7d9800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800cdb0 con 0x7f7da0109df0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d98005020 con 0x7f7da0109df0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.472+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d980116d0 con 0x7f7da0109df0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.473+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da01a8970 con 0x7f7da0109df0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.473+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01a8e30 con 0x7f7da0109df0 2024-09-21T06:10:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.474+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da0103f70 con 0x7f7da0109df0 2024-09-21T06:10:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.476+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7d980051d0 con 0x7f7da0109df0 2024-09-21T06:10:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.476+0000 7f7d9cff9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d880b6590 0x7f7d880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.477+0000 7f7d9f7fe640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d880b6590 0x7f7d880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.477+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f7d980e74c0 con 0x7f7da0109df0 2024-09-21T06:10:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.477+0000 7f7d9f7fe640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d880b6590 0x7f7d880b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7da0077160 tx=0x7f7d90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:12.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.480+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d98016030 con 0x7f7da0109df0 2024-09-21T06:10:12.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:12 smithi017 ceph-mon[31080]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:12.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:12.680+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7da0076a10 con 0x7f7da0109df0 2024-09-21T06:10:12.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:12 smithi081 ceph-mon[33870]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:12.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:12 smithi089 ceph-mon[33879]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.510+0000 7f7d9cff9640 1 -- 172.21.15.17:0/1040537918 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f7da0076a10 con 0x7f7da0109df0 2024-09-21T06:10:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.513+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d880b6590 msgr2=0x7f7d880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.513+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d880b6590 0x7f7d880b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7da0077160 tx=0x7f7d90005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.513+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 msgr2=0x7f7da0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.513+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 0x7f7da0076190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800eaa0 tx=0x7f7d9800ef60 comp rx=0 tx=0).stop 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 shutdown_connections 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d880b6590 0x7f7d880b8aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7da0109df0 0x7f7da0076190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7da01094a0 0x7f7da0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 --2- 172.21.15.17:0/1040537918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da0103b60 0x7f7da0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:13.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 >> 172.21.15.17:0/1040537918 conn(0x7f7da007b850 msgr2=0x7f7da0105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:13.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 shutdown_connections 2024-09-21T06:10:13.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:13.514+0000 7f7da5bb9640 1 -- 172.21.15.17:0/1040537918 wait complete. 2024-09-21T06:10:13.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:13 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1040537918' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:10:13.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:13 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:13 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:13 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:13.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:13 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:13.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:13 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:13 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1040537918' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:10:13.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:13 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:13 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:13 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:13.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:13 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:13.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:13 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:13 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1040537918' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:10:13.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:13.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:13.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:13.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:10:14.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T06:10:14.484 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:14.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:14 smithi089 ceph-mon[33879]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:14.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:14 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1040537918' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:10:14.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:14 smithi089 ceph-mon[33879]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:10:14.870 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:14 smithi017 ceph-mon[31080]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:14.870 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:14 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1040537918' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:10:14.871 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:14 smithi017 ceph-mon[31080]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:10:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 -- 172.21.15.17:0/986687522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc076100 msgr2=0x7f26cc10fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 --2- 172.21.15.17:0/986687522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc076100 0x7f26cc10fb90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009900 tx=0x7f26bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 -- 172.21.15.17:0/986687522 shutdown_connections 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 --2- 172.21.15.17:0/986687522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc076100 0x7f26cc10fb90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 --2- 172.21.15.17:0/986687522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26cc1100d0 0x7f26cc112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 --2- 172.21.15.17:0/986687522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc0757b0 0x7f26cc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 -- 172.21.15.17:0/986687522 >> 172.21.15.17:0/986687522 conn(0x7f26cc0ff5e0 msgr2=0x7f26cc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 -- 172.21.15.17:0/986687522 shutdown_connections 2024-09-21T06:10:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 -- 172.21.15.17:0/986687522 wait complete. 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.970+0000 7f26d3e57640 1 Processor -- start 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 -- start start 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 0x7f26cc19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc076100 0x7f26cc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26cc1100d0 0x7f26cc1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc115b30 con 0x7f26cc0757b0 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc1159b0 con 0x7f26cc1100d0 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d3e57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f26cc115cb0 con 0x7f26cc076100 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 0x7f26cc19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 0x7f26cc19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35448/0 (socket says 172.21.15.17:35448) 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 -- 172.21.15.17:0/3029188285 learned_addr learned my addr 172.21.15.17:0/3029188285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d13f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc076100 0x7f26cc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d23f4640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26cc1100d0 0x7f26cc1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 -- 172.21.15.17:0/3029188285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc076100 msgr2=0x7f26cc19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc076100 0x7f26cc19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 -- 172.21.15.17:0/3029188285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26cc1100d0 msgr2=0x7f26cc1a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26cc1100d0 0x7f26cc1a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d1bf3640 1 -- 172.21.15.17:0/3029188285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc1a25d0 con 0x7f26cc0757b0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.971+0000 7f26d13f2640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc076100 0x7f26cc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.972+0000 7f26d1bf3640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 0x7f26cc19c660 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f26c800e9f0 tx=0x7f26c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.972+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c800cd80 con 0x7f26cc0757b0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.972+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26c80054b0 con 0x7f26cc0757b0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.972+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc1a28c0 con 0x7f26cc0757b0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.972+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8010430 con 0x7f26cc0757b0 2024-09-21T06:10:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.972+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc1a9020 con 0x7f26cc0757b0 2024-09-21T06:10:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.973+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26cc075bc0 con 0x7f26cc0757b0 2024-09-21T06:10:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.975+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f26c80046c0 con 0x7f26cc0757b0 2024-09-21T06:10:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.975+0000 7f26c2ffd640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26b80b6590 0x7f26b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.975+0000 7f26d13f2640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26b80b6590 0x7f26b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.976+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7f26c80e7500 con 0x7f26cc0757b0 2024-09-21T06:10:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.976+0000 7f26d13f2640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26b80b6590 0x7f26b80b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26bc004770 tx=0x7f26bc0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:14.983+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26c8056710 con 0x7f26cc0757b0 2024-09-21T06:10:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:14 smithi081 ceph-mon[33870]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:14 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1040537918' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:10:15.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:14 smithi081 ceph-mon[33870]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:10:15.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.177+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f26cc19d790 con 0x7f26cc0757b0 2024-09-21T06:10:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-21T06:10:15.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.514+0000 7f26c2ffd640 1 -- 172.21.15.17:0/3029188285 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v72) ==== 171+0+0 (secure 0 0 0) 0x7f26c80ae0c0 con 0x7f26cc0757b0 2024-09-21T06:10:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26b80b6590 msgr2=0x7f26b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26b80b6590 0x7f26b80b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f26bc004770 tx=0x7f26bc0058d0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 msgr2=0x7f26cc19c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 0x7f26cc19c660 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f26c800e9f0 tx=0x7f26c800edf0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 shutdown_connections 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26b80b6590 0x7f26b80b8aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26cc1100d0 0x7f26cc1a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26cc076100 0x7f26cc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 --2- 172.21.15.17:0/3029188285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26cc0757b0 0x7f26cc19c660 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 >> 172.21.15.17:0/3029188285 conn(0x7f26cc0ff5e0 msgr2=0x7f26cc0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 shutdown_connections 2024-09-21T06:10:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:15.517+0000 7f26d3e57640 1 -- 172.21.15.17:0/3029188285 wait complete. 2024-09-21T06:10:15.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:15 smithi017 ceph-mon[31080]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:10:15.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:15 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3029188285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T06:10:15.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:15 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3029188285' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T06:10:15.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:15 smithi017 ceph-mon[31080]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:10:15.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:15 smithi089 ceph-mon[33879]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:10:15.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:15 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3029188285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T06:10:15.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:15 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3029188285' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T06:10:15.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:15 smithi089 ceph-mon[33879]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:10:16.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:15 smithi081 ceph-mon[33870]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:10:16.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:15 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3029188285' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T06:10:16.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:15 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3029188285' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T06:10:16.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:15 smithi081 ceph-mon[33870]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:10:16.211 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:10:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:16.537 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:16 smithi017 ceph-mon[31080]: pgmap v286: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:16.537 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:16 smithi017 ceph-mon[31080]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:10:16.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:16 smithi089 ceph-mon[33879]: pgmap v286: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:16.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:16 smithi089 ceph-mon[33879]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/1502349541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 msgr2=0x7ff8ac10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/1502349541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac10f550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009ca0 tx=0x7ff8a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/1502349541 shutdown_connections 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/1502349541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac10f550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/1502349541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1083d0 0x7ff8ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/1502349541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac102ae0 0x7ff8ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/1502349541 >> 172.21.15.17:0/1502349541 conn(0x7ff8ac079760 msgr2=0x7ff8ac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:16.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/1502349541 shutdown_connections 2024-09-21T06:10:16.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.965+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/1502349541 wait complete. 2024-09-21T06:10:16.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 Processor -- start 2024-09-21T06:10:16.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 -- start start 2024-09-21T06:10:16.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac102ae0 0x7ff8ac19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1083d0 0x7ff8ac19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac1139f0 con 0x7ff8ac108d20 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac113870 con 0x7ff8ac102ae0 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b2bd0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac113b70 con 0x7ff8ac1083d0 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35464/0 (socket says 172.21.15.17:35464) 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 -- 172.21.15.17:0/2526337104 learned_addr learned my addr 172.21.15.17:0/2526337104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8abfff640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1083d0 0x7ff8ac19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b096c640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac102ae0 0x7ff8ac19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 -- 172.21.15.17:0/2526337104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1083d0 msgr2=0x7ff8ac19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1083d0 0x7ff8ac19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 -- 172.21.15.17:0/2526337104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac102ae0 msgr2=0x7ff8ac19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.966+0000 7ff8b116d640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac102ae0 0x7ff8ac19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8b116d640 1 -- 172.21.15.17:0/2526337104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac1a03d0 con 0x7ff8ac108d20 2024-09-21T06:10:16.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8b116d640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac19fca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005cc0 tx=0x7ff8a4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4032e00 con 0x7ff8ac108d20 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8a40044d0 con 0x7ff8ac108d20 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac1a0660 con 0x7ff8ac108d20 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4030b70 con 0x7ff8ac108d20 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.967+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac1a6e20 con 0x7ff8ac108d20 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.968+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac103d10 con 0x7ff8ac108d20 2024-09-21T06:10:16.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.970+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff8a4030d10 con 0x7ff8ac108d20 2024-09-21T06:10:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.971+0000 7ff8a9ffb640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8940b6590 0x7ff8940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.971+0000 7ff8b096c640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8940b6590 0x7ff8940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:16.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.971+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7879+0+0 (secure 0 0 0) 0x7ff8a41084d0 con 0x7ff8ac108d20 2024-09-21T06:10:16.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.971+0000 7ff8b096c640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8940b6590 0x7ff8940b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00bbe0 tx=0x7ff89c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:16.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:16.974+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8a40cee70 con 0x7ff8ac108d20 2024-09-21T06:10:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:16 smithi081 ceph-mon[33870]: pgmap v286: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:16 smithi081 ceph-mon[33870]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:10:17.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.201+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff8ac102ef0 con 0x7ff8ac108d20 2024-09-21T06:10:17.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.542+0000 7ff8a9ffb640 1 -- 172.21.15.17:0/2526337104 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff8ac102ef0 con 0x7ff8ac108d20 2024-09-21T06:10:17.544 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8940b6590 msgr2=0x7ff8940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8940b6590 0x7ff8940b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00bbe0 tx=0x7ff89c00b390 comp rx=0 tx=0).stop 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 msgr2=0x7ff8ac19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac19fca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005cc0 tx=0x7ff8a4032a10 comp rx=0 tx=0).stop 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 shutdown_connections 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8940b6590 0x7ff8940b8aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8ac108d20 0x7ff8ac19fca0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8ac1083d0 0x7ff8ac19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 --2- 172.21.15.17:0/2526337104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8ac102ae0 0x7ff8ac19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:17.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 >> 172.21.15.17:0/2526337104 conn(0x7ff8ac079760 msgr2=0x7ff8ac1052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:17.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 shutdown_connections 2024-09-21T06:10:17.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:17.545+0000 7ff8b2bd0640 1 -- 172.21.15.17:0/2526337104 wait complete. 2024-09-21T06:10:17.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:17 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2526337104' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:10:17.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:17 smithi017 ceph-mon[31080]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:10:17.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:17 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2526337104' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:10:17.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:17 smithi089 ceph-mon[33879]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:10:18.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:17 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2526337104' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:10:18.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:17 smithi081 ceph-mon[33870]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:10:18.184 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T06:10:18.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T06:10:18.445 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:18.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:18 smithi017 ceph-mon[31080]: pgmap v289: 97 pgs: 13 creating+peering, 54 unknown, 30 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:18.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:18 smithi017 ceph-mon[31080]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:10:18.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:18 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2526337104' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:10:18.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:18 smithi017 ceph-mon[31080]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:10:18.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:18 smithi017 ceph-mon[31080]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:10:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:18 smithi089 ceph-mon[33879]: pgmap v289: 97 pgs: 13 creating+peering, 54 unknown, 30 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:18 smithi089 ceph-mon[33879]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:10:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:18 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2526337104' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:10:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:18 smithi089 ceph-mon[33879]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:10:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:18 smithi089 ceph-mon[33879]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:10:19.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 -- 172.21.15.17:0/243741949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 msgr2=0x7fb0f010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/243741949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f010f520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009900 tx=0x7fb0e802a410 comp rx=0 tx=0).stop 2024-09-21T06:10:19.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 -- 172.21.15.17:0/243741949 shutdown_connections 2024-09-21T06:10:19.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/243741949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f010f520 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/243741949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01083a0 0x7fb0f01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/243741949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f0102a60 0x7fb0f0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 -- 172.21.15.17:0/243741949 >> 172.21.15.17:0/243741949 conn(0x7fb0f0079730 msgr2=0x7fb0f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 -- 172.21.15.17:0/243741949 shutdown_connections 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.961+0000 7fb0f86cf640 1 -- 172.21.15.17:0/243741949 wait complete. 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 Processor -- start 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 -- start start 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f0102a60 0x7fb0f019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f01083a0 0x7fb0f019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0112810 con 0x7fb0f0108cf0 2024-09-21T06:10:19.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0112690 con 0x7fb0f0102a60 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f86cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0112990 con 0x7fb0f01083a0 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f019fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37424/0 (socket says 172.21.15.17:37424) 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 -- 172.21.15.17:0/754725656 learned_addr learned my addr 172.21.15.17:0/754725656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f646b640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f0102a60 0x7fb0f019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f5c6a640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f01083a0 0x7fb0f019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 -- 172.21.15.17:0/754725656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f01083a0 msgr2=0x7fb0f019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f01083a0 0x7fb0f019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 -- 172.21.15.17:0/754725656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f0102a60 msgr2=0x7fb0f019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f0102a60 0x7fb0f019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.962+0000 7fb0f6c6c640 1 -- 172.21.15.17:0/754725656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f01a01c0 con 0x7fb0f0108cf0 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0f646b640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f0102a60 0x7fb0f019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:19.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0f6c6c640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f019fb50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8005ab0 tx=0x7fb0e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e803f030 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f01a0450 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0e8003c90 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8035070 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.963+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f01a0930 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.964+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f0102e70 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.966+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb0e8042030 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.966+0000 7fb0ef7fe640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0d80b6540 0x7fb0d80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.967+0000 7fb0f646b640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0d80b6540 0x7fb0d80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.967+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fb0e8107c60 con 0x7fb0f0108cf0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.967+0000 7fb0f646b640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0d80b6540 0x7fb0d80b8a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0005c40 tx=0x7fb0e000a430 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:18.970+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0e80ce640 con 0x7fb0f0108cf0 2024-09-21T06:10:19.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:18 smithi081 ceph-mon[33870]: pgmap v289: 97 pgs: 13 creating+peering, 54 unknown, 30 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:19.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:18 smithi081 ceph-mon[33870]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:10:19.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:18 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2526337104' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:10:19.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:18 smithi081 ceph-mon[33870]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:10:19.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:18 smithi081 ceph-mon[33870]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:10:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.170+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fb0f019b440 con 0x7fb0f0108cf0 2024-09-21T06:10:19.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.554+0000 7fb0ef7fe640 1 -- 172.21.15.17:0/754725656 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v75) ==== 157+0+0 (secure 0 0 0) 0x7fb0f019b440 con 0x7fb0f0108cf0 2024-09-21T06:10:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.557+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0d80b6540 msgr2=0x7fb0d80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.557+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0d80b6540 0x7fb0d80b8a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0005c40 tx=0x7fb0e000a430 comp rx=0 tx=0).stop 2024-09-21T06:10:19.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.557+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 msgr2=0x7fb0f019fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.557+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f019fb50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8005ab0 tx=0x7fb0e80042f0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 shutdown_connections 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0d80b6540 0x7fb0d80b8a50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f0108cf0 0x7fb0f019fb50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0f01083a0 0x7fb0f019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 --2- 172.21.15.17:0/754725656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f0102a60 0x7fb0f019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 >> 172.21.15.17:0/754725656 conn(0x7fb0f0079730 msgr2=0x7fb0f006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 shutdown_connections 2024-09-21T06:10:19.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:19.558+0000 7fb0f86cf640 1 -- 172.21.15.17:0/754725656 wait complete. 2024-09-21T06:10:19.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:19 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] up:active 2024-09-21T06:10:19.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:19 smithi089 ceph-mon[33879]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:19.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:19 smithi089 ceph-mon[33879]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:19.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/754725656' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T06:10:19.877 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:19 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] up:active 2024-09-21T06:10:19.877 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:19 smithi017 ceph-mon[31080]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:19.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:19 smithi017 ceph-mon[31080]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:19.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/754725656' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T06:10:20.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:19 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] up:active 2024-09-21T06:10:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:19 smithi081 ceph-mon[33870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:19 smithi081 ceph-mon[33870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/754725656' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T06:10:20.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:10:20.526 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:20.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:20 smithi017 ceph-mon[31080]: pgmap v291: 97 pgs: 8 creating+peering, 14 unknown, 75 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-09-21T06:10:20.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:20 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/754725656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T06:10:20.813 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:20 smithi017 ceph-mon[31080]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:10:20.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:20 smithi089 ceph-mon[33879]: pgmap v291: 97 pgs: 8 creating+peering, 14 unknown, 75 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-09-21T06:10:20.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:20 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/754725656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T06:10:20.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:20 smithi089 ceph-mon[33879]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:10:21.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:20 smithi081 ceph-mon[33870]: pgmap v291: 97 pgs: 8 creating+peering, 14 unknown, 75 active+clean; 577 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-09-21T06:10:21.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:20 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/754725656' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T06:10:21.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:20 smithi081 ceph-mon[33870]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 -- 172.21.15.17:0/3296466963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26781084d0 msgr2=0x7f26781088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 --2- 172.21.15.17:0/3296466963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26781084d0 0x7f26781088e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f266c009900 tx=0x7f266c02a410 comp rx=0 tx=0).stop 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 -- 172.21.15.17:0/3296466963 shutdown_connections 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 --2- 172.21.15.17:0/3296466963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26781084d0 0x7f26781088e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 --2- 172.21.15.17:0/3296466963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678108e20 0x7f267810f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 --2- 172.21.15.17:0/3296466963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2678102a80 0x7f2678102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 -- 172.21.15.17:0/3296466963 >> 172.21.15.17:0/3296466963 conn(0x7f2678079720 msgr2=0x7f2678079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 -- 172.21.15.17:0/3296466963 shutdown_connections 2024-09-21T06:10:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.017+0000 7f267cb61640 1 -- 172.21.15.17:0/3296466963 wait complete. 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 Processor -- start 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 -- start start 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678102a80 0x7f26780ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26781084d0 0x7f26780ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 0x7f2678100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2678112990 con 0x7f2678108e20 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2678112810 con 0x7f26781084d0 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267cb61640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2678112b10 con 0x7f2678102a80 2024-09-21T06:10:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f2676d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 0x7f2678100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f2676d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 0x7f2678100110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37444/0 (socket says 172.21.15.17:37444) 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f2676d9d640 1 -- 172.21.15.17:0/3469547197 learned_addr learned my addr 172.21.15.17:0/3469547197 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f267659c640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678102a80 0x7f26780ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.018+0000 7f2675d9b640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26781084d0 0x7f26780ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f2676d9d640 1 -- 172.21.15.17:0/3469547197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678102a80 msgr2=0x7f26780ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f2676d9d640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678102a80 0x7f26780ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f2676d9d640 1 -- 172.21.15.17:0/3469547197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26781084d0 msgr2=0x7f26780ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f2676d9d640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26781084d0 0x7f26780ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f2676d9d640 1 -- 172.21.15.17:0/3469547197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781a8830 con 0x7f2678108e20 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f267659c640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678102a80 0x7f26780ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f2676d9d640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 0x7f2678100110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267000eaa0 tx=0x7f267000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267000cdb0 con 0x7f2678108e20 2024-09-21T06:10:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2670005020 con 0x7f2678108e20 2024-09-21T06:10:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26781a8b20 con 0x7f2678108e20 2024-09-21T06:10:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26700116d0 con 0x7f2678108e20 2024-09-21T06:10:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.019+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26781a9030 con 0x7f2678108e20 2024-09-21T06:10:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.020+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678103d00 con 0x7f2678108e20 2024-09-21T06:10:21.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.023+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f26700051d0 con 0x7f2678108e20 2024-09-21T06:10:21.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.023+0000 7f26677fe640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26600b6510 0x7f26600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:21.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.024+0000 7f267659c640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26600b6510 0x7f26600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:21.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.024+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8277+0+0 (secure 0 0 0) 0x7f26700e78d0 con 0x7f2678108e20 2024-09-21T06:10:21.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.024+0000 7f267659c640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26600b6510 0x7f26600b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f26781010e0 tx=0x7f2668005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:21.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.027+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2670016030 con 0x7f2678108e20 2024-09-21T06:10:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:21.217+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2678100990 con 0x7f2678108e20 2024-09-21T06:10:21.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:21 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3469547197' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:10:21.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:21 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3469547197' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:10:22.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:21 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3469547197' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:10:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.564+0000 7f26677fe640 1 -- 172.21.15.17:0/3469547197 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v77) ==== 228+0+0 (secure 0 0 0) 0x7f26700ae130 con 0x7f2678108e20 2024-09-21T06:10:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' created 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26600b6510 msgr2=0x7f26600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26600b6510 0x7f26600b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f26781010e0 tx=0x7f2668005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 msgr2=0x7f2678100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 0x7f2678100110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267000eaa0 tx=0x7f267000ef60 comp rx=0 tx=0).stop 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 shutdown_connections 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26600b6510 0x7f26600b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2678108e20 0x7f2678100110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26781084d0 0x7f26780ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 --2- 172.21.15.17:0/3469547197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2678102a80 0x7f26780ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 >> 172.21.15.17:0/3469547197 conn(0x7f2678079720 msgr2=0x7f267806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:22.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 shutdown_connections 2024-09-21T06:10:22.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:22.568+0000 7f267cb61640 1 -- 172.21.15.17:0/3469547197 wait complete. 2024-09-21T06:10:22.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:22 smithi089 ceph-mon[33879]: pgmap v293: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-21T06:10:22.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:22 smithi089 ceph-mon[33879]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:10:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:22 smithi017 ceph-mon[31080]: pgmap v293: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-21T06:10:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:22 smithi017 ceph-mon[31080]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:10:23.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:22 smithi081 ceph-mon[33870]: pgmap v293: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-21T06:10:23.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:22 smithi081 ceph-mon[33870]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:10:23.008 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:10:22 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: 2024-09-21T06:10:22.677+0000 7fa71b654640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:10:23.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T06:10:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:23.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:23 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3469547197' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:10:23.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:23 smithi017 ceph-mon[31080]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:10:23.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:23 smithi017 ceph-mon[31080]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:10:23.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:23 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3469547197' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:10:23.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:23 smithi089 ceph-mon[33879]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:10:23.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:23 smithi089 ceph-mon[33879]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:10:24.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:23 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3469547197' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:10:24.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:23 smithi081 ceph-mon[33870]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:10:24.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:23 smithi081 ceph-mon[33870]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 -- 172.21.15.17:0/1353861473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 msgr2=0x7fd998110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/1353861473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd998110620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd990009ca0 tx=0x7fd99002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 -- 172.21.15.17:0/1353861473 shutdown_connections 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/1353861473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd998110620 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/1353861473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9981094a0 0x7fd9981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/1353861473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd998103b60 0x7fd998103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 -- 172.21.15.17:0/1353861473 >> 172.21.15.17:0/1353861473 conn(0x7fd99807b850 msgr2=0x7fd99807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 -- 172.21.15.17:0/1353861473 shutdown_connections 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.064+0000 7fd99ea6c640 1 -- 172.21.15.17:0/1353861473 wait complete. 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 Processor -- start 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 -- start start 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd998103b60 0x7fd99819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9981094a0 0x7fd99819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd99819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9981139b0 con 0x7fd998109df0 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd998113830 con 0x7fd9981094a0 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99ea6c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd998113b30 con 0x7fd998103b60 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.065+0000 7fd99d009640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd99819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd99819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37470/0 (socket says 172.21.15.17:37470) 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 -- 172.21.15.17:0/5146741 learned_addr learned my addr 172.21.15.17:0/5146741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99c808640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd998103b60 0x7fd99819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd997fff640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9981094a0 0x7fd99819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 -- 172.21.15.17:0/5146741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd998103b60 msgr2=0x7fd99819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd998103b60 0x7fd99819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 -- 172.21.15.17:0/5146741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9981094a0 msgr2=0x7fd99819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9981094a0 0x7fd99819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 -- 172.21.15.17:0/5146741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9981a0230 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd997fff640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9981094a0 0x7fd99819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99d009640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd99819fbc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd990005cc0 tx=0x7fd990032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990032e00 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9900044d0 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9981a04c0 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.066+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990030b70 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.067+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9981a6d40 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.068+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd998103f70 con 0x7fd998109df0 2024-09-21T06:10:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.070+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd990030d10 con 0x7fd998109df0 2024-09-21T06:10:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.071+0000 7fd995ffb640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9800b65c0 0x7fd9800b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.071+0000 7fd99c808640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9800b65c0 0x7fd9800b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.071+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8770+0+0 (secure 0 0 0) 0x7fd990108890 con 0x7fd998109df0 2024-09-21T06:10:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.072+0000 7fd99c808640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9800b65c0 0x7fd9800b8ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd98800abe0 tx=0x7fd98800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.075+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9900cef00 con 0x7fd998109df0 2024-09-21T06:10:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.263+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fd99819b4b0 con 0x7fd998109df0 2024-09-21T06:10:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.582+0000 7fd995ffb640 1 -- 172.21.15.17:0/5146741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v79) ==== 169+0+0 (secure 0 0 0) 0x7fd99819b4b0 con 0x7fd998109df0 2024-09-21T06:10:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T06:10:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9800b65c0 msgr2=0x7fd9800b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9800b65c0 0x7fd9800b8ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd98800abe0 tx=0x7fd98800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 msgr2=0x7fd99819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd99819fbc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd990005cc0 tx=0x7fd990032a10 comp rx=0 tx=0).stop 2024-09-21T06:10:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 shutdown_connections 2024-09-21T06:10:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9800b65c0 0x7fd9800b8ad0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd998109df0 0x7fd99819fbc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9981094a0 0x7fd99819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 --2- 172.21.15.17:0/5146741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd998103b60 0x7fd99819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.586+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 >> 172.21.15.17:0/5146741 conn(0x7fd99807b850 msgr2=0x7fd998107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.587+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 shutdown_connections 2024-09-21T06:10:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:24.587+0000 7fd99ea6c640 1 -- 172.21.15.17:0/5146741 wait complete. 2024-09-21T06:10:24.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:24 smithi089 ceph-mon[33879]: pgmap v296: 129 pgs: 1 creating+peering, 31 unknown, 97 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-21T06:10:24.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:24 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/5146741' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T06:10:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:24 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/5146741' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T06:10:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:24 smithi089 ceph-mon[33879]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:10:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:24 smithi017 ceph-mon[31080]: pgmap v296: 129 pgs: 1 creating+peering, 31 unknown, 97 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-21T06:10:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:24 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/5146741' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T06:10:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:24 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/5146741' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T06:10:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:24 smithi017 ceph-mon[31080]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:10:25.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:24 smithi081 ceph-mon[33870]: pgmap v296: 129 pgs: 1 creating+peering, 31 unknown, 97 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-21T06:10:25.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:24 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/5146741' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T06:10:25.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:24 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/5146741' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T06:10:25.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:24 smithi081 ceph-mon[33870]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:10:25.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T06:10:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 -- 172.21.15.17:0/729122113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 msgr2=0x7f621c10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 --2- 172.21.15.17:0/729122113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c10f530 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6214009ca0 tx=0x7f621402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 -- 172.21.15.17:0/729122113 shutdown_connections 2024-09-21T06:10:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 --2- 172.21.15.17:0/729122113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c10f530 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 --2- 172.21.15.17:0/729122113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 0x7f621c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 --2- 172.21.15.17:0/729122113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102a70 0x7f621c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 -- 172.21.15.17:0/729122113 >> 172.21.15.17:0/729122113 conn(0x7f621c079710 msgr2=0x7f621c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 -- 172.21.15.17:0/729122113 shutdown_connections 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 -- 172.21.15.17:0/729122113 wait complete. 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.074+0000 7f6224627640 1 Processor -- start 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 -- start start 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102a70 0x7f621c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 0x7f621c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1128c0 con 0x7f621c108d00 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f621c112740 con 0x7f621c102a70 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6224627640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f621c112a40 con 0x7f621c1083b0 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37490/0 (socket says 172.21.15.17:37490) 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 -- 172.21.15.17:0/2818444572 learned_addr learned my addr 172.21.15.17:0/2818444572 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f62223c3640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102a70 0x7f621c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6221bc2640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 0x7f621c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 -- 172.21.15.17:0/2818444572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 msgr2=0x7f621c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 0x7f621c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 -- 172.21.15.17:0/2818444572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102a70 msgr2=0x7f621c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102a70 0x7f621c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 -- 172.21.15.17:0/2818444572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c19f280 con 0x7f621c108d00 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6221bc2640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 0x7f621c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.075+0000 7f6222bc4640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c19eb50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6214005cc0 tx=0x7f6214032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.076+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214032e00 con 0x7f621c108d00 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.076+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62140044d0 con 0x7f621c108d00 2024-09-21T06:10:26.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.076+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c19f510 con 0x7f621c108d00 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.076+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214030b70 con 0x7f621c108d00 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.076+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1a5cd0 con 0x7f621c108d00 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.077+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c103cf0 con 0x7f621c108d00 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.078+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6214030d10 con 0x7f621c108d00 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.079+0000 7f62137fe640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f62080b6590 0x7f62080b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.079+0000 7f62223c3640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f62080b6590 0x7f62080b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.079+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8770+0+0 (secure 0 0 0) 0x7f62141088c0 con 0x7f621c108d00 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.080+0000 7f62223c3640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f62080b6590 0x7f62080b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6218005d00 tx=0x7f621800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:26.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.082+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62140cef30 con 0x7f621c108d00 2024-09-21T06:10:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.315+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f621c102e80 con 0x7f621c108d00 2024-09-21T06:10:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.596+0000 7f62137fe640 1 -- 172.21.15.17:0/2818444572 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f621c102e80 con 0x7f621c108d00 2024-09-21T06:10:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:added data pool 4 to fsmap 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f62080b6590 msgr2=0x7f62080b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f62080b6590 0x7f62080b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6218005d00 tx=0x7f621800b410 comp rx=0 tx=0).stop 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 msgr2=0x7f621c19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c19eb50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6214005cc0 tx=0x7f6214032a10 comp rx=0 tx=0).stop 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 shutdown_connections 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f62080b6590 0x7f62080b8aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f621c108d00 0x7f621c19eb50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f621c1083b0 0x7f621c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 --2- 172.21.15.17:0/2818444572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c102a70 0x7f621c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 >> 172.21.15.17:0/2818444572 conn(0x7f621c079710 msgr2=0x7f621c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:26.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 shutdown_connections 2024-09-21T06:10:26.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:26.599+0000 7f6224627640 1 -- 172.21.15.17:0/2818444572 wait complete. 2024-09-21T06:10:26.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:26 smithi089 ceph-mon[33879]: pgmap v299: 129 pgs: 1 creating+activating, 4 creating+peering, 19 unknown, 105 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 6 op/s 2024-09-21T06:10:26.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:26 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2818444572' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T06:10:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:26 smithi017 ceph-mon[31080]: pgmap v299: 129 pgs: 1 creating+activating, 4 creating+peering, 19 unknown, 105 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 6 op/s 2024-09-21T06:10:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:26 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2818444572' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T06:10:27.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:26 smithi081 ceph-mon[33870]: pgmap v299: 129 pgs: 1 creating+activating, 4 creating+peering, 19 unknown, 105 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 6 op/s 2024-09-21T06:10:27.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:26 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2818444572' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T06:10:27.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:10:27.496 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:27.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:27 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2818444572' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T06:10:27.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:27 smithi017 ceph-mon[31080]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:10:27.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:27 smithi017 ceph-mon[31080]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:27.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:27 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2818444572' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T06:10:27.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:27 smithi089 ceph-mon[33879]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:10:27.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:27 smithi089 ceph-mon[33879]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 -- 172.21.15.17:0/3137946024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 msgr2=0x7f4c1410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 --2- 172.21.15.17:0/3137946024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1410f560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009ca0 tx=0x7f4c0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 -- 172.21.15.17:0/3137946024 shutdown_connections 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 --2- 172.21.15.17:0/3137946024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1410f560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 --2- 172.21.15.17:0/3137946024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141083e0 0x7f4c141087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 --2- 172.21.15.17:0/3137946024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c14102aa0 0x7f4c14102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 -- 172.21.15.17:0/3137946024 >> 172.21.15.17:0/3137946024 conn(0x7f4c14079750 msgr2=0x7f4c14079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 -- 172.21.15.17:0/3137946024 shutdown_connections 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.955+0000 7f4c18e49640 1 -- 172.21.15.17:0/3137946024 wait complete. 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 Processor -- start 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 -- start start 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c14102aa0 0x7f4c14199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141083e0 0x7f4c141998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14112950 con 0x7f4c14108d30 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c141127d0 con 0x7f4c141083e0 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c18e49640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4c14112ad0 con 0x7f4c14102aa0 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c12d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c12d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37508/0 (socket says 172.21.15.17:37508) 2024-09-21T06:10:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.956+0000 7f4c12d9d640 1 -- 172.21.15.17:0/918864457 learned_addr learned my addr 172.21.15.17:0/918864457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c11d9b640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141083e0 0x7f4c141998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c1259c640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c14102aa0 0x7f4c14199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c12d9d640 1 -- 172.21.15.17:0/918864457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c14102aa0 msgr2=0x7f4c14199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c12d9d640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c14102aa0 0x7f4c14199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c12d9d640 1 -- 172.21.15.17:0/918864457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141083e0 msgr2=0x7f4c141998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c12d9d640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141083e0 0x7f4c141998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c12d9d640 1 -- 172.21.15.17:0/918864457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1419f1d0 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c12d9d640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1419eb60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c031040 tx=0x7f4c0c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c004040 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c004670 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1419f460 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c030c50 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.957+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1419f9a0 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.958+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c14102eb0 con 0x7f4c14108d30 2024-09-21T06:10:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.960+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4c0c0041e0 con 0x7f4c14108d30 2024-09-21T06:10:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.961+0000 7f4c037fe640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4bfc0b6540 0x7f4bfc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.961+0000 7f4c1259c640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4bfc0b6540 0x7f4bfc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.961+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f4c0c108af0 con 0x7f4c14108d30 2024-09-21T06:10:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.961+0000 7f4c1259c640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4bfc0b6540 0x7f4bfc0b8a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009890 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:27.964+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c0c0cf0e0 con 0x7f4c14108d30 2024-09-21T06:10:28.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:27 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2818444572' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T06:10:28.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:27 smithi081 ceph-mon[33870]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:10:28.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:27 smithi081 ceph-mon[33870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.192+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c1419a450 con 0x7f4c14108d30 2024-09-21T06:10:28.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.193+0000 7f4c037fe640 1 -- 172.21.15.17:0/918864457 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11812 (secure 0 0 0) 0x7f4c1419a450 con 0x7f4c14108d30 2024-09-21T06:10:28.194 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:28.195 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"btime":"2024-09-21T06:10:26:595086+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:10:26.317180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24656,"qdb_cluster":[24656]},"id":1}]} 2024-09-21T06:10:28.195 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4bfc0b6540 msgr2=0x7f4bfc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4bfc0b6540 0x7f4bfc0b8a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009890 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 msgr2=0x7f4c1419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1419eb60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c031040 tx=0x7f4c0c032bc0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 shutdown_connections 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4bfc0b6540 0x7f4bfc0b8a50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c14108d30 0x7f4c1419eb60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c141083e0 0x7f4c141998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 --2- 172.21.15.17:0/918864457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c14102aa0 0x7f4c14199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:28.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 >> 172.21.15.17:0/918864457 conn(0x7f4c14079750 msgr2=0x7f4c14106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:28.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 shutdown_connections 2024-09-21T06:10:28.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:28.195+0000 7f4c18e49640 1 -- 172.21.15.17:0/918864457 wait complete. 2024-09-21T06:10:28.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:28 smithi089 ceph-mon[33879]: pgmap v301: 129 pgs: 1 creating+activating, 4 creating+peering, 124 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:28.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:28 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/918864457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:28.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:28 smithi017 ceph-mon[31080]: pgmap v301: 129 pgs: 1 creating+activating, 4 creating+peering, 124 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:28.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:28 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/918864457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:28.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:10:28.909 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:28 smithi081 ceph-mon[33870]: pgmap v301: 129 pgs: 1 creating+activating, 4 creating+peering, 124 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:28.909 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:28 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/918864457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:29.135 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 -- 172.21.15.17:0/3853583468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1801094a0 msgr2=0x7fa1801098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 --2- 172.21.15.17:0/3853583468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1801094a0 0x7fa1801098b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa168009900 tx=0x7fa16802a410 comp rx=0 tx=0).stop 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 -- 172.21.15.17:0/3853583468 shutdown_connections 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 --2- 172.21.15.17:0/3853583468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1801094a0 0x7fa1801098b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 --2- 172.21.15.17:0/3853583468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa180109df0 0x7fa180110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 --2- 172.21.15.17:0/3853583468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa180103b60 0x7fa180103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.600+0000 7fa185793640 1 -- 172.21.15.17:0/3853583468 >> 172.21.15.17:0/3853583468 conn(0x7fa18007b850 msgr2=0x7fa18007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.601+0000 7fa185793640 1 -- 172.21.15.17:0/3853583468 shutdown_connections 2024-09-21T06:10:29.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.601+0000 7fa185793640 1 -- 172.21.15.17:0/3853583468 wait complete. 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.601+0000 7fa185793640 1 Processor -- start 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.601+0000 7fa185793640 1 -- start start 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa185793640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 0x7fa18019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa185793640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1801094a0 0x7fa18019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa185793640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa180109df0 0x7fa18019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa185793640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa180113960 con 0x7fa180103b60 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa185793640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801137e0 con 0x7fa1801094a0 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa185793640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa180113ae0 con 0x7fa180109df0 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 0x7fa18019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 0x7fa18019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41556/0 (socket says 172.21.15.17:41556) 2024-09-21T06:10:29.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 -- 172.21.15.17:0/1833754244 learned_addr learned my addr 172.21.15.17:0/1833754244 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17f7fe640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa180109df0 0x7fa18019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17e7fc640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1801094a0 0x7fa18019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 -- 172.21.15.17:0/1833754244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa180109df0 msgr2=0x7fa18019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa180109df0 0x7fa18019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 -- 172.21.15.17:0/1833754244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1801094a0 msgr2=0x7fa18019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1801094a0 0x7fa18019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 -- 172.21.15.17:0/1833754244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1801a0380 con 0x7fa180103b60 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.602+0000 7fa17effd640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 0x7fa18019a410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa17000db80 tx=0x7fa17000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.603+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170017070 con 0x7fa180103b60 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.603+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1801a0670 con 0x7fa180103b60 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.603+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa170004020 con 0x7fa180103b60 2024-09-21T06:10:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.603+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17000be60 con 0x7fa180103b60 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.603+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1801a6dd0 con 0x7fa180103b60 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.604+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa180103f70 con 0x7fa180103b60 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.605+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa170003b70 con 0x7fa180103b60 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.606+0000 7fa177fff640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa16c0b6510 0x7fa16c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.606+0000 7fa17e7fc640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa16c0b6510 0x7fa16c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.606+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fa1700e7630 con 0x7fa180103b60 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.607+0000 7fa17e7fc640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa16c0b6510 0x7fa16c0b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa168005940 tx=0x7fa1680058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.610+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa170020070 con 0x7fa180103b60 2024-09-21T06:10:29.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.798+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa18010bc40 con 0x7fa180103b60 2024-09-21T06:10:29.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.799+0000 7fa177fff640 1 -- 172.21.15.17:0/1833754244 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24154 (secure 0 0 0) 0x7fa1700adc80 con 0x7fa180103b60 2024-09-21T06:10:29.802 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:29.802 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:26.317022+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa16c0b6510 msgr2=0x7fa16c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa16c0b6510 0x7fa16c0b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa168005940 tx=0x7fa1680058d0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 msgr2=0x7fa18019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 0x7fa18019a410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa17000db80 tx=0x7fa17000b630 comp rx=0 tx=0).stop 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 shutdown_connections 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa16c0b6510 0x7fa16c0b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa180109df0 0x7fa18019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1801094a0 0x7fa18019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 --2- 172.21.15.17:0/1833754244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa180103b60 0x7fa18019a410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 >> 172.21.15.17:0/1833754244 conn(0x7fa18007b850 msgr2=0x7fa1801075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 shutdown_connections 2024-09-21T06:10:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:29.802+0000 7fa185793640 1 -- 172.21.15.17:0/1833754244 wait complete. 2024-09-21T06:10:30.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:10:30.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:30 smithi089 ceph-mon[33879]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:30.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:30 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1833754244' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:30 smithi017 ceph-mon[31080]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:30 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1833754244' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:31.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:30 smithi081 ceph-mon[33870]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:31.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1833754244' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:31.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1169614794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc1094a0 msgr2=0x7fd7bc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1169614794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc1094a0 0x7fd7bc1098b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009900 tx=0x7fd7b002a410 comp rx=0 tx=0).stop 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1169614794 shutdown_connections 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1169614794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc1094a0 0x7fd7bc1098b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1169614794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc109df0 0x7fd7bc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1169614794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7bc103b60 0x7fd7bc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1169614794 >> 172.21.15.17:0/1169614794 conn(0x7fd7bc07b850 msgr2=0x7fd7bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1169614794 shutdown_connections 2024-09-21T06:10:31.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.360+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1169614794 wait complete. 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 Processor -- start 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 -- start start 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7bc103b60 0x7fd7bc19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc1094a0 0x7fd7bc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 0x7fd7bc19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc113960 con 0x7fd7bc109df0 2024-09-21T06:10:31.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc1137e0 con 0x7fd7bc1094a0 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7c1e8c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc113ae0 con 0x7fd7bc103b60 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 0x7fd7bc19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 0x7fd7bc19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41574/0 (socket says 172.21.15.17:41574) 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7bbfff640 1 -- 172.21.15.17:0/1569414300 learned_addr learned my addr 172.21.15.17:0/1569414300 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7bb7fe640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7bc103b60 0x7fd7bc19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.361+0000 7fd7baffd640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc1094a0 0x7fd7bc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7bbfff640 1 -- 172.21.15.17:0/1569414300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7bc103b60 msgr2=0x7fd7bc19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7bbfff640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7bc103b60 0x7fd7bc19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7bbfff640 1 -- 172.21.15.17:0/1569414300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc1094a0 msgr2=0x7fd7bc19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7bbfff640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc1094a0 0x7fd7bc19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7bbfff640 1 -- 172.21.15.17:0/1569414300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc1a0360 con 0x7fd7bc109df0 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7bbfff640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 0x7fd7bc19fc30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400eb10 tx=0x7fd7b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4004b20 con 0x7fd7bc109df0 2024-09-21T06:10:31.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7b4004cc0 con 0x7fd7bc109df0 2024-09-21T06:10:31.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7bc1a0650 con 0x7fd7bc109df0 2024-09-21T06:10:31.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4010690 con 0x7fd7bc109df0 2024-09-21T06:10:31.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.362+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7bc1a6db0 con 0x7fd7bc109df0 2024-09-21T06:10:31.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.363+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7bc103f70 con 0x7fd7bc109df0 2024-09-21T06:10:31.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.365+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd7b4005000 con 0x7fd7bc109df0 2024-09-21T06:10:31.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.366+0000 7fd7b8ff9640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7a40b6510 0x7fd7a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:31.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.366+0000 7fd7bb7fe640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7a40b6510 0x7fd7a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:31.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.366+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fd7b40e7c80 con 0x7fd7bc109df0 2024-09-21T06:10:31.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.366+0000 7fd7bb7fe640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7a40b6510 0x7fd7a40b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac005fd0 tx=0x7fd7ac00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:31.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.369+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7b4056710 con 0x7fd7bc109df0 2024-09-21T06:10:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.557+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7bc19b520 con 0x7fd7bc109df0 2024-09-21T06:10:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.559+0000 7fd7b8ff9640 1 -- 172.21.15.17:0/1569414300 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24154 (secure 0 0 0) 0x7fd7bc19b520 con 0x7fd7bc109df0 2024-09-21T06:10:31.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:31.561 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:26.317022+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:31.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.561+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7a40b6510 msgr2=0x7fd7a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.561+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7a40b6510 0x7fd7a40b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac005fd0 tx=0x7fd7ac00b390 comp rx=0 tx=0).stop 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.561+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 msgr2=0x7fd7bc19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.561+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 0x7fd7bc19fc30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400eb10 tx=0x7fd7b400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 shutdown_connections 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7a40b6510 0x7fd7a40b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7bc109df0 0x7fd7bc19fc30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7bc1094a0 0x7fd7bc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 --2- 172.21.15.17:0/1569414300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7bc103b60 0x7fd7bc19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 >> 172.21.15.17:0/1569414300 conn(0x7fd7bc07b850 msgr2=0x7fd7bc105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 shutdown_connections 2024-09-21T06:10:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:31.562+0000 7fd7c1e8c640 1 -- 172.21.15.17:0/1569414300 wait complete. 2024-09-21T06:10:31.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:31 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1569414300' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:32.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:31 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1569414300' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:32.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:31 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1569414300' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:32.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:10:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:32.802 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:32 smithi017 ceph-mon[31080]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:33.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:32 smithi081 ceph-mon[33870]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:33.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:32 smithi089 ceph-mon[33879]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 -- 172.21.15.17:0/2991507040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 msgr2=0x7fae7c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2991507040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c10f520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fae74009ca0 tx=0x7fae7402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 -- 172.21.15.17:0/2991507040 shutdown_connections 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2991507040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c10f520 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2991507040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7c1083a0 0x7fae7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2991507040 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae7c102a60 0x7fae7c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 -- 172.21.15.17:0/2991507040 >> 172.21.15.17:0/2991507040 conn(0x7fae7c079730 msgr2=0x7fae7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 -- 172.21.15.17:0/2991507040 shutdown_connections 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.151+0000 7fae82a2e640 1 -- 172.21.15.17:0/2991507040 wait complete. 2024-09-21T06:10:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 Processor -- start 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 -- start start 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7c102a60 0x7fae7c19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae7c1083a0 0x7fae7c19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c112860 con 0x7fae7c108cf0 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c1126e0 con 0x7fae7c102a60 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae82a2e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c1129e0 con 0x7fae7c1083a0 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae80fcb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae80fcb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c19bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41582/0 (socket says 172.21.15.17:41582) 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.152+0000 7fae80fcb640 1 -- 172.21.15.17:0/2736491648 learned_addr learned my addr 172.21.15.17:0/2736491648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae73fff640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae7c1083a0 0x7fae7c19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae7bfff640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7c102a60 0x7fae7c19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae80fcb640 1 -- 172.21.15.17:0/2736491648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae7c1083a0 msgr2=0x7fae7c19b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae80fcb640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae7c1083a0 0x7fae7c19b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae80fcb640 1 -- 172.21.15.17:0/2736491648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7c102a60 msgr2=0x7fae7c19b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae80fcb640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7c102a60 0x7fae7c19b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae80fcb640 1 -- 172.21.15.17:0/2736491648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c1a63c0 con 0x7fae7c108cf0 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae80fcb640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c19bbb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae74005cc0 tx=0x7fae74032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74032e00 con 0x7fae7c108cf0 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae740044d0 con 0x7fae7c108cf0 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c1a6650 con 0x7fae7c108cf0 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74030b70 con 0x7fae7c108cf0 2024-09-21T06:10:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.153+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7c1a6b90 con 0x7fae7c108cf0 2024-09-21T06:10:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.154+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7c102e70 con 0x7fae7c108cf0 2024-09-21T06:10:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.156+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fae74004680 con 0x7fae7c108cf0 2024-09-21T06:10:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.157+0000 7fae79ffb640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fae680b6540 0x7fae680b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.157+0000 7fae7bfff640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fae680b6540 0x7fae680b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.157+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fae74108750 con 0x7fae7c108cf0 2024-09-21T06:10:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.157+0000 7fae7bfff640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fae680b6540 0x7fae680b8a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae6c005fd0 tx=0x7fae6c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:33.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.161+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae740ceda0 con 0x7fae7c108cf0 2024-09-21T06:10:33.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.391+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae7c10a530 con 0x7fae7c108cf0 2024-09-21T06:10:33.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.391+0000 7fae79ffb640 1 -- 172.21.15.17:0/2736491648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11812 (secure 0 0 0) 0x7fae740d3180 con 0x7fae7c108cf0 2024-09-21T06:10:33.393 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:33.393 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"btime":"2024-09-21T06:10:26:595086+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24649,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:10:26.317180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24656,"qdb_cluster":[24656]},"id":1}]} 2024-09-21T06:10:33.394 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.393+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fae680b6540 msgr2=0x7fae680b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.393+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fae680b6540 0x7fae680b8a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae6c005fd0 tx=0x7fae6c005850 comp rx=0 tx=0).stop 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.393+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 msgr2=0x7fae7c19bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.393+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c19bbb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae74005cc0 tx=0x7fae74032a10 comp rx=0 tx=0).stop 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 shutdown_connections 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fae680b6540 0x7fae680b8a50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c108cf0 0x7fae7c19bbb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae7c1083a0 0x7fae7c19b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 --2- 172.21.15.17:0/2736491648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae7c102a60 0x7fae7c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 >> 172.21.15.17:0/2736491648 conn(0x7fae7c079730 msgr2=0x7fae7c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:33.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 shutdown_connections 2024-09-21T06:10:33.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:33.394+0000 7fae82a2e640 1 -- 172.21.15.17:0/2736491648 wait complete. 2024-09-21T06:10:33.757 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:33 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2736491648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:34.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:33 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2736491648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:34.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:33 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2736491648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:10:34.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:10:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:34.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:34 smithi017 ceph-mon[31080]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:34.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 -- 172.21.15.17:0/822930692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 msgr2=0x7f35e8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 --2- 172.21.15.17:0/822930692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8110620 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009ca0 tx=0x7f35e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 -- 172.21.15.17:0/822930692 shutdown_connections 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 --2- 172.21.15.17:0/822930692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8110620 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 --2- 172.21.15.17:0/822930692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e81094a0 0x7f35e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 --2- 172.21.15.17:0/822930692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e8103b60 0x7f35e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 -- 172.21.15.17:0/822930692 >> 172.21.15.17:0/822930692 conn(0x7f35e807b850 msgr2=0x7f35e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 -- 172.21.15.17:0/822930692 shutdown_connections 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.943+0000 7f35eebfa640 1 -- 172.21.15.17:0/822930692 wait complete. 2024-09-21T06:10:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 Processor -- start 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 -- start start 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e8103b60 0x7f35e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e81094a0 0x7f35e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f35e81139b0 con 0x7f35e8109df0 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8113830 con 0x7f35e8103b60 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35eebfa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8113b30 con 0x7f35e81094a0 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35ed197640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35ed197640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41598/0 (socket says 172.21.15.17:41598) 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.944+0000 7f35ed197640 1 -- 172.21.15.17:0/2494583608 learned_addr learned my addr 172.21.15.17:0/2494583608 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ec996640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e8103b60 0x7f35e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35e7fff640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e81094a0 0x7f35e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ed197640 1 -- 172.21.15.17:0/2494583608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e81094a0 msgr2=0x7f35e8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ed197640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e81094a0 0x7f35e8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ed197640 1 -- 172.21.15.17:0/2494583608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e8103b60 msgr2=0x7f35e8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ed197640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e8103b60 0x7f35e8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ed197640 1 -- 172.21.15.17:0/2494583608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e81a8660 con 0x7f35e8109df0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35ed197640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8076190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35e0005cc0 tx=0x7f35e0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0032e00 con 0x7f35e8109df0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35e00044d0 con 0x7f35e8109df0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e81a88f0 con 0x7f35e8109df0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0030b70 con 0x7f35e8109df0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.945+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e81a8e30 con 0x7f35e8109df0 2024-09-21T06:10:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.947+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e8103f70 con 0x7f35e8109df0 2024-09-21T06:10:34.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.948+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f35e0004680 con 0x7f35e8109df0 2024-09-21T06:10:34.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.949+0000 7f35e5ffb640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f35d80b6510 0x7f35d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:34.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.949+0000 7f35ec996640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f35d80b6510 0x7f35d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:34.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.949+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f35e0108820 con 0x7f35e8109df0 2024-09-21T06:10:34.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.949+0000 7f35ec996640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f35d80b6510 0x7f35d80b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f35e8077160 tx=0x7f35dc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:34.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:34.953+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35e00cee10 con 0x7f35e8109df0 2024-09-21T06:10:35.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:34 smithi081 ceph-mon[33870]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:34 smithi089 ceph-mon[33879]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.146+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35e802e640 con 0x7f35e8109df0 2024-09-21T06:10:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.147+0000 7f35e5ffb640 1 -- 172.21.15.17:0/2494583608 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24154 (secure 0 0 0) 0x7f35e00d31f0 con 0x7f35e8109df0 2024-09-21T06:10:35.149 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:35.149 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:26.317022+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f35d80b6510 msgr2=0x7f35d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f35d80b6510 0x7f35d80b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f35e8077160 tx=0x7f35dc00b390 comp rx=0 tx=0).stop 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 msgr2=0x7f35e8076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8076190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35e0005cc0 tx=0x7f35e0032a10 comp rx=0 tx=0).stop 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 shutdown_connections 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f35d80b6510 0x7f35d80b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e8109df0 0x7f35e8076190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35e81094a0 0x7f35e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 --2- 172.21.15.17:0/2494583608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e8103b60 0x7f35e8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 >> 172.21.15.17:0/2494583608 conn(0x7f35e807b850 msgr2=0x7f35e81054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:35.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 shutdown_connections 2024-09-21T06:10:35.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:35.150+0000 7f35eebfa640 1 -- 172.21.15.17:0/2494583608 wait complete. 2024-09-21T06:10:35.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:35 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2494583608' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:35.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:10:17.202602+0000', 'modified': '2024-09-21T06:10:26.317180+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24656': {'gid': 24656, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6839/84773565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 84773565}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 84773565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24656, 'qdb_cluster': [24656]} 2024-09-21T06:10:35.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:10:35.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:10:36.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:35 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2494583608' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:36.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:35 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2494583608' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 -- 172.21.15.17:0/1256188848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 msgr2=0x7fc884103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 --2- 172.21.15.17:0/1256188848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884103f70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc874009900 tx=0x7fc87402a410 comp rx=0 tx=0).stop 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 -- 172.21.15.17:0/1256188848 shutdown_connections 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 --2- 172.21.15.17:0/1256188848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc884109df0 0x7fc884110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 --2- 172.21.15.17:0/1256188848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8841094a0 0x7fc8841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 --2- 172.21.15.17:0/1256188848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884103f70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 -- 172.21.15.17:0/1256188848 >> 172.21.15.17:0/1256188848 conn(0x7fc88407b850 msgr2=0x7fc88407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 -- 172.21.15.17:0/1256188848 shutdown_connections 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.753+0000 7fc889d79640 1 -- 172.21.15.17:0/1256188848 wait complete. 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 Processor -- start 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 -- start start 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8841094a0 0x7fc884075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc884109df0 0x7fc884076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc884113960 con 0x7fc884103b60 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8841137e0 con 0x7fc8841094a0 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc889d79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc884113ae0 con 0x7fc884109df0 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41618/0 (socket says 172.21.15.17:41618) 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc8837fe640 1 -- 172.21.15.17:0/2070242223 learned_addr learned my addr 172.21.15.17:0/2070242223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.754+0000 7fc882ffd640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8841094a0 0x7fc884075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc883fff640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc884109df0 0x7fc884076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc8837fe640 1 -- 172.21.15.17:0/2070242223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc884109df0 msgr2=0x7fc884076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc884109df0 0x7fc884076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc8837fe640 1 -- 172.21.15.17:0/2070242223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8841094a0 msgr2=0x7fc884075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8841094a0 0x7fc884075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc8837fe640 1 -- 172.21.15.17:0/2070242223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8841a8690 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884075710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc874009230 tx=0x7fc874004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc880ff9640 1 -- 172.21.15.17:0/2070242223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87403f030 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc880ff9640 1 -- 172.21.15.17:0/2070242223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc874003a80 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc880ff9640 1 -- 172.21.15.17:0/2070242223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874035070 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8841a8920 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.755+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8841a8e50 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc880ff9640 1 -- 172.21.15.17:0/2070242223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc874042030 con 0x7fc884103b60 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 Processor -- start 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 -- start start 2024-09-21T06:10:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079afbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079afc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079afc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560079a73c10 con 0x560079735280 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560079a63040 con 0x56007972d0a0 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8902ed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560079a66e50 con 0x560079755f60 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc882ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079afc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc882ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079afc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41620/0 (socket says 172.21.15.17:41620) 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc882ffd640 1 -- 172.21.15.17:0/890738570 learned_addr learned my addr 172.21.15.17:0/890738570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.758+0000 7fc8837fe640 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079afc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc883fff640 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079afbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc880ff9640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc86c0b6590 0x7fc86c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc883fff640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc86c0b6590 0x7fc86c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc882ffd640 1 -- 172.21.15.17:0/890738570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 msgr2=0x560079afbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc882ffd640 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079afbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc882ffd640 1 -- 172.21.15.17:0/890738570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 msgr2=0x560079afc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc882ffd640 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079afc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc882ffd640 1 -- 172.21.15.17:0/890738570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600797c1540 con 0x560079735280 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc880ff9640 1 -- 172.21.15.17:0/2070242223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc874107cc0 con 0x7fc884103b60 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc882ffd640 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079afc980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc87800bc20 tx=0x7fc87800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba8fff7b9d7acc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc869ffb640 1 -- 172.21.15.17:0/890738570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878015070 con 0x560079735280 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc883fff640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc86c0b6590 0x7fc86c0b8aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009fd0 tx=0x7fc87c004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc869ffb640 1 -- 172.21.15.17:0/890738570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc87801a8f0 con 0x560079735280 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.759+0000 7fc869ffb640 1 -- 172.21.15.17:0/890738570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8780117c0 con 0x560079735280 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 -- 172.21.15.17:0/890738570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 msgr2=0x560079afc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079afc980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc87800bc20 tx=0x7fc87800f730 comp rx=0 tx=0).stop 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 -- 172.21.15.17:0/890738570 shutdown_connections 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079afc980 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079afc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 --2- 172.21.15.17:0/890738570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079afbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 -- 172.21.15.17:0/890738570 >> 172.21.15.17:0/890738570 conn(0x56007974a350 msgr2=0x560079af9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 -- 172.21.15.17:0/890738570 shutdown_connections 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.760+0000 7fc8902ed740 1 -- 172.21.15.17:0/890738570 wait complete. 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 -- start start 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 Processor -- start 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b07990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b07ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5600798c45f0 con 0x560079755f60 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5600799fe010 con 0x56007972d0a0 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560079b0a6e0 con 0x560079735280 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc8902ed740 10 client.0 _ll_register_callbacks cb 0x560079a5d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:10:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc883fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc883fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41630/0 (socket says 172.21.15.17:41630) 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.761+0000 7fc883fff640 1 -- 172.21.15.17:0/807336301 learned_addr learned my addr 172.21.15.17:0/807336301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc882ffd640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b07ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc8837fe640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc883fff640 1 -- 172.21.15.17:0/807336301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 msgr2=0x560079b07ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc883fff640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b07ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc883fff640 1 -- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 msgr2=0x560079b07990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc883fff640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b07990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc883fff640 1 -- 172.21.15.17:0/807336301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560079a2ba00 con 0x560079755f60 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc883fff640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b139d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc87c011b00 tx=0x7fc87c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3982146a300d2493 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc862ffd640 1 -- 172.21.15.17:0/807336301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c024070 con 0x560079755f60 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc862ffd640 1 -- 172.21.15.17:0/807336301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc87c003990 con 0x560079755f60 2024-09-21T06:10:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc87801a8f0 con 0x560079755f60 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc862ffd640 1 -- 172.21.15.17:0/807336301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc87c019070 con 0x560079755f60 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc8902ed740 10 client.14871 fetch_fsmap learned FSMap version 17 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.762+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560079b16630 con 0x560079755f60 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc862ffd640 1 -- 172.21.15.17:0/807336301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc87801a8f0 con 0x560079755f60 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc862ffd640 1 -- 172.21.15.17:0/807336301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fc87c0046c0 con 0x560079755f60 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8902ed740 10 client.14871 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8902ed740 10 client.14871 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8902ed740 20 client.14871 populate_metadata read hostname 'smithi017' 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8902ed740 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600797148e0 0x560079b1a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8902ed740 4 client.14871 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560079a75b60 con 0x5600797148e0 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.763+0000 7fc8837fe640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600797148e0 0x560079b1a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.764+0000 7fc862ffd640 10 client.14871 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.764+0000 7fc8837fe640 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600797148e0 0x560079b1a0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=950e858004857b70 server_cookie=82081e5abde36695 in_seq=0 out_seq=0 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc862ffd640 1 -- 172.21.15.17:0/807336301 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560079a75b60 con 0x5600797148e0 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc862ffd640 10 client.14871 handle_command_reply: tid=0 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 client.14871 shutdown 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 msgr2=0x560079b139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b139d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc87c011b00 tx=0x7fc87c004a40 comp rx=0 tx=0).stop 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 shutdown_connections 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600797148e0 0x560079b1a0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b139d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc862ffd640 0 client.14871 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b07ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 --2- 172.21.15.17:0/807336301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b07990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 >> 172.21.15.17:0/807336301 conn(0x56007974a350 msgr2=0x560079aff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 shutdown_connections 2024-09-21T06:10:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 1 -- 172.21.15.17:0/807336301 wait complete. 2024-09-21T06:10:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.765+0000 7fc8902ed740 20 client.14871 trim_cache size 0 max 16384 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 Processor -- start 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 -- start start 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b02020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b13940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b13e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560079b18410 con 0x560079755f60 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560079b18ae0 con 0x56007972d0a0 2024-09-21T06:10:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.784+0000 7fc8902ed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560079b191b0 con 0x560079735280 2024-09-21T06:10:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b02020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc883fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b13e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc882ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b13940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b02020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:46076/0 (socket says 172.21.15.17:46076) 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc882ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b13940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:49954/0 (socket says 172.21.15.17:49954) 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 -- 172.21.15.17:0/1175992277 learned_addr learned my addr 172.21.15.17:0/1175992277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc883fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b13e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41646/0 (socket says 172.21.15.17:41646) 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 -- 172.21.15.17:0/1175992277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 msgr2=0x560079b13940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b13940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 -- 172.21.15.17:0/1175992277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 msgr2=0x560079b13e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b13e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 -- 172.21.15.17:0/1175992277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560079b05c90 con 0x56007972d0a0 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8837fe640 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b02020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8740cdba0 tx=0x7fc874107040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c2725f40beb4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8697fa640 1 -- 172.21.15.17:0/1175992277 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874109040 con 0x56007972d0a0 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8697fa640 1 -- 172.21.15.17:0/1175992277 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8740cd720 con 0x56007972d0a0 2024-09-21T06:10:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.785+0000 7fc8697fa640 1 -- 172.21.15.17:0/1175992277 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874049040 con 0x56007972d0a0 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 -- 172.21.15.17:0/1175992277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 msgr2=0x560079b02020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b02020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8740cdba0 tx=0x7fc874107040 comp rx=0 tx=0).stop 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 -- 172.21.15.17:0/1175992277 shutdown_connections 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079755f60 0x560079b13e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079735280 0x560079b13940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 --2- 172.21.15.17:0/1175992277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b02020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 -- 172.21.15.17:0/1175992277 >> 172.21.15.17:0/1175992277 conn(0x56007974a350 msgr2=0x560079af97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 -- 172.21.15.17:0/1175992277 shutdown_connections 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.786+0000 7fc8902ed740 1 -- 172.21.15.17:0/1175992277 wait complete. 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 -- start start 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 Processor -- start 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b22a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079b1bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079b1c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560079b19f50 con 0x560079735280 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560079b19880 con 0x56007972d0a0 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x560079b1a620 con 0x560079755f60 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc8902ed740 10 client.0 _ll_register_callbacks cb 0x7fc87c009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.787+0000 7fc882ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079b1bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079b1bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41658/0 (socket says 172.21.15.17:41658) 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 -- 172.21.15.17:0/2206273016 learned_addr learned my addr 172.21.15.17:0/2206273016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b22a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc883fff640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079b1c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 -- 172.21.15.17:0/2206273016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 msgr2=0x560079b1c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079b1c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 -- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 msgr2=0x560079b22a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b22a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 -- 172.21.15.17:0/2206273016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560079b1cae0 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b22a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc882ffd640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079b1bf00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc878019000 tx=0x7fc87800b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a01f88886c113e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc862ffd640 1 -- 172.21.15.17:0/2206273016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878029060 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc862ffd640 1 -- 172.21.15.17:0/2206273016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc878005590 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.788+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8740cd720 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc862ffd640 1 -- 172.21.15.17:0/2206273016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc878030050 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 10 client.14877 fetch_fsmap learned FSMap version 17 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560079b224c0 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc862ffd640 1 -- 172.21.15.17:0/2206273016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8740cd720 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc862ffd640 1 -- 172.21.15.17:0/2206273016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fc87801a660 con 0x560079735280 2024-09-21T06:10:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 10 client.14877 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 10 client.14877 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 20 client.14877 populate_metadata read hostname 'smithi017' 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600796e9c90 0x560079b88980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 4 client.14877 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.789+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "status"}) -- 0x560079a71610 con 0x5600796e9c90 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.790+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600796e9c90 0x560079b88980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.790+0000 7fc8837fe640 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600796e9c90 0x560079b88980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb638832997b4bbe server_cookie=44bb93a5dac7ab70 in_seq=0 out_seq=0 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.790+0000 7fc862ffd640 10 client.14877 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.790+0000 7fc862ffd640 1 -- 172.21.15.17:0/2206273016 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560079a71610 con 0x5600796e9c90 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.790+0000 7fc862ffd640 10 client.14877 handle_command_reply: tid=0 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.790+0000 7fc8902ed740 1 client.14877 shutdown 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 msgr2=0x560079b1bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079b1bf00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc878019000 tx=0x7fc87800b4e0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 shutdown_connections 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5600796e9c90 0x560079b88980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560079735280 0x560079b1bf00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560079755f60 0x560079b1c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 --2- 172.21.15.17:0/2206273016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56007972d0a0 0x560079b22a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 >> 172.21.15.17:0/2206273016 conn(0x56007974a350 msgr2=0x560079af9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc862ffd640 0 client.14877 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 shutdown_connections 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 1 -- 172.21.15.17:0/2206273016 wait complete. 2024-09-21T06:10:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc8902ed740 20 client.14877 trim_cache size 0 max 16384 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24656, 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:10:36.798 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 19.245005124999999, 2024-09-21T06:10:36.799 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 17, 2024-09-21T06:10:36.799 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 80, 2024-09-21T06:10:36.799 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 79, 2024-09-21T06:10:36.799 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 30.011096689999999 2024-09-21T06:10:36.799 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:10:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc86c0b6590 msgr2=0x7fc86c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc86c0b6590 0x7fc86c0b8aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009fd0 tx=0x7fc87c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 msgr2=0x7fc884075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884075710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc874009230 tx=0x7fc874004270 comp rx=0 tx=0).stop 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 shutdown_connections 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc86c0b6590 0x7fc86c0b8aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc884109df0 0x7fc884076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8841094a0 0x7fc884075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 --2- 172.21.15.17:0/2070242223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc884103b60 0x7fc884075710 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.791+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 >> 172.21.15.17:0/2070242223 conn(0x7fc88407b850 msgr2=0x7fc8841075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.792+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 shutdown_connections 2024-09-21T06:10:36.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:36.792+0000 7fc889d79640 1 -- 172.21.15.17:0/2070242223 wait complete. 2024-09-21T06:10:36.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:36 smithi017 ceph-mon[31080]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:36 smithi081 ceph-mon[33870]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:36 smithi089 ceph-mon[33879]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:37.630 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:10:37.631 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:37.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T06:10:37.906 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3264856057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 msgr2=0x7fbb54110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3264856057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb54110330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009ca0 tx=0x7fbb4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3264856057 shutdown_connections 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3264856057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb54110330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3264856057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb54105380 0x7fbb5410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3264856057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb54104a30 0x7fbb54104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3264856057 >> 172.21.15.17:0/3264856057 conn(0x7fbb540797b0 msgr2=0x7fbb54079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.387+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3264856057 shutdown_connections 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.388+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3264856057 wait complete. 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.388+0000 7fbb5adfa640 1 Processor -- start 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.388+0000 7fbb5adfa640 1 -- start start 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb5adfa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb54104a30 0x7fbb5419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb5adfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb54105380 0x7fbb5419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb5adfa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb5419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb5adfa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54113a20 con 0x7fbb5410de60 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb5adfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541138a0 con 0x7fbb54105380 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb5adfa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54113ba0 con 0x7fbb54104a30 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb5419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb5419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41678/0 (socket says 172.21.15.17:41678) 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 -- 172.21.15.17:0/3919261146 learned_addr learned my addr 172.21.15.17:0/3919261146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb53fff640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb54105380 0x7fbb5419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb58b96640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb54104a30 0x7fbb5419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 -- 172.21.15.17:0/3919261146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb54104a30 msgr2=0x7fbb5419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb54104a30 0x7fbb5419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 -- 172.21.15.17:0/3919261146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb54105380 msgr2=0x7fbb5419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb54105380 0x7fbb5419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 -- 172.21.15.17:0/3919261146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb541a02a0 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb59397640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb5419fc30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c005cc0 tx=0x7fbb4c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.389+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c004040 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.390+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb4c004670 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.390+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c030cc0 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.390+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb541a0530 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.390+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb541a6db0 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.391+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb54104e40 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.393+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbb4c0041e0 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.394+0000 7fbb51ffb640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbb440b65c0 0x7fbb440b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.394+0000 7fbb58b96640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbb440b65c0 0x7fbb440b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.394+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fbb4c108a10 con 0x7fbb5410de60 2024-09-21T06:10:38.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.395+0000 7fbb58b96640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbb440b65c0 0x7fbb440b8ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009990 tx=0x7fbb48009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:38.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.398+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb4c0cf120 con 0x7fbb5410de60 2024-09-21T06:10:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.648+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbb5419b520 con 0x7fbb5410de60 2024-09-21T06:10:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.648+0000 7fbb51ffb640 1 -- 172.21.15.17:0/3919261146 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fbb5419b520 con 0x7fbb5410de60 2024-09-21T06:10:38.650 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbb440b65c0 msgr2=0x7fbb440b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbb440b65c0 0x7fbb440b8ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009990 tx=0x7fbb48009110 comp rx=0 tx=0).stop 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 msgr2=0x7fbb5419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb5419fc30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c005cc0 tx=0x7fbb4c032c40 comp rx=0 tx=0).stop 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 shutdown_connections 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbb440b65c0 0x7fbb440b8ad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5410de60 0x7fbb5419fc30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb54105380 0x7fbb5419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 --2- 172.21.15.17:0/3919261146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb54104a30 0x7fbb5419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 >> 172.21.15.17:0/3919261146 conn(0x7fbb540797b0 msgr2=0x7fbb540ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 shutdown_connections 2024-09-21T06:10:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:38.650+0000 7fbb5adfa640 1 -- 172.21.15.17:0/3919261146 wait complete. 2024-09-21T06:10:38.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:38 smithi017 ceph-mon[31080]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:39.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:38 smithi081 ceph-mon[33870]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:38 smithi089 ceph-mon[33879]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:39.339 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:10:39.339 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:10:39.339 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-21T06:10:39.339 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T06:10:39.340 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:39.340 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:10:39.340 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:10:39.340 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:10:39.340 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T06:10:39.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:39.340 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-21T06:10:39.357 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:10:39.358 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42238sec preferred_lft 42238sec 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:10:39.359 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-21T06:10:39.359 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:10:39.360 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:10:39.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:39.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:39.566 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:10:39.592 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-21T06:10:39.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:39.593 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-21T06:10:39.665 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-21T06:10:39.665 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:10:39.665 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T06:10:39.665 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T06:10:39.665 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:10:39.666 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:39.666 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:10:39.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T06:10:39.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T06:10:39.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T06:10:39.666 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:10:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:39.868 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:39 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3919261146' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:10:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:39.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:39.955 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-21T06:10:39.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:39.972 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-21T06:10:40.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:39 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3919261146' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:10:40.028 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:40.029 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:10:40.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:10:40.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T06:10:40.029 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:10:40.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:39 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3919261146' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:10:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:40.148 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T06:10:40.148 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:40.148 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:10:40.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T06:10:40.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:10:40.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T06:10:40.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T06:10:40.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T06:10:40.149 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:10:40.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:40.279 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:10:40.280 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:10:40.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-21T06:10:40.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:10:40.280 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:10:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:10:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:40.359 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T06:10:40.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:40.359 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:40.375 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T06:10:40.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:10:40.375 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:40.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-21T06:10:40.498 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-21T06:10:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-21T06:10:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0fb66eb7e22b894c0be8f4c043f772073f61b190582bd94c6fd74f53fa049a39/merged 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/a59bf23c5fa1d3a3e1dc6c6e88f96b5a71fff510acc583b3e2f54a1dbf1a83da/merged 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f48b8bf5180f530deb86eb3fe5e7bbeacfdcb5084311763c09756df80051576/merged 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/55ad209a74bb6d967e997c1eafcecc32c449fddbab9b596bb5e6d37bcf4290c4/merged 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6d1e4e4b2622105eff3086a2515232f383de93b8a23ac352e22c187589d5a87e/merged 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/28d07ea1c7d1f2fe4a02e9bcffb01bbe8926b9b4067c35b4b4ffb4d7377e9d64/merged 2024-09-21T06:10:40.557 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6aa0e85692310b56b099c79814d404bc7e2f718d517d1896484241fd3f9b8e9e/merged 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e8fe9fd427f979cc878775012cfe91ad8d0015df9d47975bc075bb9bc5d07807/merged 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eaba1a93d1e3a87c691933777c14d6c1a8dc9cd8f8dddb9aa62f8539d2ac5f88/merged 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/654aa8e9c4191d0b67711a7338f002fe0715925321955d8a330644bc0299c3c6/merged 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:10:40.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.558 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-21T06:10:40.612 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T06:10:40.612 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T06:10:40.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-21T06:10:40.681 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-21T06:10:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:10:40.739 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0fb66eb7e22b894c0be8f4c043f772073f61b190582bd94c6fd74f53fa049a39/merged 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/a59bf23c5fa1d3a3e1dc6c6e88f96b5a71fff510acc583b3e2f54a1dbf1a83da/merged 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f48b8bf5180f530deb86eb3fe5e7bbeacfdcb5084311763c09756df80051576/merged 2024-09-21T06:10:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/55ad209a74bb6d967e997c1eafcecc32c449fddbab9b596bb5e6d37bcf4290c4/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6d1e4e4b2622105eff3086a2515232f383de93b8a23ac352e22c187589d5a87e/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/28d07ea1c7d1f2fe4a02e9bcffb01bbe8926b9b4067c35b4b4ffb4d7377e9d64/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6aa0e85692310b56b099c79814d404bc7e2f718d517d1896484241fd3f9b8e9e/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e8fe9fd427f979cc878775012cfe91ad8d0015df9d47975bc075bb9bc5d07807/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eaba1a93d1e3a87c691933777c14d6c1a8dc9cd8f8dddb9aa62f8539d2ac5f88/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/654aa8e9c4191d0b67711a7338f002fe0715925321955d8a330644bc0299c3c6/merged 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:10:40.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.742 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-21T06:10:40.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:2024-09-21T06:10:40.775+0000 7f79e13fe480 -1 init, newargv = 0x7f79c40046a0 newargc=15 2024-09-21T06:10:40.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[76080]: starting ceph client 2024-09-21T06:10:40.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[76080]: starting fuse 2024-09-21T06:10:40.794 INFO:teuthology.orchestra.run.smithi017.stdout:120 2024-09-21T06:10:40.794 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T06:10:40.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-21T06:10:40.794 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-21T06:10:40.794 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-21T06:10:40.794 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-21T06:10:40.794 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-21T06:10:40.794 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T06:10:40.795 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-21T06:10:40.796 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-21T06:10:40.796 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-21T06:10:40.796 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T06:10:40.796 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:10:40.796 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.admin")) 2024-09-21T06:10:40.796 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-21T06:10:40.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:40 smithi017 ceph-mon[31080]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:40.915 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.admin.76080.asok 2024-09-21T06:10:40.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:40.925 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76080.asok 2024-09-21T06:10:40.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:40.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76080.asok status 2024-09-21T06:10:41.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:40 smithi081 ceph-mon[33870]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "admin", 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T06:10:41.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "76080", 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 14889, 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 14889 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2038936282 2024-09-21T06:10:41.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2038936282 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.14889 192.168.0.1:0/2038936282", 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/2038936282", 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 17, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 80, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-21T06:10:41.073 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-21T06:10:41.074 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:10:41.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:41.080 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-21T06:10:41.080 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:41.096 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-21T06:10:41.096 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:41.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:41.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:40 smithi089 ceph-mon[33879]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:41.163 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T06:10:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:10:41.283 INFO:teuthology.orchestra.run.smithi017.stdout:# file: . 2024-09-21T06:10:41.283 INFO:teuthology.orchestra.run.smithi017.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T06:10:41.284 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:41.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:10:41.289 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:10:41.290 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:41.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:10:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:42.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 -- 172.21.15.17:0/1754159469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b101049b0 msgr2=0x7f4b10104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 --2- 172.21.15.17:0/1754159469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b101049b0 0x7f4b10104dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009900 tx=0x7f4b0002a410 comp rx=0 tx=0).stop 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 -- 172.21.15.17:0/1754159469 shutdown_connections 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 --2- 172.21.15.17:0/1754159469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b1010de10 0x7f4b10110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 --2- 172.21.15.17:0/1754159469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b10105300 0x7f4b1010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 --2- 172.21.15.17:0/1754159469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b101049b0 0x7f4b10104dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 -- 172.21.15.17:0/1754159469 >> 172.21.15.17:0/1754159469 conn(0x7f4b10079720 msgr2=0x7f4b10079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 -- 172.21.15.17:0/1754159469 shutdown_connections 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.134+0000 7f4b16476640 1 -- 172.21.15.17:0/1754159469 wait complete. 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.135+0000 7f4b16476640 1 Processor -- start 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.135+0000 7f4b16476640 1 -- start start 2024-09-21T06:10:42.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b16476640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b101049b0 0x7f4b1019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b16476640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b10105300 0x7f4b1019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b16476640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 0x7f4b1019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b16476640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10113940 con 0x7f4b1010de10 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b16476640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b101137c0 con 0x7f4b101049b0 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b16476640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10113ac0 con 0x7f4b10105300 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 0x7f4b1019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 0x7f4b1019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42578/0 (socket says 172.21.15.17:42578) 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 -- 172.21.15.17:0/2527027525 learned_addr learned my addr 172.21.15.17:0/2527027525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b0ffff640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b101049b0 0x7f4b1019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b0f7fe640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b10105300 0x7f4b1019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 -- 172.21.15.17:0/2527027525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b10105300 msgr2=0x7f4b1019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b10105300 0x7f4b1019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 -- 172.21.15.17:0/2527027525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b101049b0 msgr2=0x7f4b1019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:42.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b101049b0 0x7f4b1019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 -- 172.21.15.17:0/2527027525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b101a0360 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b14a13640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 0x7f4b1019fc30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800eaa0 tx=0x7f4b0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.136+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800cdb0 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.137+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b08005020 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.137+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b101a0650 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.137+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b080116d0 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.137+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b101a6db0 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.138+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1006c2e0 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.139+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4b080051d0 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.140+0000 7f4b0d7fa640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4af80b6590 0x7f4af80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.140+0000 7f4b0ffff640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4af80b6590 0x7f4af80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.140+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f4b080e79a0 con 0x7f4b1010de10 2024-09-21T06:10:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.141+0000 7f4b0ffff640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4af80b6590 0x7f4af80b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b00004770 tx=0x7f4b000058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:42.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.144+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b08016030 con 0x7f4b1010de10 2024-09-21T06:10:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.343+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b10104dc0 con 0x7f4b1010de10 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.343+0000 7f4b0d7fa640 1 -- 172.21.15.17:0/2527027525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+592 (secure 0 0 0) 0x7f4b080ae070 con 0x7f4b1010de10 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2587374974 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3130109001 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1617037506 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4105480071 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:42.346 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1076932999 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:42.346 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1328055657 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:42.346 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4af80b6590 msgr2=0x7f4af80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4af80b6590 0x7f4af80b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b00004770 tx=0x7f4b000058d0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 msgr2=0x7f4b1019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 0x7f4b1019fc30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800eaa0 tx=0x7f4b0800ef60 comp rx=0 tx=0).stop 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 shutdown_connections 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4af80b6590 0x7f4af80b8aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b1010de10 0x7f4b1019fc30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b10105300 0x7f4b1019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 --2- 172.21.15.17:0/2527027525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b101049b0 0x7f4b1019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 >> 172.21.15.17:0/2527027525 conn(0x7f4b10079720 msgr2=0x7f4b10100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.345+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 shutdown_connections 2024-09-21T06:10:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:42.346+0000 7f4b16476640 1 -- 172.21.15.17:0/2527027525 wait complete. 2024-09-21T06:10:43.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:42 smithi081 ceph-mon[33870]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:43.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:42 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2527027525' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:10:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:42 smithi089 ceph-mon[33879]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:42 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2527027525' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:10:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:42 smithi017 ceph-mon[31080]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:42 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2527027525' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:10:43.204 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:10:43.204 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:10:43.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:10:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 -- 172.21.15.17:0/433580929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 msgr2=0x7f768c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 --2- 172.21.15.17:0/433580929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c103fc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f767c009900 tx=0x7f767c02a410 comp rx=0 tx=0).stop 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 -- 172.21.15.17:0/433580929 shutdown_connections 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 --2- 172.21.15.17:0/433580929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c109e40 0x7f768c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 --2- 172.21.15.17:0/433580929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 0x7f768c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 --2- 172.21.15.17:0/433580929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c103fc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 -- 172.21.15.17:0/433580929 >> 172.21.15.17:0/433580929 conn(0x7f768c0ff600 msgr2=0x7f768c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 -- 172.21.15.17:0/433580929 shutdown_connections 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.973+0000 7f76909d0640 1 -- 172.21.15.17:0/433580929 wait complete. 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.974+0000 7f76909d0640 1 Processor -- start 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.974+0000 7f76909d0640 1 -- start start 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f76909d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f76909d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 0x7f768c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f76909d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c109e40 0x7f768c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f76909d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f768c1139b0 con 0x7f768c103bb0 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f76909d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f768c113830 con 0x7f768c1094f0 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f76909d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f768c113b30 con 0x7f768c109e40 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42594/0 (socket says 172.21.15.17:42594) 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 -- 172.21.15.17:0/2240805093 learned_addr learned my addr 172.21.15.17:0/2240805093 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f7681d9b640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 0x7f768c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768ad9d640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c109e40 0x7f768c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 -- 172.21.15.17:0/2240805093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c109e40 msgr2=0x7f768c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c109e40 0x7f768c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 -- 172.21.15.17:0/2240805093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 msgr2=0x7f768c19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 0x7f768c19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f768a59c640 1 -- 172.21.15.17:0/2240805093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c1a0350 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.975+0000 7f7681d9b640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 0x7f768c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.976+0000 7f768a59c640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c19a3e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f767c009230 tx=0x7f767c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.976+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c03f030 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.976+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c1a05e0 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.976+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f767c003a80 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.976+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c035070 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.976+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c0755f0 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.977+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768c104e30 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.979+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f767c042030 con 0x7f768c103bb0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.979+0000 7f7683fff640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76780b6510 0x7f76780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.980+0000 7f7681d9b640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76780b6510 0x7f76780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.980+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f767c107fa0 con 0x7f768c103bb0 2024-09-21T06:10:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.980+0000 7f7681d9b640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76780b6510 0x7f76780b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f768c109070 tx=0x7f767400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:43.983+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f767c0d29d0 con 0x7f768c103bb0 2024-09-21T06:10:44.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.184+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f768c103fc0 con 0x7f768c103bb0 2024-09-21T06:10:44.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.184+0000 7f7683fff640 1 -- 172.21.15.17:0/2240805093 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+592 (secure 0 0 0) 0x7f767c0d7910 con 0x7f768c103bb0 2024-09-21T06:10:44.186 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2587374974 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:44.186 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3130109001 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1617037506 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4105480071 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1076932999 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1328055657 2024-09-22T06:02:18.519832+0000 2024-09-21T06:10:44.187 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-21T06:10:44.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76780b6510 msgr2=0x7f76780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:44.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76780b6510 0x7f76780b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f768c109070 tx=0x7f767400b410 comp rx=0 tx=0).stop 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 msgr2=0x7f768c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c19a3e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f767c009230 tx=0x7f767c004270 comp rx=0 tx=0).stop 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 shutdown_connections 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76780b6510 0x7f76780b8a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f768c109e40 0x7f768c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f768c1094f0 0x7f768c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 --2- 172.21.15.17:0/2240805093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f768c103bb0 0x7f768c19a3e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 >> 172.21.15.17:0/2240805093 conn(0x7f768c0ff600 msgr2=0x7f768c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 shutdown_connections 2024-09-21T06:10:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:44.187+0000 7f76909d0640 1 -- 172.21.15.17:0/2240805093 wait complete. 2024-09-21T06:10:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:44 smithi017 ceph-mon[31080]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:44 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2240805093' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:10:45.002 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-21T06:10:45.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:45.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:10:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:44 smithi081 ceph-mon[33870]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:44 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2240805093' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:10:45.029 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[76080]: fuse finished with error 0 and tester_r 0 2024-09-21T06:10:45.031 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:10:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:44 smithi089 ceph-mon[33879]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:44 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2240805093' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:10:46.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T06:10:46.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:45 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T06:10:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T06:10:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T06:10:46.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:45 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T06:10:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T06:10:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T06:10:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T06:10:46.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T06:10:46.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-21T06:10:46.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-21T06:10:46.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-21T06:10:46.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]} : dispatch 2024-09-21T06:10:46.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T06:10:46.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:45 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T06:10:47.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T06:10:47.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:46 smithi081 ceph-mon[33870]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T06:10:47.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:46 smithi089 ceph-mon[33879]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:10:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:10:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T06:10:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T06:10:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T06:10:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T06:10:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-21T06:10:47.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-21T06:10:47.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-21T06:10:47.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-21T06:10:47.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T06:10:47.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T06:10:47.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:46 smithi017 ceph-mon[31080]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:10:48.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:47 smithi081 ceph-mon[33870]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:10:48.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:47 smithi089 ceph-mon[33879]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:10:48.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:47 smithi017 ceph-mon[31080]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:10:48.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:48 smithi017 ceph-mon[31080]: pgmap v313: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:48 smithi081 ceph-mon[33870]: pgmap v313: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:48 smithi089 ceph-mon[33879]: pgmap v313: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:51.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:50 smithi081 ceph-mon[33870]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:50 smithi089 ceph-mon[33879]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:51.133 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T06:10:51.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:10:51.133 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T06:10:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:50 smithi017 ceph-mon[31080]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:51.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:10:51.471 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:51.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.941+0000 7fbf47c92640 1 -- 172.21.15.17:0/349348108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf400757b0 msgr2=0x7fbf40075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.941+0000 7fbf47c92640 1 --2- 172.21.15.17:0/349348108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf400757b0 0x7fbf40075bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009900 tx=0x7fbf3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 -- 172.21.15.17:0/349348108 shutdown_connections 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 --2- 172.21.15.17:0/349348108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf401100c0 0x7fbf40112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 --2- 172.21.15.17:0/349348108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf40076100 0x7fbf4010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 --2- 172.21.15.17:0/349348108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf400757b0 0x7fbf40075bc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 -- 172.21.15.17:0/349348108 >> 172.21.15.17:0/349348108 conn(0x7fbf4007b850 msgr2=0x7fbf4007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 -- 172.21.15.17:0/349348108 shutdown_connections 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 -- 172.21.15.17:0/349348108 wait complete. 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 Processor -- start 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.942+0000 7fbf47c92640 1 -- start start 2024-09-21T06:10:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf47c92640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400757b0 0x7fbf4019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf47c92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf40076100 0x7fbf4019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf47c92640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 0x7fbf401a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf47c92640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf40115b20 con 0x7fbf401100c0 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf47c92640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf401159a0 con 0x7fbf400757b0 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf47c92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf40115ca0 con 0x7fbf40076100 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 0x7fbf401a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 0x7fbf401a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39508/0 (socket says 172.21.15.17:39508) 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 -- 172.21.15.17:0/937911982 learned_addr learned my addr 172.21.15.17:0/937911982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4522d640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf40076100 0x7fbf4019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf45a2e640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400757b0 0x7fbf4019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 -- 172.21.15.17:0/937911982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf40076100 msgr2=0x7fbf4019cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf40076100 0x7fbf4019cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 -- 172.21.15.17:0/937911982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400757b0 msgr2=0x7fbf4019c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400757b0 0x7fbf4019c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 -- 172.21.15.17:0/937911982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf401a2500 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.943+0000 7fbf4622f640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 0x7fbf401a1dd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009fd0 tx=0x7fbf3800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.944+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38017070 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.944+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf38003e00 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.944+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf401a27f0 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.944+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38010460 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.944+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf401a8f50 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.945+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf40075bc0 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.947+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbf38003970 con 0x7fbf401100c0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.948+0000 7fbf36ffd640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf2c0b6590 0x7fbf2c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.948+0000 7fbf45a2e640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf2c0b6590 0x7fbf2c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:51.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.948+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fbf380e7320 con 0x7fbf401100c0 2024-09-21T06:10:51.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.948+0000 7fbf45a2e640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf2c0b6590 0x7fbf2c0b8aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0057c0 tx=0x7fbf3c0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:51.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:51.951+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf380b1cb0 con 0x7fbf401100c0 2024-09-21T06:10:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.139+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf4010b270 con 0x7fbf401100c0 2024-09-21T06:10:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.141+0000 7fbf36ffd640 1 -- 172.21.15.17:0/937911982 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24681 (secure 0 0 0) 0x7fbf380b6bf0 con 0x7fbf401100c0 2024-09-21T06:10:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:52.145 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:46.657720+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:52.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf2c0b6590 msgr2=0x7fbf2c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:52.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf2c0b6590 0x7fbf2c0b8aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0057c0 tx=0x7fbf3c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 msgr2=0x7fbf401a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 0x7fbf401a1dd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009fd0 tx=0x7fbf3800b260 comp rx=0 tx=0).stop 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 shutdown_connections 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf2c0b6590 0x7fbf2c0b8aa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf401100c0 0x7fbf401a1dd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf40076100 0x7fbf4019cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 --2- 172.21.15.17:0/937911982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400757b0 0x7fbf4019c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 >> 172.21.15.17:0/937911982 conn(0x7fbf4007b850 msgr2=0x7fbf401019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 shutdown_connections 2024-09-21T06:10:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:52.143+0000 7fbf47c92640 1 -- 172.21.15.17:0/937911982 wait complete. 2024-09-21T06:10:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:52 smithi017 ceph-mon[31080]: pgmap v315: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:52 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/937911982' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:52.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:10:53.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:52 smithi081 ceph-mon[33870]: pgmap v315: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:53.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:52 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/937911982' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:52 smithi089 ceph-mon[33879]: pgmap v315: 129 pgs: 1 peering, 128 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:10:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:52 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/937911982' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 -- 172.21.15.17:0/3672730921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0102230 msgr2=0x7f07c0102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 --2- 172.21.15.17:0/3672730921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0102230 0x7f07c0102640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009900 tx=0x7f07b002a410 comp rx=0 tx=0).stop 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 -- 172.21.15.17:0/3672730921 shutdown_connections 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 --2- 172.21.15.17:0/3672730921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c01084c0 0x7f07c010ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 --2- 172.21.15.17:0/3672730921 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0107b70 0x7f07c0107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 --2- 172.21.15.17:0/3672730921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0102230 0x7f07c0102640 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.699+0000 7f07c5955640 1 -- 172.21.15.17:0/3672730921 >> 172.21.15.17:0/3672730921 conn(0x7f07c0079e40 msgr2=0x7f07c007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.700+0000 7f07c5955640 1 -- 172.21.15.17:0/3672730921 shutdown_connections 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.700+0000 7f07c5955640 1 -- 172.21.15.17:0/3672730921 wait complete. 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.700+0000 7f07c5955640 1 Processor -- start 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.700+0000 7f07c5955640 1 -- start start 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07c5955640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0102230 0x7f07c019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07c5955640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 0x7f07c019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:53.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07c5955640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c01084c0 0x7f07c019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07c5955640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0111800 con 0x7f07c0107b70 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07c5955640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0111680 con 0x7f07c0102230 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07c5955640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f07c0111980 con 0x7f07c01084c0 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 0x7f07c019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 0x7f07c019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39522/0 (socket says 172.21.15.17:39522) 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 -- 172.21.15.17:0/685888272 learned_addr learned my addr 172.21.15.17:0/685888272 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07beffd640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0102230 0x7f07c019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07bf7fe640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c01084c0 0x7f07c019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 -- 172.21.15.17:0/685888272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c01084c0 msgr2=0x7f07c019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c01084c0 0x7f07c019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 -- 172.21.15.17:0/685888272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0102230 msgr2=0x7f07c019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0102230 0x7f07c019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07b67fc640 1 -- 172.21.15.17:0/685888272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c01a0410 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.701+0000 7f07bf7fe640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c01084c0 0x7f07c019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.702+0000 7f07b67fc640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 0x7f07c019aa40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f07a800ddc0 tx=0x7f07a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.702+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8004020 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.702+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c01a0700 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.702+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07a80054b0 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.702+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8004b00 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.702+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c01a6e60 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.703+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c0102640 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.704+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f07a801d020 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.705+0000 7f07c4953640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f07ac0b6510 0x7f07ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.706+0000 7f07beffd640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f07ac0b6510 0x7f07ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.706+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f07a80e7280 con 0x7f07c0107b70 2024-09-21T06:10:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.706+0000 7f07beffd640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f07ac0b6510 0x7f07ac0b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006010 tx=0x7f07b0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:53.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.710+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07a8054710 con 0x7f07c0107b70 2024-09-21T06:10:53.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.899+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07c0109d00 con 0x7f07c0107b70 2024-09-21T06:10:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.901+0000 7f07c4953640 1 -- 172.21.15.17:0/685888272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24681 (secure 0 0 0) 0x7f07a80ad7b0 con 0x7f07c0107b70 2024-09-21T06:10:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:10:53.904 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:46.657720+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:10:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f07ac0b6510 msgr2=0x7f07ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f07ac0b6510 0x7f07ac0b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006010 tx=0x7f07b0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 msgr2=0x7f07c019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 0x7f07c019aa40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f07a800ddc0 tx=0x7f07a800a620 comp rx=0 tx=0).stop 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 shutdown_connections 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f07ac0b6510 0x7f07ac0b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07c0107b70 0x7f07c019aa40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c01084c0 0x7f07c019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 --2- 172.21.15.17:0/685888272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07c0102230 0x7f07c019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 >> 172.21.15.17:0/685888272 conn(0x7f07c0079e40 msgr2=0x7f07c0105cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 shutdown_connections 2024-09-21T06:10:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:53.903+0000 7f07c5955640 1 -- 172.21.15.17:0/685888272 wait complete. 2024-09-21T06:10:54.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:10:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:54 smithi017 ceph-mon[31080]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/685888272' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:55.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:54 smithi081 ceph-mon[33870]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:55.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:54 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/685888272' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:55.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:54 smithi089 ceph-mon[33879]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:55.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:54 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/685888272' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:10:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 -- 172.21.15.17:0/2017315849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 msgr2=0x7fb4141098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 --2- 172.21.15.17:0/2017315849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb4141098b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009900 tx=0x7fb3fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:10:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 -- 172.21.15.17:0/2017315849 shutdown_connections 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 --2- 172.21.15.17:0/2017315849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb4141098b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 --2- 172.21.15.17:0/2017315849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414109df0 0x7fb414110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 --2- 172.21.15.17:0/2017315849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414103b60 0x7fb414103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 -- 172.21.15.17:0/2017315849 >> 172.21.15.17:0/2017315849 conn(0x7fb41407b850 msgr2=0x7fb41407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 -- 172.21.15.17:0/2017315849 shutdown_connections 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 -- 172.21.15.17:0/2017315849 wait complete. 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.421+0000 7fb419919640 1 Processor -- start 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 -- start start 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414103b60 0x7fb41419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb41419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414109df0 0x7fb41419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb414113960 con 0x7fb4141094a0 2024-09-21T06:10:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141137e0 con 0x7fb414109df0 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb419919640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb414113ae0 con 0x7fb414103b60 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb41419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb41419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39540/0 (socket says 172.21.15.17:39540) 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 -- 172.21.15.17:0/3310520764 learned_addr learned my addr 172.21.15.17:0/3310520764 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb412ffd640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414103b60 0x7fb41419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4137fe640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414109df0 0x7fb41419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 -- 172.21.15.17:0/3310520764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414103b60 msgr2=0x7fb41419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414103b60 0x7fb41419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 -- 172.21.15.17:0/3310520764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414109df0 msgr2=0x7fb41419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414109df0 0x7fb41419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4127fc640 1 -- 172.21.15.17:0/3310520764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4141a03a0 con 0x7fb4141094a0 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb412ffd640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414103b60 0x7fb41419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.422+0000 7fb4137fe640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414109df0 0x7fb41419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.423+0000 7fb4127fc640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb41419a9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004770 tx=0x7fb3fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.423+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc03f030 con 0x7fb4141094a0 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.423+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3fc004440 con 0x7fb4141094a0 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.423+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4141a0630 con 0x7fb4141094a0 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.423+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc035070 con 0x7fb4141094a0 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.423+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4141a6df0 con 0x7fb4141094a0 2024-09-21T06:10:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.424+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb414103f70 con 0x7fb4141094a0 2024-09-21T06:10:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.426+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb3fc042030 con 0x7fb4141094a0 2024-09-21T06:10:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.426+0000 7fb418917640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4000b6510 0x7fb4000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.427+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fb3fc107b60 con 0x7fb4141094a0 2024-09-21T06:10:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.427+0000 7fb412ffd640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4000b6510 0x7fb4000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.427+0000 7fb412ffd640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4000b6510 0x7fb4000b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009c20 tx=0x7fb40c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.431+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3fc0ce090 con 0x7fb4141094a0 2024-09-21T06:10:55.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.660+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb41419b560 con 0x7fb4141094a0 2024-09-21T06:10:55.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.691+0000 7fb418917640 1 -- 172.21.15.17:0/3310520764 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fb3fc0d2470 con 0x7fb4141094a0 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4000b6510 msgr2=0x7fb4000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4000b6510 0x7fb4000b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009c20 tx=0x7fb40c005f90 comp rx=0 tx=0).stop 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 msgr2=0x7fb41419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb41419a9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004770 tx=0x7fb3fc004040 comp rx=0 tx=0).stop 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 shutdown_connections 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb4000b6510 0x7fb4000b8a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141094a0 0x7fb41419a9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb414109df0 0x7fb41419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 --2- 172.21.15.17:0/3310520764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb414103b60 0x7fb41419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 >> 172.21.15.17:0/3310520764 conn(0x7fb41407b850 msgr2=0x7fb4141055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 shutdown_connections 2024-09-21T06:10:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:55.693+0000 7fb419919640 1 -- 172.21.15.17:0/3310520764 wait complete. 2024-09-21T06:10:55.988 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:55 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3310520764' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:10:56.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:55 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3310520764' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:10:56.017 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:55 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3310520764' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:10:56.486 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:10:56.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T06:10:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:56.867 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:56 smithi017 ceph-mon[31080]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:56.867 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:56 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3310520764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:10:56.867 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:56 smithi017 ceph-mon[31080]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:57.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:56 smithi081 ceph-mon[33870]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:57.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:56 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3310520764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:10:57.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:56 smithi081 ceph-mon[33870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:56 smithi089 ceph-mon[33879]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:56 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3310520764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:10:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:56 smithi089 ceph-mon[33879]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:57.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 -- 172.21.15.17:0/42665237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 msgr2=0x7fb8b810f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/42665237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b810f780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a410 comp rx=0 tx=0).stop 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 -- 172.21.15.17:0/42665237 shutdown_connections 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/42665237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b810f780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/42665237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 0x7fb8b8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/42665237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b81031c0 0x7fb8b81035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 -- 172.21.15.17:0/42665237 >> 172.21.15.17:0/42665237 conn(0x7fb8b8079e30 msgr2=0x7fb8b807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 -- 172.21.15.17:0/42665237 shutdown_connections 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.206+0000 7fb8bf38f640 1 -- 172.21.15.17:0/42665237 wait complete. 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 Processor -- start 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 -- start start 2024-09-21T06:10:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b81031c0 0x7fb8b819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 0x7fb8b819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b8112ac0 con 0x7fb8b8108f50 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b8112940 con 0x7fb8b8108600 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bf38f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b8112c40 con 0x7fb8b81031c0 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bd92c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bd92c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b819bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39552/0 (socket says 172.21.15.17:39552) 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bd92c640 1 -- 172.21.15.17:0/846768126 learned_addr learned my addr 172.21.15.17:0/846768126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.207+0000 7fb8bd12b640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b81031c0 0x7fb8b819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bc92a640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 0x7fb8b819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bd92c640 1 -- 172.21.15.17:0/846768126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b81031c0 msgr2=0x7fb8b819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bd92c640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b81031c0 0x7fb8b819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bd92c640 1 -- 172.21.15.17:0/846768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 msgr2=0x7fb8b819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bd92c640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 0x7fb8b819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bd92c640 1 -- 172.21.15.17:0/846768126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b81a65f0 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bc92a640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 0x7fb8b819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bd92c640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b819bdf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0004770 tx=0x7fb8b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b003f030 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8b0004440 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035070 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b81a6880 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.208+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b81a6d60 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.209+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b81035d0 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.212+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb8b0042030 con 0x7fb8b8108f50 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.212+0000 7fb8ae7fc640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8a40b6510 0x7fb8a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.213+0000 7fb8bd12b640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8a40b6510 0x7fb8a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:57.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.213+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fb8b0107e90 con 0x7fb8b8108f50 2024-09-21T06:10:57.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.213+0000 7fb8bd12b640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8a40b6510 0x7fb8a40b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb8b81029e0 tx=0x7fb8b40075b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:57.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.216+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8b00ce3c0 con 0x7fb8b8108f50 2024-09-21T06:10:57.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.451+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fb8b810ad40 con 0x7fb8b8108f50 2024-09-21T06:10:57.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.698+0000 7fb8ae7fc640 1 -- 172.21.15.17:0/846768126 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fb8b00d27a0 con 0x7fb8b8108f50 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8a40b6510 msgr2=0x7fb8a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8a40b6510 0x7fb8a40b8a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb8b81029e0 tx=0x7fb8b40075b0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 msgr2=0x7fb8b819bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b819bdf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0004770 tx=0x7fb8b0004040 comp rx=0 tx=0).stop 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 shutdown_connections 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8a40b6510 0x7fb8a40b8a20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8b8108f50 0x7fb8b819bdf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b8108600 0x7fb8b819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 --2- 172.21.15.17:0/846768126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8b81031c0 0x7fb8b819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:57.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 >> 172.21.15.17:0/846768126 conn(0x7fb8b8079e30 msgr2=0x7fb8b8106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:57.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 shutdown_connections 2024-09-21T06:10:57.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:57.701+0000 7fb8bf38f640 1 -- 172.21.15.17:0/846768126 wait complete. 2024-09-21T06:10:58.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:57 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/846768126' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:10:58.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:57 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/846768126' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:10:58.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:57 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/846768126' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:10:58.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T06:10:58.848 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/846768126' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:10:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:58 smithi017 ceph-mon[31080]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:10:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:10:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/846768126' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:10:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:10:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:10:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:58 smithi081 ceph-mon[33870]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/846768126' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:10:59.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:58 smithi089 ceph-mon[33879]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:10:59.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 -- 172.21.15.17:0/1322053119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 msgr2=0x7f12fc1066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:59.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 --2- 172.21.15.17:0/1322053119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc1066c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009900 tx=0x7f12f002a410 comp rx=0 tx=0).stop 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 -- 172.21.15.17:0/1322053119 shutdown_connections 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 --2- 172.21.15.17:0/1322053119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc1066c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 --2- 172.21.15.17:0/1322053119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc106c00 0x7f12fc110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 --2- 172.21.15.17:0/1322053119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12fc1020c0 0x7f12fc1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 -- 172.21.15.17:0/1322053119 >> 172.21.15.17:0/1322053119 conn(0x7f12fc077cc0 msgr2=0x7f12fc078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 -- 172.21.15.17:0/1322053119 shutdown_connections 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.348+0000 7f130240d640 1 -- 172.21.15.17:0/1322053119 wait complete. 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.349+0000 7f130240d640 1 Processor -- start 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.349+0000 7f130240d640 1 -- start start 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.349+0000 7f130240d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 0x7f12fc19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.349+0000 7f130240d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f130240d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12fc106c00 0x7f12fc1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:59.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f130240d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc113980 con 0x7f12fc1062b0 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f130240d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc113800 con 0x7f12fc1020c0 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f130240d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc113b00 con 0x7f12fc106c00 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 0x7f12fc19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 0x7f12fc19c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:50748/0 (socket says 172.21.15.17:50748) 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41282/0 (socket says 172.21.15.17:41282) 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 -- 172.21.15.17:0/2925880113 learned_addr learned my addr 172.21.15.17:0/2925880113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f13009aa640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12fc106c00 0x7f12fc1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 -- 172.21.15.17:0/2925880113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12fc106c00 msgr2=0x7f12fc1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12fc106c00 0x7f12fc1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 -- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 msgr2=0x7f12fc19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 -- 172.21.15.17:0/2925880113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc1a25a0 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12fbfff640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 0x7f12fc19c630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00d770 tx=0x7f12ec00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec017070 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.350+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12fc1a2890 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.351+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12fc1a8ff0 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.351+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12ec009c30 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.351+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec003c50 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.351+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12fc06b850 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.353+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f12ec003df0 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.354+0000 7f12f97fa640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e40b6510 0x7f12e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.354+0000 7f12fb7fe640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e40b6510 0x7f12e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.354+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f12ec0e7480 con 0x7f12fc1020c0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.355+0000 7f12fb7fe640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e40b6510 0x7f12e40b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12f0005940 tx=0x7f12f00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:10:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.357+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12ec0ad9b0 con 0x7f12fc1020c0 2024-09-21T06:10:59.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.588+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f12fc1024d0 con 0x7f12fc1020c0 2024-09-21T06:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.723+0000 7f12f97fa640 1 -- 172.21.15.17:0/2925880113 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f12ec009de0 con 0x7f12fc1020c0 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.725+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e40b6510 msgr2=0x7f12e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.725+0000 7f130240d640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e40b6510 0x7f12e40b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12f0005940 tx=0x7f12f00058d0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 msgr2=0x7f12fc19c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 0x7f12fc19c630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00d770 tx=0x7f12ec00dc30 comp rx=0 tx=0).stop 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 shutdown_connections 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e40b6510 0x7f12e40b8a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12fc1062b0 0x7f12fc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12fc106c00 0x7f12fc1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 --2- 172.21.15.17:0/2925880113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12fc1020c0 0x7f12fc19c630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 >> 172.21.15.17:0/2925880113 conn(0x7f12fc077cc0 msgr2=0x7f12fc107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 shutdown_connections 2024-09-21T06:10:59.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:10:59.726+0000 7f130240d640 1 -- 172.21.15.17:0/2925880113 wait complete. 2024-09-21T06:10:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] up:active 2024-09-21T06:10:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:10:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:10:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: Cluster is now healthy 2024-09-21T06:10:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:10:59.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:10:59.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:10:59.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2925880113' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:10:59.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:10:59 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:11:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] up:active 2024-09-21T06:11:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:11:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:11:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: Cluster is now healthy 2024-09-21T06:11:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:11:00.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:11:00.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:11:00.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2925880113' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:11:00.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:10:59 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:11:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] up:active 2024-09-21T06:11:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:11:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:11:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: Cluster is now healthy 2024-09-21T06:11:00.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:11:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:11:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:11:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2925880113' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:11:00.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:10:59 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:11:00.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T06:11:00.687 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:00.976 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:00 smithi017 ceph-mon[31080]: pgmap v319: 129 pgs: 129 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:00.976 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:00 smithi017 ceph-mon[31080]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:11:00.976 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:00 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] up:active 2024-09-21T06:11:00.976 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:00 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:11:00.976 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:00 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:11:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:00 smithi081 ceph-mon[33870]: pgmap v319: 129 pgs: 129 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:00 smithi081 ceph-mon[33870]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:11:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:00 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] up:active 2024-09-21T06:11:01.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:00 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:11:01.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:00 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:11:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:00 smithi089 ceph-mon[33879]: pgmap v319: 129 pgs: 129 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:00 smithi089 ceph-mon[33879]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:11:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:00 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] up:active 2024-09-21T06:11:01.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:00 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:11:01.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:00 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:11:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 -- 172.21.15.17:0/1064664594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 msgr2=0x7ff0dc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 --2- 172.21.15.17:0/1064664594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc1098d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009900 tx=0x7ff0d002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 -- 172.21.15.17:0/1064664594 shutdown_connections 2024-09-21T06:11:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 --2- 172.21.15.17:0/1064664594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc1098d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 --2- 172.21.15.17:0/1064664594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0dc109e10 0x7ff0dc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 --2- 172.21.15.17:0/1064664594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0dc103b80 0x7ff0dc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.171+0000 7ff0e3570640 1 -- 172.21.15.17:0/1064664594 >> 172.21.15.17:0/1064664594 conn(0x7ff0dc0ff610 msgr2=0x7ff0dc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.172+0000 7ff0e3570640 1 -- 172.21.15.17:0/1064664594 shutdown_connections 2024-09-21T06:11:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.172+0000 7ff0e3570640 1 -- 172.21.15.17:0/1064664594 wait complete. 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.172+0000 7ff0e3570640 1 Processor -- start 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.172+0000 7ff0e3570640 1 -- start start 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e3570640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0dc103b80 0x7ff0dc19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e3570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e3570640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0dc109e10 0x7ff0dc1a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e3570640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc1139a0 con 0x7ff0dc1094c0 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e3570640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc113820 con 0x7ff0dc109e10 2024-09-21T06:11:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e3570640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc113b20 con 0x7ff0dc103b80 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41292/0 (socket says 172.21.15.17:41292) 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 -- 172.21.15.17:0/3867591489 learned_addr learned my addr 172.21.15.17:0/3867591489 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e130c640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0dc103b80 0x7ff0dc19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e1b0d640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0dc109e10 0x7ff0dc1a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 -- 172.21.15.17:0/3867591489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0dc103b80 msgr2=0x7ff0dc19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0dc103b80 0x7ff0dc19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 -- 172.21.15.17:0/3867591489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0dc109e10 msgr2=0x7ff0dc1a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0dc109e10 0x7ff0dc1a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 -- 172.21.15.17:0/3867591489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc1a2560 con 0x7ff0dc1094c0 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.173+0000 7ff0e0b0b640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc19cc50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005940 tx=0x7ff0d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.174+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d003f030 con 0x7ff0dc1094c0 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.174+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc1a27f0 con 0x7ff0dc1094c0 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.174+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0d0003c90 con 0x7ff0dc1094c0 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.174+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0035070 con 0x7ff0dc1094c0 2024-09-21T06:11:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.174+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc1a9070 con 0x7ff0dc1094c0 2024-09-21T06:11:01.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.175+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc104e00 con 0x7ff0dc1094c0 2024-09-21T06:11:01.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.176+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff0d0042030 con 0x7ff0dc1094c0 2024-09-21T06:11:01.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.177+0000 7ff0da7fc640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff0c40b6540 0x7ff0c40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.177+0000 7ff0e130c640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff0c40b6540 0x7ff0c40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.177+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff0d0107f60 con 0x7ff0dc1094c0 2024-09-21T06:11:01.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.178+0000 7ff0e130c640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff0c40b6540 0x7ff0c40b8a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009990 tx=0x7ff0d4009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.180+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0d00ce490 con 0x7ff0dc1094c0 2024-09-21T06:11:01.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.411+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff0dc1a9240 con 0x7ff0dc1094c0 2024-09-21T06:11:01.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.725+0000 7ff0da7fc640 1 -- 172.21.15.17:0/3867591489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7ff0d00d2870 con 0x7ff0dc1094c0 2024-09-21T06:11:01.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff0c40b6540 msgr2=0x7ff0c40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff0c40b6540 0x7ff0c40b8a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009990 tx=0x7ff0d4009110 comp rx=0 tx=0).stop 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 msgr2=0x7ff0dc19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc19cc50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005940 tx=0x7ff0d00042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 shutdown_connections 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff0c40b6540 0x7ff0c40b8a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc1094c0 0x7ff0dc19cc50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0dc109e10 0x7ff0dc1a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 --2- 172.21.15.17:0/3867591489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0dc103b80 0x7ff0dc19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 >> 172.21.15.17:0/3867591489 conn(0x7ff0dc0ff610 msgr2=0x7ff0dc108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 shutdown_connections 2024-09-21T06:11:01.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:01.728+0000 7ff0e3570640 1 -- 172.21.15.17:0/3867591489 wait complete. 2024-09-21T06:11:02.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3867591489' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:11:02.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3867591489' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:11:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3867591489' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:11:02.423 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T06:11:02.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T06:11:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:02 smithi081 ceph-mon[33870]: pgmap v320: 129 pgs: 129 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 938 B/s wr, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:03.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:02 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3867591489' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:11:03.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:02 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:11:03.010 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:11:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: 2024-09-21T06:11:02.680+0000 7fa71b654640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T06:11:03.010 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:11:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: 2024-09-21T06:11:02.680+0000 7fa71b654640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T06:11:03.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:02 smithi017 ceph-mon[31080]: pgmap v320: 129 pgs: 129 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 938 B/s wr, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:03.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:02 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3867591489' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:11:03.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:02 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:11:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:02 smithi089 ceph-mon[33879]: pgmap v320: 129 pgs: 129 active+clean; 582 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 938 B/s wr, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:02 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3867591489' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:11:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:02 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:11:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.165+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/2261711812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8103b60 msgr2=0x7fd4b8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.165+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/2261711812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8103b60 0x7fd4b8103f70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009900 tx=0x7fd4a802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/2261711812 shutdown_connections 2024-09-21T06:11:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/2261711812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4b8109df0 0x7fd4b8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/2261711812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b81094a0 0x7fd4b81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/2261711812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8103b60 0x7fd4b8103f70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/2261711812 >> 172.21.15.17:0/2261711812 conn(0x7fd4b807b850 msgr2=0x7fd4b807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/2261711812 shutdown_connections 2024-09-21T06:11:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.166+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/2261711812 wait complete. 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 Processor -- start 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 -- start start 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8103b60 0x7fd4b819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4b81094a0 0x7fd4b819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 0x7fd4b819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8113960 con 0x7fd4b8109df0 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b81137e0 con 0x7fd4b8103b60 2024-09-21T06:11:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4bcb0f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8113ae0 con 0x7fd4b81094a0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 0x7fd4b819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 0x7fd4b819fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41316/0 (socket says 172.21.15.17:41316) 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4b6d9d640 1 -- 172.21.15.17:0/181446450 learned_addr learned my addr 172.21.15.17:0/181446450 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4affff640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4b81094a0 0x7fd4b819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.167+0000 7fd4b659c640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8103b60 0x7fd4b819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4b6d9d640 1 -- 172.21.15.17:0/181446450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4b81094a0 msgr2=0x7fd4b819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4b6d9d640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4b81094a0 0x7fd4b819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4b6d9d640 1 -- 172.21.15.17:0/181446450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8103b60 msgr2=0x7fd4b819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4b6d9d640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8103b60 0x7fd4b819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4b6d9d640 1 -- 172.21.15.17:0/181446450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b81a0320 con 0x7fd4b8109df0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4b6d9d640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 0x7fd4b819fbf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000eaa0 tx=0x7fd4b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b000cdb0 con 0x7fd4b8109df0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b81a0610 con 0x7fd4b8109df0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4b0005020 con 0x7fd4b8109df0 2024-09-21T06:11:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00116d0 con 0x7fd4b8109df0 2024-09-21T06:11:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.168+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b81a6d70 con 0x7fd4b8109df0 2024-09-21T06:11:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.169+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b8103f70 con 0x7fd4b8109df0 2024-09-21T06:11:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.171+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd4b0004a40 con 0x7fd4b8109df0 2024-09-21T06:11:03.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.172+0000 7fd4af7fe640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4a40b6510 0x7fd4a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:03.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.172+0000 7fd4b659c640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4a40b6510 0x7fd4a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:03.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.172+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fd4b00e7aa0 con 0x7fd4b8109df0 2024-09-21T06:11:03.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.172+0000 7fd4b659c640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4a40b6510 0x7fd4a40b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80057c0 tx=0x7fd4a80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:03.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.175+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4b0016030 con 0x7fd4b8109df0 2024-09-21T06:11:03.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.391+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd4b8063800 con 0x7fd4a40b6510 2024-09-21T06:11:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.413+0000 7fd4af7fe640 1 -- 172.21.15.17:0/181446450 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd4b8063800 con 0x7fd4a40b6510 2024-09-21T06:11:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.415+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4a40b6510 msgr2=0x7fd4a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.415+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4a40b6510 0x7fd4a40b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80057c0 tx=0x7fd4a80058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.415+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 msgr2=0x7fd4b819fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.415+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 0x7fd4b819fbf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000eaa0 tx=0x7fd4b000ef60 comp rx=0 tx=0).stop 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 shutdown_connections 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd4a40b6510 0x7fd4a40b8a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4b8109df0 0x7fd4b819fbf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4b81094a0 0x7fd4b819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 --2- 172.21.15.17:0/181446450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4b8103b60 0x7fd4b819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 >> 172.21.15.17:0/181446450 conn(0x7fd4b807b850 msgr2=0x7fd4b81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:03.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 shutdown_connections 2024-09-21T06:11:03.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:03.416+0000 7fd4bcb0f640 1 -- 172.21.15.17:0/181446450 wait complete. 2024-09-21T06:11:03.825 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:11:03 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:11:03.396+0000 7f4b9c0d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:11:03.825 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:11:03 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:11:03.396+0000 7f4b9c0d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:11:03.826 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:11:03 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:11:03.396+0000 7f4b9c0d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:11:03.826 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:11:03 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:11:03.396+0000 7f4b9c0d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:11:03.826 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:11:03 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:11:03.396+0000 7f4b9c0d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:11:04.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T06:11:04.307 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 -- 172.21.15.17:0/2566876624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 msgr2=0x7fa2681087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 --2- 172.21.15.17:0/2566876624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2681087c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009900 tx=0x7fa25c02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 -- 172.21.15.17:0/2566876624 shutdown_connections 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 --2- 172.21.15.17:0/2566876624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2681087c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 --2- 172.21.15.17:0/2566876624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa268108d00 0x7fa26810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 --2- 172.21.15.17:0/2566876624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa268102a70 0x7fa268102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 -- 172.21.15.17:0/2566876624 >> 172.21.15.17:0/2566876624 conn(0x7fa268079710 msgr2=0x7fa268079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 -- 172.21.15.17:0/2566876624 shutdown_connections 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 -- 172.21.15.17:0/2566876624 wait complete. 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.786+0000 7fa26efe4640 1 Processor -- start 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 -- start start 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa268102a70 0x7fa2680ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2680ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa268108d00 0x7fa268100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa268112870 con 0x7fa2681083b0 2024-09-21T06:11:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2681126f0 con 0x7fa268102a70 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26efe4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa2681129f0 con 0x7fa268108d00 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2680ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2680ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41340/0 (socket says 172.21.15.17:41340) 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 -- 172.21.15.17:0/4249413214 learned_addr learned my addr 172.21.15.17:0/4249413214 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26cd80640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa268102a70 0x7fa2680ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa26d581640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa268108d00 0x7fa268100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 -- 172.21.15.17:0/4249413214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa268108d00 msgr2=0x7fa268100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa268108d00 0x7fa268100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 -- 172.21.15.17:0/4249413214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa268102a70 msgr2=0x7fa2680ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa268102a70 0x7fa2680ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.787+0000 7fa267fff640 1 -- 172.21.15.17:0/4249413214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2681a86b0 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.788+0000 7fa267fff640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2680ffb30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa25c005940 tx=0x7fa25c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.788+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c03f030 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.788+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa25c003a80 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.788+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2681a8940 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.788+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c035070 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.788+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2681a8e70 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.789+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa268103cf0 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.791+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa25c042030 con 0x7fa2681083b0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.791+0000 7fa265ffb640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa2500b6590 0x7fa2500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.791+0000 7fa26cd80640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa2500b6590 0x7fa2500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.791+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fa25c107a60 con 0x7fa2681083b0 2024-09-21T06:11:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.792+0000 7fa26cd80640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa2500b6590 0x7fa2500b8aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa268101040 tx=0x7fa25800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:04.796+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa25c0d2370 con 0x7fa2681083b0 2024-09-21T06:11:05.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:04 smithi081 ceph-mon[33870]: pgmap v321: 129 pgs: 129 active+clean; 584 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:05.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:04 smithi081 ceph-mon[33870]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:05.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.013+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa268063800 con 0x7fa2500b6590 2024-09-21T06:11:05.015 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:04 smithi017 ceph-mon[31080]: pgmap v321: 129 pgs: 129 active+clean; 584 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:05.016 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:04 smithi017 ceph-mon[31080]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:05.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.041+0000 7fa265ffb640 1 -- 172.21.15.17:0/4249413214 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa268063800 con 0x7fa2500b6590 2024-09-21T06:11:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa2500b6590 msgr2=0x7fa2500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa2500b6590 0x7fa2500b8aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa268101040 tx=0x7fa25800b390 comp rx=0 tx=0).stop 2024-09-21T06:11:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 msgr2=0x7fa2680ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2680ffb30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa25c005940 tx=0x7fa25c0040e0 comp rx=0 tx=0).stop 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 shutdown_connections 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fa2500b6590 0x7fa2500b8aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2681083b0 0x7fa2680ffb30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa268108d00 0x7fa268100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 --2- 172.21.15.17:0/4249413214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa268102a70 0x7fa2680ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.043+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 >> 172.21.15.17:0/4249413214 conn(0x7fa268079710 msgr2=0x7fa268101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.044+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 shutdown_connections 2024-09-21T06:11:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:05.044+0000 7fa26efe4640 1 -- 172.21.15.17:0/4249413214 wait complete. 2024-09-21T06:11:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:04 smithi089 ceph-mon[33879]: pgmap v321: 129 pgs: 129 active+clean; 584 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.9 KiB/s wr, 8 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T06:11:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:04 smithi089 ceph-mon[33879]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:05.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T06:11:05.986 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 -- 172.21.15.17:0/1359358047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824109e40 msgr2=0x7f8824110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1359358047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824109e40 0x7f8824110670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8814009ca0 tx=0x7f881402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 -- 172.21.15.17:0/1359358047 shutdown_connections 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1359358047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824109e40 0x7f8824110670 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1359358047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88241094f0 0x7f8824109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1359358047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8824103bb0 0x7f8824103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 -- 172.21.15.17:0/1359358047 >> 172.21.15.17:0/1359358047 conn(0x7f88240ff600 msgr2=0x7f8824101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 -- 172.21.15.17:0/1359358047 shutdown_connections 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.533+0000 7f882b4c3640 1 -- 172.21.15.17:0/1359358047 wait complete. 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 Processor -- start 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 -- start start 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8824103bb0 0x7f8824075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 0x7f8824075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8824109e40 0x7f8824076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8824113a00 con 0x7f88241094f0 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8824113880 con 0x7f8824103bb0 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f882b4c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8824113b80 con 0x7f8824109e40 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f8828a5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 0x7f8824075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f8828a5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 0x7f8824075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41356/0 (socket says 172.21.15.17:41356) 2024-09-21T06:11:06.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.534+0000 7f8828a5e640 1 -- 172.21.15.17:0/1177281004 learned_addr learned my addr 172.21.15.17:0/1177281004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f882925f640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8824103bb0 0x7f8824075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8829a60640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8824109e40 0x7f8824076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8828a5e640 1 -- 172.21.15.17:0/1177281004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8824109e40 msgr2=0x7f8824076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8828a5e640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8824109e40 0x7f8824076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8828a5e640 1 -- 172.21.15.17:0/1177281004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8824103bb0 msgr2=0x7f8824075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8828a5e640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8824103bb0 0x7f8824075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8828a5e640 1 -- 172.21.15.17:0/1177281004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88241a8670 con 0x7f88241094f0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f8828a5e640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 0x7f8824075c50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f881800d750 tx=0x7f881800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818017070 con 0x7f88241094f0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88180054b0 con 0x7f88241094f0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818004bc0 con 0x7f88241094f0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88241a8960 con 0x7f88241094f0 2024-09-21T06:11:06.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.535+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88241a8ea0 con 0x7f88241094f0 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.536+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8824103fc0 con 0x7f88241094f0 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.538+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8818009c30 con 0x7f88241094f0 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.539+0000 7f88227fc640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f880c0b6620 0x7f880c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.539+0000 7f882925f640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f880c0b6620 0x7f880c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.539+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f88180e7680 con 0x7f88241094f0 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.539+0000 7f882925f640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f880c0b6620 0x7f880c0b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8824077160 tx=0x7f881c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.542+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88180ada70 con 0x7f88241094f0 2024-09-21T06:11:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.760+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8824063800 con 0x7f880c0b6620 2024-09-21T06:11:06.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.766+0000 7f88227fc640 1 -- 172.21.15.17:0/1177281004 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8824063800 con 0x7f880c0b6620 2024-09-21T06:11:06.768 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_0/d5efea2b-aa59-44db-b6b8-34a1fe3caa14 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f880c0b6620 msgr2=0x7f880c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f880c0b6620 0x7f880c0b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8824077160 tx=0x7f881c00b390 comp rx=0 tx=0).stop 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 msgr2=0x7f8824075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 0x7f8824075c50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f881800d750 tx=0x7f881800dc10 comp rx=0 tx=0).stop 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 shutdown_connections 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f880c0b6620 0x7f880c0b8b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88241094f0 0x7f8824075c50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8824109e40 0x7f8824076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 --2- 172.21.15.17:0/1177281004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8824103bb0 0x7f8824075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 >> 172.21.15.17:0/1177281004 conn(0x7f88240ff600 msgr2=0x7f8824101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 shutdown_connections 2024-09-21T06:11:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:06.768+0000 7f882b4c3640 1 -- 172.21.15.17:0/1177281004 wait complete. 2024-09-21T06:11:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:06 smithi081 ceph-mon[33870]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:06 smithi081 ceph-mon[33870]: pgmap v322: 129 pgs: 129 active+clean; 584 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-21T06:11:07.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:06 smithi081 ceph-mon[33870]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T06:11:07.086 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:06 smithi017 ceph-mon[31080]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:07.086 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:06 smithi017 ceph-mon[31080]: pgmap v322: 129 pgs: 129 active+clean; 584 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-21T06:11:07.086 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:06 smithi017 ceph-mon[31080]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T06:11:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:06 smithi089 ceph-mon[33879]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:06 smithi089 ceph-mon[33879]: pgmap v322: 129 pgs: 129 active+clean; 584 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-21T06:11:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:06 smithi089 ceph-mon[33879]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T06:11:07.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T06:11:07.767 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:08.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:07 smithi081 ceph-mon[33870]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:08.029 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:07 smithi017 ceph-mon[31080]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:08.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:07 smithi089 ceph-mon[33879]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:08.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 -- 172.21.15.17:0/3331356570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 msgr2=0x7f9b94102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:08.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 --2- 172.21.15.17:0/3331356570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b94102eb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009900 tx=0x7f9b8402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 -- 172.21.15.17:0/3331356570 shutdown_connections 2024-09-21T06:11:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 --2- 172.21.15.17:0/3331356570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94108d30 0x7f9b9410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 --2- 172.21.15.17:0/3331356570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b941083e0 0x7f9b941087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 --2- 172.21.15.17:0/3331356570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b94102eb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.239+0000 7f9b99303640 1 -- 172.21.15.17:0/3331356570 >> 172.21.15.17:0/3331356570 conn(0x7f9b940797e0 msgr2=0x7f9b94079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.240+0000 7f9b99303640 1 -- 172.21.15.17:0/3331356570 shutdown_connections 2024-09-21T06:11:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.240+0000 7f9b99303640 1 -- 172.21.15.17:0/3331356570 wait complete. 2024-09-21T06:11:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.240+0000 7f9b99303640 1 Processor -- start 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.240+0000 7f9b99303640 1 -- start start 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b99303640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b9419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b99303640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b941083e0 0x7f9b9419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b99303640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94108d30 0x7f9b9419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b99303640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94112850 con 0x7f9b94102aa0 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b99303640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b941126d0 con 0x7f9b941083e0 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b99303640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9b941129d0 con 0x7f9b94108d30 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b9419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b9419a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41384/0 (socket says 172.21.15.17:41384) 2024-09-21T06:11:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 -- 172.21.15.17:0/331946861 learned_addr learned my addr 172.21.15.17:0/331946861 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b937fe640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94108d30 0x7f9b9419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b927fc640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b941083e0 0x7f9b9419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 -- 172.21.15.17:0/331946861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94108d30 msgr2=0x7f9b9419fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94108d30 0x7f9b9419fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 -- 172.21.15.17:0/331946861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b941083e0 msgr2=0x7f9b9419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b941083e0 0x7f9b9419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.241+0000 7f9b92ffd640 1 -- 172.21.15.17:0/331946861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b941a02c0 con 0x7f9b94102aa0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.242+0000 7f9b92ffd640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b9419a350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009230 tx=0x7f9b84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.242+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8403f030 con 0x7f9b94102aa0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.242+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b941a0550 con 0x7f9b94102aa0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.242+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b84003a80 con 0x7f9b94102aa0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.242+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b84035070 con 0x7f9b94102aa0 2024-09-21T06:11:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.242+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b941a6d10 con 0x7f9b94102aa0 2024-09-21T06:11:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.243+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b94102eb0 con 0x7f9b94102aa0 2024-09-21T06:11:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.245+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9b84042030 con 0x7f9b94102aa0 2024-09-21T06:11:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.245+0000 7f9b7bfff640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9b7c0b65a0 0x7f9b7c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.245+0000 7f9b927fc640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9b7c0b65a0 0x7f9b7c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.246+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f9b841082d0 con 0x7f9b94102aa0 2024-09-21T06:11:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.246+0000 7f9b927fc640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9b7c0b65a0 0x7f9b7c0b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b94079d10 tx=0x7f9b8800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:08.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.253+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b840d2a80 con 0x7f9b94102aa0 2024-09-21T06:11:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.468+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9b94106380 con 0x7f9b7c0b65a0 2024-09-21T06:11:08.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.496+0000 7f9b7bfff640 1 -- 172.21.15.17:0/331946861 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9b94106380 con 0x7f9b7c0b65a0 2024-09-21T06:11:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9b7c0b65a0 msgr2=0x7f9b7c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9b7c0b65a0 0x7f9b7c0b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b94079d10 tx=0x7f9b8800b390 comp rx=0 tx=0).stop 2024-09-21T06:11:08.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 msgr2=0x7f9b9419a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b9419a350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009230 tx=0x7f9b84004270 comp rx=0 tx=0).stop 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 shutdown_connections 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9b7c0b65a0 0x7f9b7c0b8ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b94108d30 0x7f9b9419fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b941083e0 0x7f9b9419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 --2- 172.21.15.17:0/331946861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b94102aa0 0x7f9b9419a350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.498+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 >> 172.21.15.17:0/331946861 conn(0x7f9b940797e0 msgr2=0x7f9b94101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.499+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 shutdown_connections 2024-09-21T06:11:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:08.499+0000 7f9b99303640 1 -- 172.21.15.17:0/331946861 wait complete. 2024-09-21T06:11:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:08 smithi081 ceph-mon[33870]: pgmap v323: 129 pgs: 129 active+clean; 606 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-21T06:11:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:08 smithi089 ceph-mon[33879]: pgmap v323: 129 pgs: 129 active+clean; 606 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-21T06:11:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:08 smithi017 ceph-mon[31080]: pgmap v323: 129 pgs: 129 active+clean; 606 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-21T06:11:09.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T06:11:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:09.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:09 smithi017 ceph-mon[31080]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 -- 172.21.15.17:0/3154820423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c107b80 msgr2=0x7fcc5c107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 --2- 172.21.15.17:0/3154820423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c107b80 0x7fcc5c107f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009900 tx=0x7fcc5002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 -- 172.21.15.17:0/3154820423 shutdown_connections 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 --2- 172.21.15.17:0/3154820423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c107b80 0x7fcc5c107f90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 --2- 172.21.15.17:0/3154820423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c10ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 --2- 172.21.15.17:0/3154820423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 -- 172.21.15.17:0/3154820423 >> 172.21.15.17:0/3154820423 conn(0x7fcc5c079f90 msgr2=0x7fcc5c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 -- 172.21.15.17:0/3154820423 shutdown_connections 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.945+0000 7fcc61e36640 1 -- 172.21.15.17:0/3154820423 wait complete. 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 Processor -- start 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 -- start start 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c0fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc5c107b80 0x7fcc5c0ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c0ff870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c1117c0 con 0x7fcc5c1084d0 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c111640 con 0x7fcc5c102240 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc61e36640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c111940 con 0x7fcc5c107b80 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc5bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c0ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c0fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc5bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c0ff870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39952/0 (socket says 172.21.15.17:39952) 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c0fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:38760/0 (socket says 172.21.15.17:38760) 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.946+0000 7fcc5bfff640 1 -- 172.21.15.17:0/1309774986 learned_addr learned my addr 172.21.15.17:0/1309774986 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5affd640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc5c107b80 0x7fcc5c0ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5bfff640 1 -- 172.21.15.17:0/1309774986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc5c107b80 msgr2=0x7fcc5c0ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5bfff640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc5c107b80 0x7fcc5c0ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5bfff640 1 -- 172.21.15.17:0/1309774986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 msgr2=0x7fcc5c0fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5bfff640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c0fedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5bfff640 1 -- 172.21.15.17:0/1309774986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c1a8750 con 0x7fcc5c1084d0 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5b7fe640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c0fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc5bfff640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c0ff870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400cad0 tx=0x7fcc5400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400ae20 con 0x7fcc5c1084d0 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c1a8a40 con 0x7fcc5c1084d0 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc54005020 con 0x7fcc5c1084d0 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400f6b0 con 0x7fcc5c1084d0 2024-09-21T06:11:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.947+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c1a8f50 con 0x7fcc5c1084d0 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.948+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5c102650 con 0x7fcc5c1084d0 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.950+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcc540051d0 con 0x7fcc5c1084d0 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.951+0000 7fcc58ff9640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcc440b65a0 0x7fcc440b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.951+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fcc540e7ad0 con 0x7fcc5c1084d0 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.951+0000 7fcc5b7fe640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcc440b65a0 0x7fcc440b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.951+0000 7fcc5b7fe640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcc440b65a0 0x7fcc440b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c100840 tx=0x7fcc4c00b490 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:09.954+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc54014030 con 0x7fcc5c1084d0 2024-09-21T06:11:10.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:09 smithi081 ceph-mon[33870]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:10.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:09 smithi089 ceph-mon[33879]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:10.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.178+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fcc5c063800 con 0x7fcc440b65a0 2024-09-21T06:11:10.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.183+0000 7fcc58ff9640 1 -- 172.21.15.17:0/1309774986 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fcc5c063800 con 0x7fcc440b65a0 2024-09-21T06:11:10.186 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/qa/sv_1/083ac5f4-d521-4f76-beee-9f4b5ab2a6d4 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcc440b65a0 msgr2=0x7fcc440b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcc440b65a0 0x7fcc440b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c100840 tx=0x7fcc4c00b490 comp rx=0 tx=0).stop 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 msgr2=0x7fcc5c0ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c0ff870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400cad0 tx=0x7fcc5400cf90 comp rx=0 tx=0).stop 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 shutdown_connections 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fcc440b65a0 0x7fcc440b8ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc5c1084d0 0x7fcc5c0ff870 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc5c107b80 0x7fcc5c0ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 --2- 172.21.15.17:0/1309774986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc5c102240 0x7fcc5c0fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 >> 172.21.15.17:0/1309774986 conn(0x7fcc5c079f90 msgr2=0x7fcc5c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 shutdown_connections 2024-09-21T06:11:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:10.186+0000 7fcc61e36640 1 -- 172.21.15.17:0/1309774986 wait complete. 2024-09-21T06:11:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:10 smithi017 ceph-mon[31080]: pgmap v324: 129 pgs: 129 active+clean; 606 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-21T06:11:10.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:11:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:10 smithi081 ceph-mon[33870]: pgmap v324: 129 pgs: 129 active+clean; 606 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-21T06:11:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:10 smithi089 ceph-mon[33879]: pgmap v324: 129 pgs: 129 active+clean; 606 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-21T06:11:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:11.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 -- 172.21.15.17:0/730935695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e8102aa0 msgr2=0x7f39e8102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 --2- 172.21.15.17:0/730935695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e8102aa0 0x7f39e8102eb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009900 tx=0x7f39d802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 -- 172.21.15.17:0/730935695 shutdown_connections 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 --2- 172.21.15.17:0/730935695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 0x7f39e810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 --2- 172.21.15.17:0/730935695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e81083e0 0x7f39e81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 --2- 172.21.15.17:0/730935695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e8102aa0 0x7f39e8102eb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 -- 172.21.15.17:0/730935695 >> 172.21.15.17:0/730935695 conn(0x7f39e8079750 msgr2=0x7f39e8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 -- 172.21.15.17:0/730935695 shutdown_connections 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.644+0000 7f39ed13d640 1 -- 172.21.15.17:0/730935695 wait complete. 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 Processor -- start 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 -- start start 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8102aa0 0x7f39e819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 0x7f39e819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 0x7f39e819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81128a0 con 0x7f39e81083e0 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8112720 con 0x7f39e8108d30 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39ed13d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8112a20 con 0x7f39e8102aa0 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39e659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 0x7f39e819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39e659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 0x7f39e819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39968/0 (socket says 172.21.15.17:39968) 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39e659c640 1 -- 172.21.15.17:0/2060693848 learned_addr learned my addr 172.21.15.17:0/2060693848 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39e6d9d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8102aa0 0x7f39e819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.645+0000 7f39e759e640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 0x7f39e819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e659c640 1 -- 172.21.15.17:0/2060693848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8102aa0 msgr2=0x7f39e819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e659c640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8102aa0 0x7f39e819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e659c640 1 -- 172.21.15.17:0/2060693848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 msgr2=0x7f39e819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e659c640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 0x7f39e819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e659c640 1 -- 172.21.15.17:0/2060693848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e81a02d0 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e759e640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 0x7f39e819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39e659c640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 0x7f39e819a9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c8c0 tx=0x7f39dc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc007bb0 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e81a05c0 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39dc007d50 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e81a6de0 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.646+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc018660 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.647+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e8102eb0 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.649+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f39dc00fa00 con 0x7f39e81083e0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.649+0000 7f39cffff640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d00b65d0 0x7f39d00b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.650+0000 7f39e6d9d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d00b65d0 0x7f39d00b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:11.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.650+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f39dc0e7b20 con 0x7f39e81083e0 2024-09-21T06:11:11.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.650+0000 7f39e6d9d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d00b65d0 0x7f39d00b8ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39d80057c0 tx=0x7f39d80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:11.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.653+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39dc014030 con 0x7f39e81083e0 2024-09-21T06:11:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.881+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39e819b550 con 0x7f39e81083e0 2024-09-21T06:11:11.884 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:11 smithi017 ceph-mon[31080]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:11.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.882+0000 7f39cffff640 1 -- 172.21.15.17:0/2060693848 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11885 (secure 0 0 0) 0x7f39dc0adf80 con 0x7f39e81083e0 2024-09-21T06:11:11.884 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:11.884 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-21T06:11:01:721627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:11:01.413226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:11:11.885 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:11:11.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d00b65d0 msgr2=0x7f39d00b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:11.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d00b65d0 0x7f39d00b8ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39d80057c0 tx=0x7f39d80058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 msgr2=0x7f39e819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:11.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 0x7f39e819a9c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c8c0 tx=0x7f39dc00cd80 comp rx=0 tx=0).stop 2024-09-21T06:11:11.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 shutdown_connections 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f39d00b65d0 0x7f39d00b8ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e81083e0 0x7f39e819a9c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8108d30 0x7f39e819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 --2- 172.21.15.17:0/2060693848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39e8102aa0 0x7f39e819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.884+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 >> 172.21.15.17:0/2060693848 conn(0x7f39e8079750 msgr2=0x7f39e8101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.885+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 shutdown_connections 2024-09-21T06:11:11.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:11.885+0000 7f39ed13d640 1 -- 172.21.15.17:0/2060693848 wait complete. 2024-09-21T06:11:12.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:11 smithi089 ceph-mon[33879]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:12.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:11 smithi081 ceph-mon[33870]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:12.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:11:12.877 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:12.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:12 smithi017 ceph-mon[31080]: pgmap v325: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-21T06:11:12.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:12 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2060693848' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:11:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:12 smithi089 ceph-mon[33879]: pgmap v325: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-21T06:11:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:12 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2060693848' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:11:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:12 smithi081 ceph-mon[33870]: pgmap v325: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2024-09-21T06:11:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:12 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2060693848' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:11:13.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 -- 172.21.15.17:0/658114846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c109df0 msgr2=0x7f010c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 --2- 172.21.15.17:0/658114846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c109df0 0x7f010c110620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0104009900 tx=0x7f010402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 -- 172.21.15.17:0/658114846 shutdown_connections 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 --2- 172.21.15.17:0/658114846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c109df0 0x7f010c110620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 --2- 172.21.15.17:0/658114846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f010c1094a0 0x7f010c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 --2- 172.21.15.17:0/658114846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f010c103b60 0x7f010c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 -- 172.21.15.17:0/658114846 >> 172.21.15.17:0/658114846 conn(0x7f010c07b850 msgr2=0x7f010c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 -- 172.21.15.17:0/658114846 shutdown_connections 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.367+0000 7f0113578640 1 -- 172.21.15.17:0/658114846 wait complete. 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 Processor -- start 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 -- start start 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 0x7f010c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:13.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f010c1094a0 0x7f010c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f010c109df0 0x7f010c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f010c113960 con 0x7f010c103b60 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f010c1137e0 con 0x7f010c109df0 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0113578640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f010c113ae0 con 0x7f010c1094a0 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0111314640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 0x7f010c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0111314640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 0x7f010c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39988/0 (socket says 172.21.15.17:39988) 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.368+0000 7f0111314640 1 -- 172.21.15.17:0/1593334157 learned_addr learned my addr 172.21.15.17:0/1593334157 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111b15640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f010c109df0 0x7f010c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0110b13640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f010c1094a0 0x7f010c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111314640 1 -- 172.21.15.17:0/1593334157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f010c1094a0 msgr2=0x7f010c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111314640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f010c1094a0 0x7f010c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111314640 1 -- 172.21.15.17:0/1593334157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f010c109df0 msgr2=0x7f010c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:13.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111314640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f010c109df0 0x7f010c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111314640 1 -- 172.21.15.17:0/1593334157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c1a01e0 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0111314640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 0x7f010c19a330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00cce0 tx=0x7f00fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00f650 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00fc00fc80 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c1a04d0 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc018ae0 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.369+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c1a6cf0 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.370+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c103f70 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.372+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f00fc018c80 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.373+0000 7f010a7fc640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00f40b6650 0x7f00f40b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.373+0000 7f0110b13640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00f40b6650 0x7f00f40b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.373+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f00fc0e7b40 con 0x7f010c103b60 2024-09-21T06:11:13.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.373+0000 7f0110b13640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00f40b6650 0x7f00f40b8b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f010c106450 tx=0x7f010000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:13.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.378+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00fc014030 con 0x7f010c103b60 2024-09-21T06:11:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.583+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f010c19b460 con 0x7f010c103b60 2024-09-21T06:11:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.584+0000 7f010a7fc640 1 -- 172.21.15.17:0/1593334157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24681 (secure 0 0 0) 0x7f00fc0adf10 con 0x7f010c103b60 2024-09-21T06:11:13.588 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:13.588 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:46.657720+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00f40b6650 msgr2=0x7f00f40b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00f40b6650 0x7f00f40b8b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f010c106450 tx=0x7f010000b390 comp rx=0 tx=0).stop 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 msgr2=0x7f010c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 0x7f010c19a330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00cce0 tx=0x7f00fc00a620 comp rx=0 tx=0).stop 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 shutdown_connections 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00f40b6650 0x7f00f40b8b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f010c109df0 0x7f010c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f010c1094a0 0x7f010c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 --2- 172.21.15.17:0/1593334157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c103b60 0x7f010c19a330 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 >> 172.21.15.17:0/1593334157 conn(0x7f010c07b850 msgr2=0x7f010c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 shutdown_connections 2024-09-21T06:11:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:13.587+0000 7f0113578640 1 -- 172.21.15.17:0/1593334157 wait complete. 2024-09-21T06:11:13.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:13 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:13.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:13 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1593334157' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:14.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:13 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:14.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:13 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1593334157' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:14.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:13 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:14.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:13 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1593334157' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:14.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:14 smithi017 ceph-mon[31080]: pgmap v326: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.6 KiB/s wr, 10 op/s 2024-09-21T06:11:14.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:14 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:14.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:14 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:14.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:14 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:14.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:14 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:14.859 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:11:14.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:11:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:14 smithi089 ceph-mon[33879]: pgmap v326: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.6 KiB/s wr, 10 op/s 2024-09-21T06:11:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:14 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:14 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:14 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:14 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.143 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:15.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:14 smithi081 ceph-mon[33870]: pgmap v326: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.6 KiB/s wr, 10 op/s 2024-09-21T06:11:15.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:14 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:14 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:14 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:14 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 -- 172.21.15.17:0/1331330134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 msgr2=0x7fe75010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 --2- 172.21.15.17:0/1331330134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75010f530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe748009ca0 tx=0x7fe74802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 -- 172.21.15.17:0/1331330134 shutdown_connections 2024-09-21T06:11:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 --2- 172.21.15.17:0/1331330134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75010f530 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 --2- 172.21.15.17:0/1331330134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7501083b0 0x7fe7501087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 --2- 172.21.15.17:0/1331330134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe750102a70 0x7fe750102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 -- 172.21.15.17:0/1331330134 >> 172.21.15.17:0/1331330134 conn(0x7fe750079730 msgr2=0x7fe750079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 -- 172.21.15.17:0/1331330134 shutdown_connections 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.683+0000 7fe756501640 1 -- 172.21.15.17:0/1331330134 wait complete. 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 Processor -- start 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 -- start start 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe750102a70 0x7fe75019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7501083b0 0x7fe75019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe750112870 con 0x7fe750108d00 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7501126f0 con 0x7fe750102a70 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe756501640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe7501129f0 con 0x7fe7501083b0 2024-09-21T06:11:15.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe754a9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe754a9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40006/0 (socket says 172.21.15.17:40006) 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.684+0000 7fe754a9e640 1 -- 172.21.15.17:0/2872938236 learned_addr learned my addr 172.21.15.17:0/2872938236 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe74ffff640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe750102a70 0x7fe75019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe747fff640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7501083b0 0x7fe75019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe754a9e640 1 -- 172.21.15.17:0/2872938236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7501083b0 msgr2=0x7fe75019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe754a9e640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7501083b0 0x7fe75019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe754a9e640 1 -- 172.21.15.17:0/2872938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe750102a70 msgr2=0x7fe75019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe754a9e640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe750102a70 0x7fe75019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe754a9e640 1 -- 172.21.15.17:0/2872938236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501a03a0 con 0x7fe750108d00 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe754a9e640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75019fc70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe748005cc0 tx=0x7fe748032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748032e00 con 0x7fe750108d00 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7480044d0 con 0x7fe750108d00 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748030b70 con 0x7fe750108d00 2024-09-21T06:11:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501a0630 con 0x7fe750108d00 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.685+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a6df0 con 0x7fe750108d00 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.687+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750103cf0 con 0x7fe750108d00 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.688+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe748004680 con 0x7fe750108d00 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.689+0000 7fe74dffb640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe73c0b6620 0x7fe73c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.689+0000 7fe74ffff640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe73c0b6620 0x7fe73c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.689+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fe748108990 con 0x7fe750108d00 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.689+0000 7fe74ffff640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe73c0b6620 0x7fe73c0b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe74000bbe0 tx=0x7fe74000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.693+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7480ced00 con 0x7fe750108d00 2024-09-21T06:11:15.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.914+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe750063800 con 0x7fe73c0b6620 2024-09-21T06:11:15.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.921+0000 7fe74dffb640 1 -- 172.21.15.17:0/2872938236 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340557 (secure 0 0 0) 0x7fe750063800 con 0x7fe73c0b6620 2024-09-21T06:11:15.927 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:15.928 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe73c0b6620 msgr2=0x7fe73c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe73c0b6620 0x7fe73c0b8b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe74000bbe0 tx=0x7fe74000b390 comp rx=0 tx=0).stop 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 msgr2=0x7fe75019fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75019fc70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe748005cc0 tx=0x7fe748032a10 comp rx=0 tx=0).stop 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 shutdown_connections 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe73c0b6620 0x7fe73c0b8b30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe750108d00 0x7fe75019fc70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7501083b0 0x7fe75019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 --2- 172.21.15.17:0/2872938236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe750102a70 0x7fe75019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 >> 172.21.15.17:0/2872938236 conn(0x7fe750079730 msgr2=0x7fe75006bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:15.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 shutdown_connections 2024-09-21T06:11:15.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:15.926+0000 7fe756501640 1 -- 172.21.15.17:0/2872938236 wait complete. 2024-09-21T06:11:16.603 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-21T06:11:15.138644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641693,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":170,"num_read_kb":167,"num_write":275,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372612,"kb_used_data":10884,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569212,"statfs":{"total":1151940427776,"available":1151558873088,"internally_reserved":0,"allocated":11145216,"data_stored":7377071,"data_compressed":390495,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43963,"num_objects":5,"num_object_clones":0,"num_object_copies":17,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":70,"num_read_kb":80,"num_write":30,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003481"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728863+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:10:58.728863+0000","last_peered":"2024-09-21T06:10:58.728863+0000","last_clean":"2024-09-21T06:10:58.728863+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:10:58.728863+0000","last_undegraded":"2024-09-21T06:10:58.728863+0000","last_fullsized":"2024-09-21T06:10:58.728863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782814+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:10:46.782814+0000","last_peered":"2024-09-21T06:10:46.782814+0000","last_clean":"2024-09-21T06:10:46.782814+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:10:46.782814+0000","last_undegraded":"2024-09-21T06:10:46.782814+0000","last_fullsized":"2024-09-21T06:10:46.782814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669363+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:10:46.669363+0000","last_peered":"2024-09-21T06:10:46.669363+0000","last_clean":"2024-09-21T06:10:46.669363+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:10:46.669363+0000","last_undegraded":"2024-09-21T06:10:46.669363+0000","last_fullsized":"2024-09-21T06:10:46.669363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.783364+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:10:46.783364+0000","last_peered":"2024-09-21T06:10:46.783364+0000","last_clean":"2024-09-21T06:10:46.783364+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:10:46.783364+0000","last_undegraded":"2024-09-21T06:10:46.783364+0000","last_fullsized":"2024-09-21T06:10:46.783364+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781769+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:10:46.781769+0000","last_peered":"2024-09-21T06:10:46.781769+0000","last_clean":"2024-09-21T06:10:46.781769+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:10:46.781769+0000","last_undegraded":"2024-09-21T06:10:46.781769+0000","last_fullsized":"2024-09-21T06:10:46.781769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667302+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:10:46.667302+0000","last_peered":"2024-09-21T06:10:46.667302+0000","last_clean":"2024-09-21T06:10:46.667302+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:10:46.667302+0000","last_undegraded":"2024-09-21T06:10:46.667302+0000","last_fullsized":"2024-09-21T06:10:46.667302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728024+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:10:58.728024+0000","last_peered":"2024-09-21T06:10:58.728024+0000","last_clean":"2024-09-21T06:10:58.728024+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:10:58.728024+0000","last_undegraded":"2024-09-21T06:10:58.728024+0000","last_fullsized":"2024-09-21T06:10:58.728024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668811+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:10:46.668811+0000","last_peered":"2024-09-21T06:10:46.668811+0000","last_clean":"2024-09-21T06:10:46.668811+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:10:46.668811+0000","last_undegraded":"2024-09-21T06:10:46.668811+0000","last_fullsized":"2024-09-21T06:10:46.668811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.783877+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:10:46.783877+0000","last_peered":"2024-09-21T06:10:46.783877+0000","last_clean":"2024-09-21T06:10:46.783877+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:10:46.783877+0000","last_undegraded":"2024-09-21T06:10:46.783877+0000","last_fullsized":"2024-09-21T06:10:46.783877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667938+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:10:46.667938+0000","last_peered":"2024-09-21T06:10:46.667938+0000","last_clean":"2024-09-21T06:10:46.667938+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:10:46.667938+0000","last_undegraded":"2024-09-21T06:10:46.667938+0000","last_fullsized":"2024-09-21T06:10:46.667938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668635+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:10:46.668635+0000","last_peered":"2024-09-21T06:10:46.668635+0000","last_clean":"2024-09-21T06:10:46.668635+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:10:46.668635+0000","last_undegraded":"2024-09-21T06:10:46.668635+0000","last_fullsized":"2024-09-21T06:10:46.668635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665968+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:10:46.665968+0000","last_peered":"2024-09-21T06:10:46.665968+0000","last_clean":"2024-09-21T06:10:46.665968+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:10:46.665968+0000","last_undegraded":"2024-09-21T06:10:46.665968+0000","last_fullsized":"2024-09-21T06:10:46.665968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665428+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:10:46.665428+0000","last_peered":"2024-09-21T06:10:46.665428+0000","last_clean":"2024-09-21T06:10:46.665428+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:10:46.665428+0000","last_undegraded":"2024-09-21T06:10:46.665428+0000","last_fullsized":"2024-09-21T06:10:46.665428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.720178+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:10:57.720178+0000","last_peered":"2024-09-21T06:10:57.720178+0000","last_clean":"2024-09-21T06:10:57.720178+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:10:57.720178+0000","last_undegraded":"2024-09-21T06:10:57.720178+0000","last_fullsized":"2024-09-21T06:10:57.720178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666637+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:10:46.666637+0000","last_peered":"2024-09-21T06:10:46.666637+0000","last_clean":"2024-09-21T06:10:46.666637+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:10:46.666637+0000","last_undegraded":"2024-09-21T06:10:46.666637+0000","last_fullsized":"2024-09-21T06:10:46.666637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781826+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:10:46.781826+0000","last_peered":"2024-09-21T06:10:46.781826+0000","last_clean":"2024-09-21T06:10:46.781826+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:10:46.781826+0000","last_undegraded":"2024-09-21T06:10:46.781826+0000","last_fullsized":"2024-09-21T06:10:46.781826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669228+0000","last_change":"2024-09-21T06:10:14.525305+0000","last_active":"2024-09-21T06:10:46.669228+0000","last_peered":"2024-09-21T06:10:46.669228+0000","last_clean":"2024-09-21T06:10:46.669228+0000","last_became_active":"2024-09-21T06:10:14.524676+0000","last_became_peered":"2024-09-21T06:10:14.524676+0000","last_unstale":"2024-09-21T06:10:46.669228+0000","last_undegraded":"2024-09-21T06:10:46.669228+0000","last_fullsized":"2024-09-21T06:10:46.669228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:35.514346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666744+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:10:46.666744+0000","last_peered":"2024-09-21T06:10:46.666744+0000","last_clean":"2024-09-21T06:10:46.666744+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:10:46.666744+0000","last_undegraded":"2024-09-21T06:10:46.666744+0000","last_fullsized":"2024-09-21T06:10:46.666744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662171+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:10:46.662171+0000","last_peered":"2024-09-21T06:10:46.662171+0000","last_clean":"2024-09-21T06:10:46.662171+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:10:46.662171+0000","last_undegraded":"2024-09-21T06:10:46.662171+0000","last_fullsized":"2024-09-21T06:10:46.662171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.721227+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:10:57.721227+0000","last_peered":"2024-09-21T06:10:57.721227+0000","last_clean":"2024-09-21T06:10:57.721227+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:10:57.721227+0000","last_undegraded":"2024-09-21T06:10:57.721227+0000","last_fullsized":"2024-09-21T06:10:57.721227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.785749+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:10:46.785749+0000","last_peered":"2024-09-21T06:10:46.785749+0000","last_clean":"2024-09-21T06:10:46.785749+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:10:46.785749+0000","last_undegraded":"2024-09-21T06:10:46.785749+0000","last_fullsized":"2024-09-21T06:10:46.785749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665489+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:10:46.665489+0000","last_peered":"2024-09-21T06:10:46.665489+0000","last_clean":"2024-09-21T06:10:46.665489+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:10:46.665489+0000","last_undegraded":"2024-09-21T06:10:46.665489+0000","last_fullsized":"2024-09-21T06:10:46.665489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719464+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:10:57.719464+0000","last_peered":"2024-09-21T06:10:57.719464+0000","last_clean":"2024-09-21T06:10:57.719464+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:10:57.719464+0000","last_undegraded":"2024-09-21T06:10:57.719464+0000","last_fullsized":"2024-09-21T06:10:57.719464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.672466+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:10:46.672466+0000","last_peered":"2024-09-21T06:10:46.672466+0000","last_clean":"2024-09-21T06:10:46.672466+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:10:46.672466+0000","last_undegraded":"2024-09-21T06:10:46.672466+0000","last_fullsized":"2024-09-21T06:10:46.672466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782175+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:10:46.782175+0000","last_peered":"2024-09-21T06:10:46.782175+0000","last_clean":"2024-09-21T06:10:46.782175+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:10:46.782175+0000","last_undegraded":"2024-09-21T06:10:46.782175+0000","last_fullsized":"2024-09-21T06:10:46.782175+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.720506+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:10:57.720506+0000","last_peered":"2024-09-21T06:10:57.720506+0000","last_clean":"2024-09-21T06:10:57.720506+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:10:57.720506+0000","last_undegraded":"2024-09-21T06:10:57.720506+0000","last_fullsized":"2024-09-21T06:10:57.720506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669698+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:10:46.669698+0000","last_peered":"2024-09-21T06:10:46.669698+0000","last_clean":"2024-09-21T06:10:46.669698+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:10:46.669698+0000","last_undegraded":"2024-09-21T06:10:46.669698+0000","last_fullsized":"2024-09-21T06:10:46.669698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782959+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:10:46.782959+0000","last_peered":"2024-09-21T06:10:46.782959+0000","last_clean":"2024-09-21T06:10:46.782959+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:10:46.782959+0000","last_undegraded":"2024-09-21T06:10:46.782959+0000","last_fullsized":"2024-09-21T06:10:46.782959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:07.558176+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:11:07.558176+0000","last_peered":"2024-09-21T06:11:07.558176+0000","last_clean":"2024-09-21T06:11:07.558176+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:11:07.558176+0000","last_undegraded":"2024-09-21T06:11:07.558176+0000","last_fullsized":"2024-09-21T06:11:07.558176+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781359+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:10:46.781359+0000","last_peered":"2024-09-21T06:10:46.781359+0000","last_clean":"2024-09-21T06:10:46.781359+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:10:46.781359+0000","last_undegraded":"2024-09-21T06:10:46.781359+0000","last_fullsized":"2024-09-21T06:10:46.781359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662582+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:10:46.662582+0000","last_peered":"2024-09-21T06:10:46.662582+0000","last_clean":"2024-09-21T06:10:46.662582+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:10:46.662582+0000","last_undegraded":"2024-09-21T06:10:46.662582+0000","last_fullsized":"2024-09-21T06:10:46.662582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719090+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:10:57.719090+0000","last_peered":"2024-09-21T06:10:57.719090+0000","last_clean":"2024-09-21T06:10:57.719090+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:10:57.719090+0000","last_undegraded":"2024-09-21T06:10:57.719090+0000","last_fullsized":"2024-09-21T06:10:57.719090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662295+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:10:46.662295+0000","last_peered":"2024-09-21T06:10:46.662295+0000","last_clean":"2024-09-21T06:10:46.662295+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:10:46.662295+0000","last_undegraded":"2024-09-21T06:10:46.662295+0000","last_fullsized":"2024-09-21T06:10:46.662295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662782+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:10:46.662782+0000","last_peered":"2024-09-21T06:10:46.662782+0000","last_clean":"2024-09-21T06:10:46.662782+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:10:46.662782+0000","last_undegraded":"2024-09-21T06:10:46.662782+0000","last_fullsized":"2024-09-21T06:10:46.662782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667209+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:10:46.667209+0000","last_peered":"2024-09-21T06:10:46.667209+0000","last_clean":"2024-09-21T06:10:46.667209+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:10:46.667209+0000","last_undegraded":"2024-09-21T06:10:46.667209+0000","last_fullsized":"2024-09-21T06:10:46.667209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665445+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:10:46.665445+0000","last_peered":"2024-09-21T06:10:46.665445+0000","last_clean":"2024-09-21T06:10:46.665445+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:10:46.665445+0000","last_undegraded":"2024-09-21T06:10:46.665445+0000","last_fullsized":"2024-09-21T06:10:46.665445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662648+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:10:46.662648+0000","last_peered":"2024-09-21T06:10:46.662648+0000","last_clean":"2024-09-21T06:10:46.662648+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:10:46.662648+0000","last_undegraded":"2024-09-21T06:10:46.662648+0000","last_fullsized":"2024-09-21T06:10:46.662648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665719+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:10:46.665719+0000","last_peered":"2024-09-21T06:10:46.665719+0000","last_clean":"2024-09-21T06:10:46.665719+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:10:46.665719+0000","last_undegraded":"2024-09-21T06:10:46.665719+0000","last_fullsized":"2024-09-21T06:10:46.665719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662439+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:10:46.662439+0000","last_peered":"2024-09-21T06:10:46.662439+0000","last_clean":"2024-09-21T06:10:46.662439+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:10:46.662439+0000","last_undegraded":"2024-09-21T06:10:46.662439+0000","last_fullsized":"2024-09-21T06:10:46.662439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666257+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:10:46.666257+0000","last_peered":"2024-09-21T06:10:46.666257+0000","last_clean":"2024-09-21T06:10:46.666257+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:10:46.666257+0000","last_undegraded":"2024-09-21T06:10:46.666257+0000","last_fullsized":"2024-09-21T06:10:46.666257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:11.753657+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:11:11.753657+0000","last_peered":"2024-09-21T06:11:11.753657+0000","last_clean":"2024-09-21T06:11:11.753657+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:11:11.753657+0000","last_undegraded":"2024-09-21T06:11:11.753657+0000","last_fullsized":"2024-09-21T06:11:11.753657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662122+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:10:46.662122+0000","last_peered":"2024-09-21T06:10:46.662122+0000","last_clean":"2024-09-21T06:10:46.662122+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:10:46.662122+0000","last_undegraded":"2024-09-21T06:10:46.662122+0000","last_fullsized":"2024-09-21T06:10:46.662122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.661552+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:10:46.661552+0000","last_peered":"2024-09-21T06:10:46.661552+0000","last_clean":"2024-09-21T06:10:46.661552+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:10:46.661552+0000","last_undegraded":"2024-09-21T06:10:46.661552+0000","last_fullsized":"2024-09-21T06:10:46.661552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728196+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:10:58.728196+0000","last_peered":"2024-09-21T06:10:58.728196+0000","last_clean":"2024-09-21T06:10:58.728196+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:10:58.728196+0000","last_undegraded":"2024-09-21T06:10:58.728196+0000","last_fullsized":"2024-09-21T06:10:58.728196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668039+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:10:46.668039+0000","last_peered":"2024-09-21T06:10:46.668039+0000","last_clean":"2024-09-21T06:10:46.668039+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:10:46.668039+0000","last_undegraded":"2024-09-21T06:10:46.668039+0000","last_fullsized":"2024-09-21T06:10:46.668039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782207+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:10:46.782207+0000","last_peered":"2024-09-21T06:10:46.782207+0000","last_clean":"2024-09-21T06:10:46.782207+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:10:46.782207+0000","last_undegraded":"2024-09-21T06:10:46.782207+0000","last_fullsized":"2024-09-21T06:10:46.782207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:59.733129+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:10:59.733129+0000","last_peered":"2024-09-21T06:10:59.733129+0000","last_clean":"2024-09-21T06:10:59.733129+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:10:59.733129+0000","last_undegraded":"2024-09-21T06:10:59.733129+0000","last_fullsized":"2024-09-21T06:10:59.733129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665176+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:10:46.665176+0000","last_peered":"2024-09-21T06:10:46.665176+0000","last_clean":"2024-09-21T06:10:46.665176+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:10:46.665176+0000","last_undegraded":"2024-09-21T06:10:46.665176+0000","last_fullsized":"2024-09-21T06:10:46.665176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666371+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:10:46.666371+0000","last_peered":"2024-09-21T06:10:46.666371+0000","last_clean":"2024-09-21T06:10:46.666371+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:10:46.666371+0000","last_undegraded":"2024-09-21T06:10:46.666371+0000","last_fullsized":"2024-09-21T06:10:46.666371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666649+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:10:46.666649+0000","last_peered":"2024-09-21T06:10:46.666649+0000","last_clean":"2024-09-21T06:10:46.666649+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:10:46.666649+0000","last_undegraded":"2024-09-21T06:10:46.666649+0000","last_fullsized":"2024-09-21T06:10:46.666649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.729128+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:10:58.729128+0000","last_peered":"2024-09-21T06:10:58.729128+0000","last_clean":"2024-09-21T06:10:58.729128+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:10:58.729128+0000","last_undegraded":"2024-09-21T06:10:58.729128+0000","last_fullsized":"2024-09-21T06:10:58.729128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667558+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:10:46.667558+0000","last_peered":"2024-09-21T06:10:46.667558+0000","last_clean":"2024-09-21T06:10:46.667558+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:10:46.667558+0000","last_undegraded":"2024-09-21T06:10:46.667558+0000","last_fullsized":"2024-09-21T06:10:46.667558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666069+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:10:46.666069+0000","last_peered":"2024-09-21T06:10:46.666069+0000","last_clean":"2024-09-21T06:10:46.666069+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:10:46.666069+0000","last_undegraded":"2024-09-21T06:10:46.666069+0000","last_fullsized":"2024-09-21T06:10:46.666069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669045+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:10:46.669045+0000","last_peered":"2024-09-21T06:10:46.669045+0000","last_clean":"2024-09-21T06:10:46.669045+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:10:46.669045+0000","last_undegraded":"2024-09-21T06:10:46.669045+0000","last_fullsized":"2024-09-21T06:10:46.669045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781766+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:10:46.781766+0000","last_peered":"2024-09-21T06:10:46.781766+0000","last_clean":"2024-09-21T06:10:46.781766+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:10:46.781766+0000","last_undegraded":"2024-09-21T06:10:46.781766+0000","last_fullsized":"2024-09-21T06:10:46.781766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667062+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:10:46.667062+0000","last_peered":"2024-09-21T06:10:46.667062+0000","last_clean":"2024-09-21T06:10:46.667062+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:10:46.667062+0000","last_undegraded":"2024-09-21T06:10:46.667062+0000","last_fullsized":"2024-09-21T06:10:46.667062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662151+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:10:46.662151+0000","last_peered":"2024-09-21T06:10:46.662151+0000","last_clean":"2024-09-21T06:10:46.662151+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:10:46.662151+0000","last_undegraded":"2024-09-21T06:10:46.662151+0000","last_fullsized":"2024-09-21T06:10:46.662151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665272+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:10:46.665272+0000","last_peered":"2024-09-21T06:10:46.665272+0000","last_clean":"2024-09-21T06:10:46.665272+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:10:46.665272+0000","last_undegraded":"2024-09-21T06:10:46.665272+0000","last_fullsized":"2024-09-21T06:10:46.665272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662603+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:10:46.662603+0000","last_peered":"2024-09-21T06:10:46.662603+0000","last_clean":"2024-09-21T06:10:46.662603+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:10:46.662603+0000","last_undegraded":"2024-09-21T06:10:46.662603+0000","last_fullsized":"2024-09-21T06:10:46.662603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:59.724241+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:10:59.724241+0000","last_peered":"2024-09-21T06:10:59.724241+0000","last_clean":"2024-09-21T06:10:59.724241+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:10:59.724241+0000","last_undegraded":"2024-09-21T06:10:59.724241+0000","last_fullsized":"2024-09-21T06:10:59.724241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665799+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:10:46.665799+0000","last_peered":"2024-09-21T06:10:46.665799+0000","last_clean":"2024-09-21T06:10:46.665799+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:10:46.665799+0000","last_undegraded":"2024-09-21T06:10:46.665799+0000","last_fullsized":"2024-09-21T06:10:46.665799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666008+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:10:46.666008+0000","last_peered":"2024-09-21T06:10:46.666008+0000","last_clean":"2024-09-21T06:10:46.666008+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:10:46.666008+0000","last_undegraded":"2024-09-21T06:10:46.666008+0000","last_fullsized":"2024-09-21T06:10:46.666008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.729380+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:10:58.729380+0000","last_peered":"2024-09-21T06:10:58.729380+0000","last_clean":"2024-09-21T06:10:58.729380+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:10:58.729380+0000","last_undegraded":"2024-09-21T06:10:58.729380+0000","last_fullsized":"2024-09-21T06:10:58.729380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662143+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:10:46.662143+0000","last_peered":"2024-09-21T06:10:46.662143+0000","last_clean":"2024-09-21T06:10:46.662143+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:10:46.662143+0000","last_undegraded":"2024-09-21T06:10:46.662143+0000","last_fullsized":"2024-09-21T06:10:46.662143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.664755+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:10:46.664755+0000","last_peered":"2024-09-21T06:10:46.664755+0000","last_clean":"2024-09-21T06:10:46.664755+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:10:46.664755+0000","last_undegraded":"2024-09-21T06:10:46.664755+0000","last_fullsized":"2024-09-21T06:10:46.664755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:08.749653+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:11:08.749653+0000","last_peered":"2024-09-21T06:11:08.749653+0000","last_clean":"2024-09-21T06:11:08.749653+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:11:08.749653+0000","last_undegraded":"2024-09-21T06:11:08.749653+0000","last_fullsized":"2024-09-21T06:11:08.749653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667182+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:10:46.667182+0000","last_peered":"2024-09-21T06:10:46.667182+0000","last_clean":"2024-09-21T06:10:46.667182+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:10:46.667182+0000","last_undegraded":"2024-09-21T06:10:46.667182+0000","last_fullsized":"2024-09-21T06:10:46.667182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668971+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:10:46.668971+0000","last_peered":"2024-09-21T06:10:46.668971+0000","last_clean":"2024-09-21T06:10:46.668971+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:10:46.668971+0000","last_undegraded":"2024-09-21T06:10:46.668971+0000","last_fullsized":"2024-09-21T06:10:46.668971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719870+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:10:57.719870+0000","last_peered":"2024-09-21T06:10:57.719870+0000","last_clean":"2024-09-21T06:10:57.719870+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:10:57.719870+0000","last_undegraded":"2024-09-21T06:10:57.719870+0000","last_fullsized":"2024-09-21T06:10:57.719870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662354+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:10:46.662354+0000","last_peered":"2024-09-21T06:10:46.662354+0000","last_clean":"2024-09-21T06:10:46.662354+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:10:46.662354+0000","last_undegraded":"2024-09-21T06:10:46.662354+0000","last_fullsized":"2024-09-21T06:10:46.662354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.661779+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:10:46.661779+0000","last_peered":"2024-09-21T06:10:46.661779+0000","last_clean":"2024-09-21T06:10:46.661779+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:10:46.661779+0000","last_undegraded":"2024-09-21T06:10:46.661779+0000","last_fullsized":"2024-09-21T06:10:46.661779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728912+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:10:58.728912+0000","last_peered":"2024-09-21T06:10:58.728912+0000","last_clean":"2024-09-21T06:10:58.728912+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:10:58.728912+0000","last_undegraded":"2024-09-21T06:10:58.728912+0000","last_fullsized":"2024-09-21T06:10:58.728912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668516+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:10:46.668516+0000","last_peered":"2024-09-21T06:10:46.668516+0000","last_clean":"2024-09-21T06:10:46.668516+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:10:46.668516+0000","last_undegraded":"2024-09-21T06:10:46.668516+0000","last_fullsized":"2024-09-21T06:10:46.668516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665490+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:10:46.665490+0000","last_peered":"2024-09-21T06:10:46.665490+0000","last_clean":"2024-09-21T06:10:46.665490+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:10:46.665490+0000","last_undegraded":"2024-09-21T06:10:46.665490+0000","last_fullsized":"2024-09-21T06:10:46.665490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'25","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:09.758090+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:11:09.758090+0000","last_peered":"2024-09-21T06:11:09.758090+0000","last_clean":"2024-09-21T06:11:09.758090+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:11:09.758090+0000","last_undegraded":"2024-09-21T06:11:09.758090+0000","last_fullsized":"2024-09-21T06:11:09.758090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47481,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":60,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.672317+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:10:46.672317+0000","last_peered":"2024-09-21T06:10:46.672317+0000","last_clean":"2024-09-21T06:10:46.672317+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:10:46.672317+0000","last_undegraded":"2024-09-21T06:10:46.672317+0000","last_fullsized":"2024-09-21T06:10:46.672317+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.671697+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:10:46.671697+0000","last_peered":"2024-09-21T06:10:46.671697+0000","last_clean":"2024-09-21T06:10:46.671697+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:10:46.671697+0000","last_undegraded":"2024-09-21T06:10:46.671697+0000","last_fullsized":"2024-09-21T06:10:46.671697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719371+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:10:57.719371+0000","last_peered":"2024-09-21T06:10:57.719371+0000","last_clean":"2024-09-21T06:10:57.719371+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:10:57.719371+0000","last_undegraded":"2024-09-21T06:10:57.719371+0000","last_fullsized":"2024-09-21T06:10:57.719371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667532+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:10:46.667532+0000","last_peered":"2024-09-21T06:10:46.667532+0000","last_clean":"2024-09-21T06:10:46.667532+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:10:46.667532+0000","last_undegraded":"2024-09-21T06:10:46.667532+0000","last_fullsized":"2024-09-21T06:10:46.667532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782046+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:10:46.782046+0000","last_peered":"2024-09-21T06:10:46.782046+0000","last_clean":"2024-09-21T06:10:46.782046+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:10:46.782046+0000","last_undegraded":"2024-09-21T06:10:46.782046+0000","last_fullsized":"2024-09-21T06:10:46.782046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.720209+0000","last_change":"2024-09-21T06:10:14.530091+0000","last_active":"2024-09-21T06:10:57.720209+0000","last_peered":"2024-09-21T06:10:57.720209+0000","last_clean":"2024-09-21T06:10:57.720209+0000","last_became_active":"2024-09-21T06:10:14.528930+0000","last_became_peered":"2024-09-21T06:10:14.528930+0000","last_unstale":"2024-09-21T06:10:57.720209+0000","last_undegraded":"2024-09-21T06:10:57.720209+0000","last_fullsized":"2024-09-21T06:10:57.720209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:43.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666269+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:10:46.666269+0000","last_peered":"2024-09-21T06:10:46.666269+0000","last_clean":"2024-09-21T06:10:46.666269+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:10:46.666269+0000","last_undegraded":"2024-09-21T06:10:46.666269+0000","last_fullsized":"2024-09-21T06:10:46.666269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669572+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:10:46.669572+0000","last_peered":"2024-09-21T06:10:46.669572+0000","last_clean":"2024-09-21T06:10:46.669572+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:10:46.669572+0000","last_undegraded":"2024-09-21T06:10:46.669572+0000","last_fullsized":"2024-09-21T06:10:46.669572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:08.751273+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:11:08.751273+0000","last_peered":"2024-09-21T06:11:08.751273+0000","last_clean":"2024-09-21T06:11:08.751273+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:11:08.751273+0000","last_undegraded":"2024-09-21T06:11:08.751273+0000","last_fullsized":"2024-09-21T06:11:08.751273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782132+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:10:46.782132+0000","last_peered":"2024-09-21T06:10:46.782132+0000","last_clean":"2024-09-21T06:10:46.782132+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:10:46.782132+0000","last_undegraded":"2024-09-21T06:10:46.782132+0000","last_fullsized":"2024-09-21T06:10:46.782132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781867+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:10:46.781867+0000","last_peered":"2024-09-21T06:10:46.781867+0000","last_clean":"2024-09-21T06:10:46.781867+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:10:46.781867+0000","last_undegraded":"2024-09-21T06:10:46.781867+0000","last_fullsized":"2024-09-21T06:10:46.781867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666457+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:10:46.666457+0000","last_peered":"2024-09-21T06:10:46.666457+0000","last_clean":"2024-09-21T06:10:46.666457+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:10:46.666457+0000","last_undegraded":"2024-09-21T06:10:46.666457+0000","last_fullsized":"2024-09-21T06:10:46.666457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666496+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:10:46.666496+0000","last_peered":"2024-09-21T06:10:46.666496+0000","last_clean":"2024-09-21T06:10:46.666496+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:10:46.666496+0000","last_undegraded":"2024-09-21T06:10:46.666496+0000","last_fullsized":"2024-09-21T06:10:46.666496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662493+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:10:46.662493+0000","last_peered":"2024-09-21T06:10:46.662493+0000","last_clean":"2024-09-21T06:10:46.662493+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:10:46.662493+0000","last_undegraded":"2024-09-21T06:10:46.662493+0000","last_fullsized":"2024-09-21T06:10:46.662493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781212+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:10:46.781212+0000","last_peered":"2024-09-21T06:10:46.781212+0000","last_clean":"2024-09-21T06:10:46.781212+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:10:46.781212+0000","last_undegraded":"2024-09-21T06:10:46.781212+0000","last_fullsized":"2024-09-21T06:10:46.781212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.729316+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:10:58.729316+0000","last_peered":"2024-09-21T06:10:58.729316+0000","last_clean":"2024-09-21T06:10:58.729316+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:10:58.729316+0000","last_undegraded":"2024-09-21T06:10:58.729316+0000","last_fullsized":"2024-09-21T06:10:58.729316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728411+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:10:58.728411+0000","last_peered":"2024-09-21T06:10:58.728411+0000","last_clean":"2024-09-21T06:10:58.728411+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:10:58.728411+0000","last_undegraded":"2024-09-21T06:10:58.728411+0000","last_fullsized":"2024-09-21T06:10:58.728411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.784640+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:10:46.784640+0000","last_peered":"2024-09-21T06:10:46.784640+0000","last_clean":"2024-09-21T06:10:46.784640+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:10:46.784640+0000","last_undegraded":"2024-09-21T06:10:46.784640+0000","last_fullsized":"2024-09-21T06:10:46.784640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.671146+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:10:46.671146+0000","last_peered":"2024-09-21T06:10:46.671146+0000","last_clean":"2024-09-21T06:10:46.671146+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:10:46.671146+0000","last_undegraded":"2024-09-21T06:10:46.671146+0000","last_fullsized":"2024-09-21T06:10:46.671146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:09.753266+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:11:09.753266+0000","last_peered":"2024-09-21T06:11:09.753266+0000","last_clean":"2024-09-21T06:11:09.753266+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:11:09.753266+0000","last_undegraded":"2024-09-21T06:11:09.753266+0000","last_fullsized":"2024-09-21T06:11:09.753266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665662+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:10:46.665662+0000","last_peered":"2024-09-21T06:10:46.665662+0000","last_clean":"2024-09-21T06:10:46.665662+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:10:46.665662+0000","last_undegraded":"2024-09-21T06:10:46.665662+0000","last_fullsized":"2024-09-21T06:10:46.665662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669469+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:10:46.669469+0000","last_peered":"2024-09-21T06:10:46.669469+0000","last_clean":"2024-09-21T06:10:46.669469+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:10:46.669469+0000","last_undegraded":"2024-09-21T06:10:46.669469+0000","last_fullsized":"2024-09-21T06:10:46.669469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662094+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:10:46.662094+0000","last_peered":"2024-09-21T06:10:46.662094+0000","last_clean":"2024-09-21T06:10:46.662094+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:10:46.662094+0000","last_undegraded":"2024-09-21T06:10:46.662094+0000","last_fullsized":"2024-09-21T06:10:46.662094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669814+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:10:46.669814+0000","last_peered":"2024-09-21T06:10:46.669814+0000","last_clean":"2024-09-21T06:10:46.669814+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:10:46.669814+0000","last_undegraded":"2024-09-21T06:10:46.669814+0000","last_fullsized":"2024-09-21T06:10:46.669814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669011+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:10:46.669011+0000","last_peered":"2024-09-21T06:10:46.669011+0000","last_clean":"2024-09-21T06:10:46.669011+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:10:46.669011+0000","last_undegraded":"2024-09-21T06:10:46.669011+0000","last_fullsized":"2024-09-21T06:10:46.669011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781947+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:10:46.781947+0000","last_peered":"2024-09-21T06:10:46.781947+0000","last_clean":"2024-09-21T06:10:46.781947+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:10:46.781947+0000","last_undegraded":"2024-09-21T06:10:46.781947+0000","last_fullsized":"2024-09-21T06:10:46.781947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.784679+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:10:46.784679+0000","last_peered":"2024-09-21T06:10:46.784679+0000","last_clean":"2024-09-21T06:10:46.784679+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:10:46.784679+0000","last_undegraded":"2024-09-21T06:10:46.784679+0000","last_fullsized":"2024-09-21T06:10:46.784679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662564+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:10:46.662564+0000","last_peered":"2024-09-21T06:10:46.662564+0000","last_clean":"2024-09-21T06:10:46.662564+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:10:46.662564+0000","last_undegraded":"2024-09-21T06:10:46.662564+0000","last_fullsized":"2024-09-21T06:10:46.662564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669370+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:10:46.669370+0000","last_peered":"2024-09-21T06:10:46.669370+0000","last_clean":"2024-09-21T06:10:46.669370+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:10:46.669370+0000","last_undegraded":"2024-09-21T06:10:46.669370+0000","last_fullsized":"2024-09-21T06:10:46.669370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782814+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:10:46.782814+0000","last_peered":"2024-09-21T06:10:46.782814+0000","last_clean":"2024-09-21T06:10:46.782814+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:10:46.782814+0000","last_undegraded":"2024-09-21T06:10:46.782814+0000","last_fullsized":"2024-09-21T06:10:46.782814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666148+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:10:46.666148+0000","last_peered":"2024-09-21T06:10:46.666148+0000","last_clean":"2024-09-21T06:10:46.666148+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:10:46.666148+0000","last_undegraded":"2024-09-21T06:10:46.666148+0000","last_fullsized":"2024-09-21T06:10:46.666148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782016+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:10:46.782016+0000","last_peered":"2024-09-21T06:10:46.782016+0000","last_clean":"2024-09-21T06:10:46.782016+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:10:46.782016+0000","last_undegraded":"2024-09-21T06:10:46.782016+0000","last_fullsized":"2024-09-21T06:10:46.782016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669051+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:10:46.669051+0000","last_peered":"2024-09-21T06:10:46.669051+0000","last_clean":"2024-09-21T06:10:46.669051+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:10:46.669051+0000","last_undegraded":"2024-09-21T06:10:46.669051+0000","last_fullsized":"2024-09-21T06:10:46.669051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662291+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:10:46.662291+0000","last_peered":"2024-09-21T06:10:46.662291+0000","last_clean":"2024-09-21T06:10:46.662291+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:10:46.662291+0000","last_undegraded":"2024-09-21T06:10:46.662291+0000","last_fullsized":"2024-09-21T06:10:46.662291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662360+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:10:46.662360+0000","last_peered":"2024-09-21T06:10:46.662360+0000","last_clean":"2024-09-21T06:10:46.662360+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:10:46.662360+0000","last_undegraded":"2024-09-21T06:10:46.662360+0000","last_fullsized":"2024-09-21T06:10:46.662360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669673+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:10:46.669673+0000","last_peered":"2024-09-21T06:10:46.669673+0000","last_clean":"2024-09-21T06:10:46.669673+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:10:46.669673+0000","last_undegraded":"2024-09-21T06:10:46.669673+0000","last_fullsized":"2024-09-21T06:10:46.669673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667358+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:10:46.667358+0000","last_peered":"2024-09-21T06:10:46.667358+0000","last_clean":"2024-09-21T06:10:46.667358+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:10:46.667358+0000","last_undegraded":"2024-09-21T06:10:46.667358+0000","last_fullsized":"2024-09-21T06:10:46.667358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662902+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:10:46.662902+0000","last_peered":"2024-09-21T06:10:46.662902+0000","last_clean":"2024-09-21T06:10:46.662902+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:10:46.662902+0000","last_undegraded":"2024-09-21T06:10:46.662902+0000","last_fullsized":"2024-09-21T06:10:46.662902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667543+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:10:46.667543+0000","last_peered":"2024-09-21T06:10:46.667543+0000","last_clean":"2024-09-21T06:10:46.667543+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:10:46.667543+0000","last_undegraded":"2024-09-21T06:10:46.667543+0000","last_fullsized":"2024-09-21T06:10:46.667543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781168+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:10:46.781168+0000","last_peered":"2024-09-21T06:10:46.781168+0000","last_clean":"2024-09-21T06:10:46.781168+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:10:46.781168+0000","last_undegraded":"2024-09-21T06:10:46.781168+0000","last_fullsized":"2024-09-21T06:10:46.781168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781360+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:10:46.781360+0000","last_peered":"2024-09-21T06:10:46.781360+0000","last_clean":"2024-09-21T06:10:46.781360+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:10:46.781360+0000","last_undegraded":"2024-09-21T06:10:46.781360+0000","last_fullsized":"2024-09-21T06:10:46.781360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662156+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:10:46.662156+0000","last_peered":"2024-09-21T06:10:46.662156+0000","last_clean":"2024-09-21T06:10:46.662156+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:10:46.662156+0000","last_undegraded":"2024-09-21T06:10:46.662156+0000","last_fullsized":"2024-09-21T06:10:46.662156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667199+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:10:46.667199+0000","last_peered":"2024-09-21T06:10:46.667199+0000","last_clean":"2024-09-21T06:10:46.667199+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:10:46.667199+0000","last_undegraded":"2024-09-21T06:10:46.667199+0000","last_fullsized":"2024-09-21T06:10:46.667199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666509+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:10:46.666509+0000","last_peered":"2024-09-21T06:10:46.666509+0000","last_clean":"2024-09-21T06:10:46.666509+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:10:46.666509+0000","last_undegraded":"2024-09-21T06:10:46.666509+0000","last_fullsized":"2024-09-21T06:10:46.666509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.663328+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:10:46.663328+0000","last_peered":"2024-09-21T06:10:46.663328+0000","last_clean":"2024-09-21T06:10:46.663328+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:10:46.663328+0000","last_undegraded":"2024-09-21T06:10:46.663328+0000","last_fullsized":"2024-09-21T06:10:46.663328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669687+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:10:46.669687+0000","last_peered":"2024-09-21T06:10:46.669687+0000","last_clean":"2024-09-21T06:10:46.669687+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:10:46.669687+0000","last_undegraded":"2024-09-21T06:10:46.669687+0000","last_fullsized":"2024-09-21T06:10:46.669687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.780994+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:10:46.780994+0000","last_peered":"2024-09-21T06:10:46.780994+0000","last_clean":"2024-09-21T06:10:46.780994+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:10:46.780994+0000","last_undegraded":"2024-09-21T06:10:46.780994+0000","last_fullsized":"2024-09-21T06:10:46.780994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.664855+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:10:46.664855+0000","last_peered":"2024-09-21T06:10:46.664855+0000","last_clean":"2024-09-21T06:10:46.664855+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:10:46.664855+0000","last_undegraded":"2024-09-21T06:10:46.664855+0000","last_fullsized":"2024-09-21T06:10:46.664855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.663041+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:10:46.663041+0000","last_peered":"2024-09-21T06:10:46.663041+0000","last_clean":"2024-09-21T06:10:46.663041+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:10:46.663041+0000","last_undegraded":"2024-09-21T06:10:46.663041+0000","last_fullsized":"2024-09-21T06:10:46.663041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665738+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:10:46.665738+0000","last_peered":"2024-09-21T06:10:46.665738+0000","last_clean":"2024-09-21T06:10:46.665738+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:10:46.665738+0000","last_undegraded":"2024-09-21T06:10:46.665738+0000","last_fullsized":"2024-09-21T06:10:46.665738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667042+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:10:46.667042+0000","last_peered":"2024-09-21T06:10:46.667042+0000","last_clean":"2024-09-21T06:10:46.667042+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:10:46.667042+0000","last_undegraded":"2024-09-21T06:10:46.667042+0000","last_fullsized":"2024-09-21T06:10:46.667042+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781465+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:10:46.781465+0000","last_peered":"2024-09-21T06:10:46.781465+0000","last_clean":"2024-09-21T06:10:46.781465+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:10:46.781465+0000","last_undegraded":"2024-09-21T06:10:46.781465+0000","last_fullsized":"2024-09-21T06:10:46.781465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782015+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:10:46.782015+0000","last_peered":"2024-09-21T06:10:46.782015+0000","last_clean":"2024-09-21T06:10:46.782015+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:10:46.782015+0000","last_undegraded":"2024-09-21T06:10:46.782015+0000","last_fullsized":"2024-09-21T06:10:46.782015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662821+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:10:46.662821+0000","last_peered":"2024-09-21T06:10:46.662821+0000","last_clean":"2024-09-21T06:10:46.662821+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:10:46.662821+0000","last_undegraded":"2024-09-21T06:10:46.662821+0000","last_fullsized":"2024-09-21T06:10:46.662821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51091,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":94,"num_read_kb":103,"num_write":150,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":171399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":454850,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1089577,"data_compressed":59761,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070498,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":459160,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":454962,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":1050502,"data_compressed":59761,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":450240,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1046090,"data_compressed":59761,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":454890,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":450434,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":508044,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":506694,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":451628,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:11:16.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:11:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:16 smithi017 ceph-mon[31080]: pgmap v327: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-21T06:11:17.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:17.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:17.089 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:16 smithi089 ceph-mon[33879]: pgmap v327: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-21T06:11:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:16 smithi081 ceph-mon[33870]: pgmap v327: 129 pgs: 129 active+clean; 627 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-21T06:11:17.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:17.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:17.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:11:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 -- 172.21.15.17:0/759269947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 msgr2=0x7f3e441087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/759269947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e441087e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009900 tx=0x7f3e3802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 -- 172.21.15.17:0/759269947 shutdown_connections 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/759269947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e441087e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/759269947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44108d20 0x7f3e4410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/759269947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44102a90 0x7f3e44102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 -- 172.21.15.17:0/759269947 >> 172.21.15.17:0/759269947 conn(0x7f3e44079750 msgr2=0x7f3e44079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 -- 172.21.15.17:0/759269947 shutdown_connections 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.302+0000 7f3e49bf9640 1 -- 172.21.15.17:0/759269947 wait complete. 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.303+0000 7f3e49bf9640 1 Processor -- start 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.303+0000 7f3e49bf9640 1 -- start start 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e49bf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 0x7f3e4419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e49bf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e4419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e49bf9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44108d20 0x7f3e4419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e49bf9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44112840 con 0x7f3e441083d0 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e49bf9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e441126c0 con 0x7f3e44102a90 2024-09-21T06:11:17.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e49bf9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3e441129c0 con 0x7f3e44108d20 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e4419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 0x7f3e4419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 0x7f3e4419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:38820/0 (socket says 172.21.15.17:38820) 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e4419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40030/0 (socket says 172.21.15.17:40030) 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e437fe640 1 -- 172.21.15.17:0/1105894876 learned_addr learned my addr 172.21.15.17:0/1105894876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e43fff640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44108d20 0x7f3e4419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 -- 172.21.15.17:0/1105894876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44108d20 msgr2=0x7f3e4419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44108d20 0x7f3e4419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 -- 172.21.15.17:0/1105894876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 msgr2=0x7f3e4419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 0x7f3e4419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 -- 172.21.15.17:0/1105894876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e441a0410 con 0x7f3e441083d0 2024-09-21T06:11:17.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e437fe640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 0x7f3e4419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e43fff640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44108d20 0x7f3e4419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.304+0000 7f3e42ffd640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e4419aa40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009230 tx=0x7f3e380040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.305+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3803f070 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.305+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e441a06a0 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.305+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e38003c80 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.305+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38035070 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.305+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e441a6e60 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.306+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e44103d10 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.308+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3e380037f0 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.308+0000 7f3e40ff9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e2c0b65a0 0x7f3e2c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.308+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f3e38108730 con 0x7f3e441083d0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.308+0000 7f3e437fe640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e2c0b65a0 0x7f3e2c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:17.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.309+0000 7f3e437fe640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e2c0b65a0 0x7f3e2c0b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e340058c0 tx=0x7f3e3400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:17.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.312+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e380ceb00 con 0x7f3e441083d0 2024-09-21T06:11:17.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.499+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e44063800 con 0x7f3e2c0b65a0 2024-09-21T06:11:17.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.504+0000 7f3e40ff9640 1 -- 172.21.15.17:0/1105894876 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340563 (secure 0 0 0) 0x7f3e44063800 con 0x7f3e2c0b65a0 2024-09-21T06:11:17.510 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:17.512 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:11:17.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e2c0b65a0 msgr2=0x7f3e2c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e2c0b65a0 0x7f3e2c0b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e340058c0 tx=0x7f3e3400a380 comp rx=0 tx=0).stop 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 msgr2=0x7f3e4419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e4419aa40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009230 tx=0x7f3e380040e0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 shutdown_connections 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e2c0b65a0 0x7f3e2c0b8ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e441083d0 0x7f3e4419aa40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e44108d20 0x7f3e4419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 --2- 172.21.15.17:0/1105894876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e44102a90 0x7f3e4419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 >> 172.21.15.17:0/1105894876 conn(0x7f3e44079750 msgr2=0x7f3e44101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 shutdown_connections 2024-09-21T06:11:17.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:17.508+0000 7f3e49bf9640 1 -- 172.21.15.17:0/1105894876 wait complete. 2024-09-21T06:11:18.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:17 smithi089 ceph-mon[33879]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:18.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:17 smithi017 ceph-mon[31080]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:18.256 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-21T06:11:17.139174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650756,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":286,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372620,"kb_used_data":10892,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124569204,"statfs":{"total":1151940427776,"available":1151558864896,"internally_reserved":0,"allocated":11153408,"data_stored":7386134,"data_compressed":390495,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52936,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":93,"num_write":34,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003454"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728863+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:10:58.728863+0000","last_peered":"2024-09-21T06:10:58.728863+0000","last_clean":"2024-09-21T06:10:58.728863+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:10:58.728863+0000","last_undegraded":"2024-09-21T06:10:58.728863+0000","last_fullsized":"2024-09-21T06:10:58.728863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782814+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:10:46.782814+0000","last_peered":"2024-09-21T06:10:46.782814+0000","last_clean":"2024-09-21T06:10:46.782814+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:10:46.782814+0000","last_undegraded":"2024-09-21T06:10:46.782814+0000","last_fullsized":"2024-09-21T06:10:46.782814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669363+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:10:46.669363+0000","last_peered":"2024-09-21T06:10:46.669363+0000","last_clean":"2024-09-21T06:10:46.669363+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:10:46.669363+0000","last_undegraded":"2024-09-21T06:10:46.669363+0000","last_fullsized":"2024-09-21T06:10:46.669363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.783364+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:10:46.783364+0000","last_peered":"2024-09-21T06:10:46.783364+0000","last_clean":"2024-09-21T06:10:46.783364+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:10:46.783364+0000","last_undegraded":"2024-09-21T06:10:46.783364+0000","last_fullsized":"2024-09-21T06:10:46.783364+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781769+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:10:46.781769+0000","last_peered":"2024-09-21T06:10:46.781769+0000","last_clean":"2024-09-21T06:10:46.781769+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:10:46.781769+0000","last_undegraded":"2024-09-21T06:10:46.781769+0000","last_fullsized":"2024-09-21T06:10:46.781769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667302+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:10:46.667302+0000","last_peered":"2024-09-21T06:10:46.667302+0000","last_clean":"2024-09-21T06:10:46.667302+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:10:46.667302+0000","last_undegraded":"2024-09-21T06:10:46.667302+0000","last_fullsized":"2024-09-21T06:10:46.667302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728024+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:10:58.728024+0000","last_peered":"2024-09-21T06:10:58.728024+0000","last_clean":"2024-09-21T06:10:58.728024+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:10:58.728024+0000","last_undegraded":"2024-09-21T06:10:58.728024+0000","last_fullsized":"2024-09-21T06:10:58.728024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668811+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:10:46.668811+0000","last_peered":"2024-09-21T06:10:46.668811+0000","last_clean":"2024-09-21T06:10:46.668811+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:10:46.668811+0000","last_undegraded":"2024-09-21T06:10:46.668811+0000","last_fullsized":"2024-09-21T06:10:46.668811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.783877+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:10:46.783877+0000","last_peered":"2024-09-21T06:10:46.783877+0000","last_clean":"2024-09-21T06:10:46.783877+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:10:46.783877+0000","last_undegraded":"2024-09-21T06:10:46.783877+0000","last_fullsized":"2024-09-21T06:10:46.783877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667938+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:10:46.667938+0000","last_peered":"2024-09-21T06:10:46.667938+0000","last_clean":"2024-09-21T06:10:46.667938+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:10:46.667938+0000","last_undegraded":"2024-09-21T06:10:46.667938+0000","last_fullsized":"2024-09-21T06:10:46.667938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668635+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:10:46.668635+0000","last_peered":"2024-09-21T06:10:46.668635+0000","last_clean":"2024-09-21T06:10:46.668635+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:10:46.668635+0000","last_undegraded":"2024-09-21T06:10:46.668635+0000","last_fullsized":"2024-09-21T06:10:46.668635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665968+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:10:46.665968+0000","last_peered":"2024-09-21T06:10:46.665968+0000","last_clean":"2024-09-21T06:10:46.665968+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:10:46.665968+0000","last_undegraded":"2024-09-21T06:10:46.665968+0000","last_fullsized":"2024-09-21T06:10:46.665968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665428+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:10:46.665428+0000","last_peered":"2024-09-21T06:10:46.665428+0000","last_clean":"2024-09-21T06:10:46.665428+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:10:46.665428+0000","last_undegraded":"2024-09-21T06:10:46.665428+0000","last_fullsized":"2024-09-21T06:10:46.665428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.720178+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:10:57.720178+0000","last_peered":"2024-09-21T06:10:57.720178+0000","last_clean":"2024-09-21T06:10:57.720178+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:10:57.720178+0000","last_undegraded":"2024-09-21T06:10:57.720178+0000","last_fullsized":"2024-09-21T06:10:57.720178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666637+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:10:46.666637+0000","last_peered":"2024-09-21T06:10:46.666637+0000","last_clean":"2024-09-21T06:10:46.666637+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:10:46.666637+0000","last_undegraded":"2024-09-21T06:10:46.666637+0000","last_fullsized":"2024-09-21T06:10:46.666637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781826+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:10:46.781826+0000","last_peered":"2024-09-21T06:10:46.781826+0000","last_clean":"2024-09-21T06:10:46.781826+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:10:46.781826+0000","last_undegraded":"2024-09-21T06:10:46.781826+0000","last_fullsized":"2024-09-21T06:10:46.781826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669228+0000","last_change":"2024-09-21T06:10:14.525305+0000","last_active":"2024-09-21T06:10:46.669228+0000","last_peered":"2024-09-21T06:10:46.669228+0000","last_clean":"2024-09-21T06:10:46.669228+0000","last_became_active":"2024-09-21T06:10:14.524676+0000","last_became_peered":"2024-09-21T06:10:14.524676+0000","last_unstale":"2024-09-21T06:10:46.669228+0000","last_undegraded":"2024-09-21T06:10:46.669228+0000","last_fullsized":"2024-09-21T06:10:46.669228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:35.514346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666744+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:10:46.666744+0000","last_peered":"2024-09-21T06:10:46.666744+0000","last_clean":"2024-09-21T06:10:46.666744+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:10:46.666744+0000","last_undegraded":"2024-09-21T06:10:46.666744+0000","last_fullsized":"2024-09-21T06:10:46.666744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662171+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:10:46.662171+0000","last_peered":"2024-09-21T06:10:46.662171+0000","last_clean":"2024-09-21T06:10:46.662171+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:10:46.662171+0000","last_undegraded":"2024-09-21T06:10:46.662171+0000","last_fullsized":"2024-09-21T06:10:46.662171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.721227+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:10:57.721227+0000","last_peered":"2024-09-21T06:10:57.721227+0000","last_clean":"2024-09-21T06:10:57.721227+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:10:57.721227+0000","last_undegraded":"2024-09-21T06:10:57.721227+0000","last_fullsized":"2024-09-21T06:10:57.721227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.785749+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:10:46.785749+0000","last_peered":"2024-09-21T06:10:46.785749+0000","last_clean":"2024-09-21T06:10:46.785749+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:10:46.785749+0000","last_undegraded":"2024-09-21T06:10:46.785749+0000","last_fullsized":"2024-09-21T06:10:46.785749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665489+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:10:46.665489+0000","last_peered":"2024-09-21T06:10:46.665489+0000","last_clean":"2024-09-21T06:10:46.665489+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:10:46.665489+0000","last_undegraded":"2024-09-21T06:10:46.665489+0000","last_fullsized":"2024-09-21T06:10:46.665489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719464+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:10:57.719464+0000","last_peered":"2024-09-21T06:10:57.719464+0000","last_clean":"2024-09-21T06:10:57.719464+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:10:57.719464+0000","last_undegraded":"2024-09-21T06:10:57.719464+0000","last_fullsized":"2024-09-21T06:10:57.719464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.672466+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:10:46.672466+0000","last_peered":"2024-09-21T06:10:46.672466+0000","last_clean":"2024-09-21T06:10:46.672466+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:10:46.672466+0000","last_undegraded":"2024-09-21T06:10:46.672466+0000","last_fullsized":"2024-09-21T06:10:46.672466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782175+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:10:46.782175+0000","last_peered":"2024-09-21T06:10:46.782175+0000","last_clean":"2024-09-21T06:10:46.782175+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:10:46.782175+0000","last_undegraded":"2024-09-21T06:10:46.782175+0000","last_fullsized":"2024-09-21T06:10:46.782175+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.720506+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:10:57.720506+0000","last_peered":"2024-09-21T06:10:57.720506+0000","last_clean":"2024-09-21T06:10:57.720506+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:10:57.720506+0000","last_undegraded":"2024-09-21T06:10:57.720506+0000","last_fullsized":"2024-09-21T06:10:57.720506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669698+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:10:46.669698+0000","last_peered":"2024-09-21T06:10:46.669698+0000","last_clean":"2024-09-21T06:10:46.669698+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:10:46.669698+0000","last_undegraded":"2024-09-21T06:10:46.669698+0000","last_fullsized":"2024-09-21T06:10:46.669698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782959+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:10:46.782959+0000","last_peered":"2024-09-21T06:10:46.782959+0000","last_clean":"2024-09-21T06:10:46.782959+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:10:46.782959+0000","last_undegraded":"2024-09-21T06:10:46.782959+0000","last_fullsized":"2024-09-21T06:10:46.782959+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'10","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:12.558985+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:11:12.558985+0000","last_peered":"2024-09-21T06:11:12.558985+0000","last_clean":"2024-09-21T06:11:12.558985+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:11:12.558985+0000","last_undegraded":"2024-09-21T06:11:12.558985+0000","last_fullsized":"2024-09-21T06:11:12.558985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781359+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:10:46.781359+0000","last_peered":"2024-09-21T06:10:46.781359+0000","last_clean":"2024-09-21T06:10:46.781359+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:10:46.781359+0000","last_undegraded":"2024-09-21T06:10:46.781359+0000","last_fullsized":"2024-09-21T06:10:46.781359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662582+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:10:46.662582+0000","last_peered":"2024-09-21T06:10:46.662582+0000","last_clean":"2024-09-21T06:10:46.662582+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:10:46.662582+0000","last_undegraded":"2024-09-21T06:10:46.662582+0000","last_fullsized":"2024-09-21T06:10:46.662582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719090+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:10:57.719090+0000","last_peered":"2024-09-21T06:10:57.719090+0000","last_clean":"2024-09-21T06:10:57.719090+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:10:57.719090+0000","last_undegraded":"2024-09-21T06:10:57.719090+0000","last_fullsized":"2024-09-21T06:10:57.719090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662295+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:10:46.662295+0000","last_peered":"2024-09-21T06:10:46.662295+0000","last_clean":"2024-09-21T06:10:46.662295+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:10:46.662295+0000","last_undegraded":"2024-09-21T06:10:46.662295+0000","last_fullsized":"2024-09-21T06:10:46.662295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662782+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:10:46.662782+0000","last_peered":"2024-09-21T06:10:46.662782+0000","last_clean":"2024-09-21T06:10:46.662782+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:10:46.662782+0000","last_undegraded":"2024-09-21T06:10:46.662782+0000","last_fullsized":"2024-09-21T06:10:46.662782+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667209+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:10:46.667209+0000","last_peered":"2024-09-21T06:10:46.667209+0000","last_clean":"2024-09-21T06:10:46.667209+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:10:46.667209+0000","last_undegraded":"2024-09-21T06:10:46.667209+0000","last_fullsized":"2024-09-21T06:10:46.667209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665445+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:10:46.665445+0000","last_peered":"2024-09-21T06:10:46.665445+0000","last_clean":"2024-09-21T06:10:46.665445+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:10:46.665445+0000","last_undegraded":"2024-09-21T06:10:46.665445+0000","last_fullsized":"2024-09-21T06:10:46.665445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662648+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:10:46.662648+0000","last_peered":"2024-09-21T06:10:46.662648+0000","last_clean":"2024-09-21T06:10:46.662648+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:10:46.662648+0000","last_undegraded":"2024-09-21T06:10:46.662648+0000","last_fullsized":"2024-09-21T06:10:46.662648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665719+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:10:46.665719+0000","last_peered":"2024-09-21T06:10:46.665719+0000","last_clean":"2024-09-21T06:10:46.665719+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:10:46.665719+0000","last_undegraded":"2024-09-21T06:10:46.665719+0000","last_fullsized":"2024-09-21T06:10:46.665719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662439+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:10:46.662439+0000","last_peered":"2024-09-21T06:10:46.662439+0000","last_clean":"2024-09-21T06:10:46.662439+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:10:46.662439+0000","last_undegraded":"2024-09-21T06:10:46.662439+0000","last_fullsized":"2024-09-21T06:10:46.662439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666257+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:10:46.666257+0000","last_peered":"2024-09-21T06:10:46.666257+0000","last_clean":"2024-09-21T06:10:46.666257+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:10:46.666257+0000","last_undegraded":"2024-09-21T06:10:46.666257+0000","last_fullsized":"2024-09-21T06:10:46.666257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:11.753657+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:11:11.753657+0000","last_peered":"2024-09-21T06:11:11.753657+0000","last_clean":"2024-09-21T06:11:11.753657+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:11:11.753657+0000","last_undegraded":"2024-09-21T06:11:11.753657+0000","last_fullsized":"2024-09-21T06:11:11.753657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662122+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:10:46.662122+0000","last_peered":"2024-09-21T06:10:46.662122+0000","last_clean":"2024-09-21T06:10:46.662122+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:10:46.662122+0000","last_undegraded":"2024-09-21T06:10:46.662122+0000","last_fullsized":"2024-09-21T06:10:46.662122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.661552+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:10:46.661552+0000","last_peered":"2024-09-21T06:10:46.661552+0000","last_clean":"2024-09-21T06:10:46.661552+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:10:46.661552+0000","last_undegraded":"2024-09-21T06:10:46.661552+0000","last_fullsized":"2024-09-21T06:10:46.661552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728196+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:10:58.728196+0000","last_peered":"2024-09-21T06:10:58.728196+0000","last_clean":"2024-09-21T06:10:58.728196+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:10:58.728196+0000","last_undegraded":"2024-09-21T06:10:58.728196+0000","last_fullsized":"2024-09-21T06:10:58.728196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668039+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:10:46.668039+0000","last_peered":"2024-09-21T06:10:46.668039+0000","last_clean":"2024-09-21T06:10:46.668039+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:10:46.668039+0000","last_undegraded":"2024-09-21T06:10:46.668039+0000","last_fullsized":"2024-09-21T06:10:46.668039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782207+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:10:46.782207+0000","last_peered":"2024-09-21T06:10:46.782207+0000","last_clean":"2024-09-21T06:10:46.782207+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:10:46.782207+0000","last_undegraded":"2024-09-21T06:10:46.782207+0000","last_fullsized":"2024-09-21T06:10:46.782207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:59.733129+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:10:59.733129+0000","last_peered":"2024-09-21T06:10:59.733129+0000","last_clean":"2024-09-21T06:10:59.733129+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:10:59.733129+0000","last_undegraded":"2024-09-21T06:10:59.733129+0000","last_fullsized":"2024-09-21T06:10:59.733129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665176+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:10:46.665176+0000","last_peered":"2024-09-21T06:10:46.665176+0000","last_clean":"2024-09-21T06:10:46.665176+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:10:46.665176+0000","last_undegraded":"2024-09-21T06:10:46.665176+0000","last_fullsized":"2024-09-21T06:10:46.665176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666371+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:10:46.666371+0000","last_peered":"2024-09-21T06:10:46.666371+0000","last_clean":"2024-09-21T06:10:46.666371+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:10:46.666371+0000","last_undegraded":"2024-09-21T06:10:46.666371+0000","last_fullsized":"2024-09-21T06:10:46.666371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666649+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:10:46.666649+0000","last_peered":"2024-09-21T06:10:46.666649+0000","last_clean":"2024-09-21T06:10:46.666649+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:10:46.666649+0000","last_undegraded":"2024-09-21T06:10:46.666649+0000","last_fullsized":"2024-09-21T06:10:46.666649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.729128+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:10:58.729128+0000","last_peered":"2024-09-21T06:10:58.729128+0000","last_clean":"2024-09-21T06:10:58.729128+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:10:58.729128+0000","last_undegraded":"2024-09-21T06:10:58.729128+0000","last_fullsized":"2024-09-21T06:10:58.729128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667558+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:10:46.667558+0000","last_peered":"2024-09-21T06:10:46.667558+0000","last_clean":"2024-09-21T06:10:46.667558+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:10:46.667558+0000","last_undegraded":"2024-09-21T06:10:46.667558+0000","last_fullsized":"2024-09-21T06:10:46.667558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666069+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:10:46.666069+0000","last_peered":"2024-09-21T06:10:46.666069+0000","last_clean":"2024-09-21T06:10:46.666069+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:10:46.666069+0000","last_undegraded":"2024-09-21T06:10:46.666069+0000","last_fullsized":"2024-09-21T06:10:46.666069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669045+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:10:46.669045+0000","last_peered":"2024-09-21T06:10:46.669045+0000","last_clean":"2024-09-21T06:10:46.669045+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:10:46.669045+0000","last_undegraded":"2024-09-21T06:10:46.669045+0000","last_fullsized":"2024-09-21T06:10:46.669045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781766+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:10:46.781766+0000","last_peered":"2024-09-21T06:10:46.781766+0000","last_clean":"2024-09-21T06:10:46.781766+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:10:46.781766+0000","last_undegraded":"2024-09-21T06:10:46.781766+0000","last_fullsized":"2024-09-21T06:10:46.781766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667062+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:10:46.667062+0000","last_peered":"2024-09-21T06:10:46.667062+0000","last_clean":"2024-09-21T06:10:46.667062+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:10:46.667062+0000","last_undegraded":"2024-09-21T06:10:46.667062+0000","last_fullsized":"2024-09-21T06:10:46.667062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662151+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:10:46.662151+0000","last_peered":"2024-09-21T06:10:46.662151+0000","last_clean":"2024-09-21T06:10:46.662151+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:10:46.662151+0000","last_undegraded":"2024-09-21T06:10:46.662151+0000","last_fullsized":"2024-09-21T06:10:46.662151+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665272+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:10:46.665272+0000","last_peered":"2024-09-21T06:10:46.665272+0000","last_clean":"2024-09-21T06:10:46.665272+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:10:46.665272+0000","last_undegraded":"2024-09-21T06:10:46.665272+0000","last_fullsized":"2024-09-21T06:10:46.665272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662603+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:10:46.662603+0000","last_peered":"2024-09-21T06:10:46.662603+0000","last_clean":"2024-09-21T06:10:46.662603+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:10:46.662603+0000","last_undegraded":"2024-09-21T06:10:46.662603+0000","last_fullsized":"2024-09-21T06:10:46.662603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:59.724241+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:10:59.724241+0000","last_peered":"2024-09-21T06:10:59.724241+0000","last_clean":"2024-09-21T06:10:59.724241+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:10:59.724241+0000","last_undegraded":"2024-09-21T06:10:59.724241+0000","last_fullsized":"2024-09-21T06:10:59.724241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665799+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:10:46.665799+0000","last_peered":"2024-09-21T06:10:46.665799+0000","last_clean":"2024-09-21T06:10:46.665799+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:10:46.665799+0000","last_undegraded":"2024-09-21T06:10:46.665799+0000","last_fullsized":"2024-09-21T06:10:46.665799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666008+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:10:46.666008+0000","last_peered":"2024-09-21T06:10:46.666008+0000","last_clean":"2024-09-21T06:10:46.666008+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:10:46.666008+0000","last_undegraded":"2024-09-21T06:10:46.666008+0000","last_fullsized":"2024-09-21T06:10:46.666008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.729380+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:10:58.729380+0000","last_peered":"2024-09-21T06:10:58.729380+0000","last_clean":"2024-09-21T06:10:58.729380+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:10:58.729380+0000","last_undegraded":"2024-09-21T06:10:58.729380+0000","last_fullsized":"2024-09-21T06:10:58.729380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662143+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:10:46.662143+0000","last_peered":"2024-09-21T06:10:46.662143+0000","last_clean":"2024-09-21T06:10:46.662143+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:10:46.662143+0000","last_undegraded":"2024-09-21T06:10:46.662143+0000","last_fullsized":"2024-09-21T06:10:46.662143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.664755+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:10:46.664755+0000","last_peered":"2024-09-21T06:10:46.664755+0000","last_clean":"2024-09-21T06:10:46.664755+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:10:46.664755+0000","last_undegraded":"2024-09-21T06:10:46.664755+0000","last_fullsized":"2024-09-21T06:10:46.664755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:13.757499+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:11:13.757499+0000","last_peered":"2024-09-21T06:11:13.757499+0000","last_clean":"2024-09-21T06:11:13.757499+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:11:13.757499+0000","last_undegraded":"2024-09-21T06:11:13.757499+0000","last_fullsized":"2024-09-21T06:11:13.757499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667182+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:10:46.667182+0000","last_peered":"2024-09-21T06:10:46.667182+0000","last_clean":"2024-09-21T06:10:46.667182+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:10:46.667182+0000","last_undegraded":"2024-09-21T06:10:46.667182+0000","last_fullsized":"2024-09-21T06:10:46.667182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668971+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:10:46.668971+0000","last_peered":"2024-09-21T06:10:46.668971+0000","last_clean":"2024-09-21T06:10:46.668971+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:10:46.668971+0000","last_undegraded":"2024-09-21T06:10:46.668971+0000","last_fullsized":"2024-09-21T06:10:46.668971+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719870+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:10:57.719870+0000","last_peered":"2024-09-21T06:10:57.719870+0000","last_clean":"2024-09-21T06:10:57.719870+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:10:57.719870+0000","last_undegraded":"2024-09-21T06:10:57.719870+0000","last_fullsized":"2024-09-21T06:10:57.719870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662354+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:10:46.662354+0000","last_peered":"2024-09-21T06:10:46.662354+0000","last_clean":"2024-09-21T06:10:46.662354+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:10:46.662354+0000","last_undegraded":"2024-09-21T06:10:46.662354+0000","last_fullsized":"2024-09-21T06:10:46.662354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.661779+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:10:46.661779+0000","last_peered":"2024-09-21T06:10:46.661779+0000","last_clean":"2024-09-21T06:10:46.661779+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:10:46.661779+0000","last_undegraded":"2024-09-21T06:10:46.661779+0000","last_fullsized":"2024-09-21T06:10:46.661779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728912+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:10:58.728912+0000","last_peered":"2024-09-21T06:10:58.728912+0000","last_clean":"2024-09-21T06:10:58.728912+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:10:58.728912+0000","last_undegraded":"2024-09-21T06:10:58.728912+0000","last_fullsized":"2024-09-21T06:10:58.728912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.668516+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:10:46.668516+0000","last_peered":"2024-09-21T06:10:46.668516+0000","last_clean":"2024-09-21T06:10:46.668516+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:10:46.668516+0000","last_undegraded":"2024-09-21T06:10:46.668516+0000","last_fullsized":"2024-09-21T06:10:46.668516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665490+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:10:46.665490+0000","last_peered":"2024-09-21T06:10:46.665490+0000","last_clean":"2024-09-21T06:10:46.665490+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:10:46.665490+0000","last_undegraded":"2024-09-21T06:10:46.665490+0000","last_fullsized":"2024-09-21T06:10:46.665490+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:14.765489+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:11:14.765489+0000","last_peered":"2024-09-21T06:11:14.765489+0000","last_clean":"2024-09-21T06:11:14.765489+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:11:14.765489+0000","last_undegraded":"2024-09-21T06:11:14.765489+0000","last_fullsized":"2024-09-21T06:11:14.765489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56544,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":74,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.672317+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:10:46.672317+0000","last_peered":"2024-09-21T06:10:46.672317+0000","last_clean":"2024-09-21T06:10:46.672317+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:10:46.672317+0000","last_undegraded":"2024-09-21T06:10:46.672317+0000","last_fullsized":"2024-09-21T06:10:46.672317+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.671697+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:10:46.671697+0000","last_peered":"2024-09-21T06:10:46.671697+0000","last_clean":"2024-09-21T06:10:46.671697+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:10:46.671697+0000","last_undegraded":"2024-09-21T06:10:46.671697+0000","last_fullsized":"2024-09-21T06:10:46.671697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.719371+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:10:57.719371+0000","last_peered":"2024-09-21T06:10:57.719371+0000","last_clean":"2024-09-21T06:10:57.719371+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:10:57.719371+0000","last_undegraded":"2024-09-21T06:10:57.719371+0000","last_fullsized":"2024-09-21T06:10:57.719371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667532+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:10:46.667532+0000","last_peered":"2024-09-21T06:10:46.667532+0000","last_clean":"2024-09-21T06:10:46.667532+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:10:46.667532+0000","last_undegraded":"2024-09-21T06:10:46.667532+0000","last_fullsized":"2024-09-21T06:10:46.667532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782046+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:10:46.782046+0000","last_peered":"2024-09-21T06:10:46.782046+0000","last_clean":"2024-09-21T06:10:46.782046+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:10:46.782046+0000","last_undegraded":"2024-09-21T06:10:46.782046+0000","last_fullsized":"2024-09-21T06:10:46.782046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:57.720209+0000","last_change":"2024-09-21T06:10:14.530091+0000","last_active":"2024-09-21T06:10:57.720209+0000","last_peered":"2024-09-21T06:10:57.720209+0000","last_clean":"2024-09-21T06:10:57.720209+0000","last_became_active":"2024-09-21T06:10:14.528930+0000","last_became_peered":"2024-09-21T06:10:14.528930+0000","last_unstale":"2024-09-21T06:10:57.720209+0000","last_undegraded":"2024-09-21T06:10:57.720209+0000","last_fullsized":"2024-09-21T06:10:57.720209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:43.383149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666269+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:10:46.666269+0000","last_peered":"2024-09-21T06:10:46.666269+0000","last_clean":"2024-09-21T06:10:46.666269+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:10:46.666269+0000","last_undegraded":"2024-09-21T06:10:46.666269+0000","last_fullsized":"2024-09-21T06:10:46.666269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669572+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:10:46.669572+0000","last_peered":"2024-09-21T06:10:46.669572+0000","last_clean":"2024-09-21T06:10:46.669572+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:10:46.669572+0000","last_undegraded":"2024-09-21T06:10:46.669572+0000","last_fullsized":"2024-09-21T06:10:46.669572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:13.758048+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:11:13.758048+0000","last_peered":"2024-09-21T06:11:13.758048+0000","last_clean":"2024-09-21T06:11:13.758048+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:11:13.758048+0000","last_undegraded":"2024-09-21T06:11:13.758048+0000","last_fullsized":"2024-09-21T06:11:13.758048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782132+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:10:46.782132+0000","last_peered":"2024-09-21T06:10:46.782132+0000","last_clean":"2024-09-21T06:10:46.782132+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:10:46.782132+0000","last_undegraded":"2024-09-21T06:10:46.782132+0000","last_fullsized":"2024-09-21T06:10:46.782132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781867+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:10:46.781867+0000","last_peered":"2024-09-21T06:10:46.781867+0000","last_clean":"2024-09-21T06:10:46.781867+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:10:46.781867+0000","last_undegraded":"2024-09-21T06:10:46.781867+0000","last_fullsized":"2024-09-21T06:10:46.781867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666457+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:10:46.666457+0000","last_peered":"2024-09-21T06:10:46.666457+0000","last_clean":"2024-09-21T06:10:46.666457+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:10:46.666457+0000","last_undegraded":"2024-09-21T06:10:46.666457+0000","last_fullsized":"2024-09-21T06:10:46.666457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666496+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:10:46.666496+0000","last_peered":"2024-09-21T06:10:46.666496+0000","last_clean":"2024-09-21T06:10:46.666496+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:10:46.666496+0000","last_undegraded":"2024-09-21T06:10:46.666496+0000","last_fullsized":"2024-09-21T06:10:46.666496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662493+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:10:46.662493+0000","last_peered":"2024-09-21T06:10:46.662493+0000","last_clean":"2024-09-21T06:10:46.662493+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:10:46.662493+0000","last_undegraded":"2024-09-21T06:10:46.662493+0000","last_fullsized":"2024-09-21T06:10:46.662493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781212+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:10:46.781212+0000","last_peered":"2024-09-21T06:10:46.781212+0000","last_clean":"2024-09-21T06:10:46.781212+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:10:46.781212+0000","last_undegraded":"2024-09-21T06:10:46.781212+0000","last_fullsized":"2024-09-21T06:10:46.781212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.729316+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:10:58.729316+0000","last_peered":"2024-09-21T06:10:58.729316+0000","last_clean":"2024-09-21T06:10:58.729316+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:10:58.729316+0000","last_undegraded":"2024-09-21T06:10:58.729316+0000","last_fullsized":"2024-09-21T06:10:58.729316+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:58.728411+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:10:58.728411+0000","last_peered":"2024-09-21T06:10:58.728411+0000","last_clean":"2024-09-21T06:10:58.728411+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:10:58.728411+0000","last_undegraded":"2024-09-21T06:10:58.728411+0000","last_fullsized":"2024-09-21T06:10:58.728411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.784640+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:10:46.784640+0000","last_peered":"2024-09-21T06:10:46.784640+0000","last_clean":"2024-09-21T06:10:46.784640+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:10:46.784640+0000","last_undegraded":"2024-09-21T06:10:46.784640+0000","last_fullsized":"2024-09-21T06:10:46.784640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.671146+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:10:46.671146+0000","last_peered":"2024-09-21T06:10:46.671146+0000","last_clean":"2024-09-21T06:10:46.671146+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:10:46.671146+0000","last_undegraded":"2024-09-21T06:10:46.671146+0000","last_fullsized":"2024-09-21T06:10:46.671146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:11:14.759608+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:11:14.759608+0000","last_peered":"2024-09-21T06:11:14.759608+0000","last_clean":"2024-09-21T06:11:14.759608+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:11:14.759608+0000","last_undegraded":"2024-09-21T06:11:14.759608+0000","last_fullsized":"2024-09-21T06:11:14.759608+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665662+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:10:46.665662+0000","last_peered":"2024-09-21T06:10:46.665662+0000","last_clean":"2024-09-21T06:10:46.665662+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:10:46.665662+0000","last_undegraded":"2024-09-21T06:10:46.665662+0000","last_fullsized":"2024-09-21T06:10:46.665662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669469+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:10:46.669469+0000","last_peered":"2024-09-21T06:10:46.669469+0000","last_clean":"2024-09-21T06:10:46.669469+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:10:46.669469+0000","last_undegraded":"2024-09-21T06:10:46.669469+0000","last_fullsized":"2024-09-21T06:10:46.669469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662094+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:10:46.662094+0000","last_peered":"2024-09-21T06:10:46.662094+0000","last_clean":"2024-09-21T06:10:46.662094+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:10:46.662094+0000","last_undegraded":"2024-09-21T06:10:46.662094+0000","last_fullsized":"2024-09-21T06:10:46.662094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669814+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:10:46.669814+0000","last_peered":"2024-09-21T06:10:46.669814+0000","last_clean":"2024-09-21T06:10:46.669814+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:10:46.669814+0000","last_undegraded":"2024-09-21T06:10:46.669814+0000","last_fullsized":"2024-09-21T06:10:46.669814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669011+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:10:46.669011+0000","last_peered":"2024-09-21T06:10:46.669011+0000","last_clean":"2024-09-21T06:10:46.669011+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:10:46.669011+0000","last_undegraded":"2024-09-21T06:10:46.669011+0000","last_fullsized":"2024-09-21T06:10:46.669011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781947+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:10:46.781947+0000","last_peered":"2024-09-21T06:10:46.781947+0000","last_clean":"2024-09-21T06:10:46.781947+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:10:46.781947+0000","last_undegraded":"2024-09-21T06:10:46.781947+0000","last_fullsized":"2024-09-21T06:10:46.781947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.784679+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:10:46.784679+0000","last_peered":"2024-09-21T06:10:46.784679+0000","last_clean":"2024-09-21T06:10:46.784679+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:10:46.784679+0000","last_undegraded":"2024-09-21T06:10:46.784679+0000","last_fullsized":"2024-09-21T06:10:46.784679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662564+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:10:46.662564+0000","last_peered":"2024-09-21T06:10:46.662564+0000","last_clean":"2024-09-21T06:10:46.662564+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:10:46.662564+0000","last_undegraded":"2024-09-21T06:10:46.662564+0000","last_fullsized":"2024-09-21T06:10:46.662564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669370+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:10:46.669370+0000","last_peered":"2024-09-21T06:10:46.669370+0000","last_clean":"2024-09-21T06:10:46.669370+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:10:46.669370+0000","last_undegraded":"2024-09-21T06:10:46.669370+0000","last_fullsized":"2024-09-21T06:10:46.669370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782814+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:10:46.782814+0000","last_peered":"2024-09-21T06:10:46.782814+0000","last_clean":"2024-09-21T06:10:46.782814+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:10:46.782814+0000","last_undegraded":"2024-09-21T06:10:46.782814+0000","last_fullsized":"2024-09-21T06:10:46.782814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666148+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:10:46.666148+0000","last_peered":"2024-09-21T06:10:46.666148+0000","last_clean":"2024-09-21T06:10:46.666148+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:10:46.666148+0000","last_undegraded":"2024-09-21T06:10:46.666148+0000","last_fullsized":"2024-09-21T06:10:46.666148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782016+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:10:46.782016+0000","last_peered":"2024-09-21T06:10:46.782016+0000","last_clean":"2024-09-21T06:10:46.782016+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:10:46.782016+0000","last_undegraded":"2024-09-21T06:10:46.782016+0000","last_fullsized":"2024-09-21T06:10:46.782016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669051+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:10:46.669051+0000","last_peered":"2024-09-21T06:10:46.669051+0000","last_clean":"2024-09-21T06:10:46.669051+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:10:46.669051+0000","last_undegraded":"2024-09-21T06:10:46.669051+0000","last_fullsized":"2024-09-21T06:10:46.669051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662291+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:10:46.662291+0000","last_peered":"2024-09-21T06:10:46.662291+0000","last_clean":"2024-09-21T06:10:46.662291+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:10:46.662291+0000","last_undegraded":"2024-09-21T06:10:46.662291+0000","last_fullsized":"2024-09-21T06:10:46.662291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662360+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:10:46.662360+0000","last_peered":"2024-09-21T06:10:46.662360+0000","last_clean":"2024-09-21T06:10:46.662360+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:10:46.662360+0000","last_undegraded":"2024-09-21T06:10:46.662360+0000","last_fullsized":"2024-09-21T06:10:46.662360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669673+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:10:46.669673+0000","last_peered":"2024-09-21T06:10:46.669673+0000","last_clean":"2024-09-21T06:10:46.669673+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:10:46.669673+0000","last_undegraded":"2024-09-21T06:10:46.669673+0000","last_fullsized":"2024-09-21T06:10:46.669673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667358+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:10:46.667358+0000","last_peered":"2024-09-21T06:10:46.667358+0000","last_clean":"2024-09-21T06:10:46.667358+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:10:46.667358+0000","last_undegraded":"2024-09-21T06:10:46.667358+0000","last_fullsized":"2024-09-21T06:10:46.667358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662902+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:10:46.662902+0000","last_peered":"2024-09-21T06:10:46.662902+0000","last_clean":"2024-09-21T06:10:46.662902+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:10:46.662902+0000","last_undegraded":"2024-09-21T06:10:46.662902+0000","last_fullsized":"2024-09-21T06:10:46.662902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667543+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:10:46.667543+0000","last_peered":"2024-09-21T06:10:46.667543+0000","last_clean":"2024-09-21T06:10:46.667543+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:10:46.667543+0000","last_undegraded":"2024-09-21T06:10:46.667543+0000","last_fullsized":"2024-09-21T06:10:46.667543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781168+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:10:46.781168+0000","last_peered":"2024-09-21T06:10:46.781168+0000","last_clean":"2024-09-21T06:10:46.781168+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:10:46.781168+0000","last_undegraded":"2024-09-21T06:10:46.781168+0000","last_fullsized":"2024-09-21T06:10:46.781168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781360+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:10:46.781360+0000","last_peered":"2024-09-21T06:10:46.781360+0000","last_clean":"2024-09-21T06:10:46.781360+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:10:46.781360+0000","last_undegraded":"2024-09-21T06:10:46.781360+0000","last_fullsized":"2024-09-21T06:10:46.781360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662156+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:10:46.662156+0000","last_peered":"2024-09-21T06:10:46.662156+0000","last_clean":"2024-09-21T06:10:46.662156+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:10:46.662156+0000","last_undegraded":"2024-09-21T06:10:46.662156+0000","last_fullsized":"2024-09-21T06:10:46.662156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667199+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:10:46.667199+0000","last_peered":"2024-09-21T06:10:46.667199+0000","last_clean":"2024-09-21T06:10:46.667199+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:10:46.667199+0000","last_undegraded":"2024-09-21T06:10:46.667199+0000","last_fullsized":"2024-09-21T06:10:46.667199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.666509+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:10:46.666509+0000","last_peered":"2024-09-21T06:10:46.666509+0000","last_clean":"2024-09-21T06:10:46.666509+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:10:46.666509+0000","last_undegraded":"2024-09-21T06:10:46.666509+0000","last_fullsized":"2024-09-21T06:10:46.666509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.663328+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:10:46.663328+0000","last_peered":"2024-09-21T06:10:46.663328+0000","last_clean":"2024-09-21T06:10:46.663328+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:10:46.663328+0000","last_undegraded":"2024-09-21T06:10:46.663328+0000","last_fullsized":"2024-09-21T06:10:46.663328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.669687+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:10:46.669687+0000","last_peered":"2024-09-21T06:10:46.669687+0000","last_clean":"2024-09-21T06:10:46.669687+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:10:46.669687+0000","last_undegraded":"2024-09-21T06:10:46.669687+0000","last_fullsized":"2024-09-21T06:10:46.669687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.780994+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:10:46.780994+0000","last_peered":"2024-09-21T06:10:46.780994+0000","last_clean":"2024-09-21T06:10:46.780994+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:10:46.780994+0000","last_undegraded":"2024-09-21T06:10:46.780994+0000","last_fullsized":"2024-09-21T06:10:46.780994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.664855+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:10:46.664855+0000","last_peered":"2024-09-21T06:10:46.664855+0000","last_clean":"2024-09-21T06:10:46.664855+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:10:46.664855+0000","last_undegraded":"2024-09-21T06:10:46.664855+0000","last_fullsized":"2024-09-21T06:10:46.664855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.663041+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:10:46.663041+0000","last_peered":"2024-09-21T06:10:46.663041+0000","last_clean":"2024-09-21T06:10:46.663041+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:10:46.663041+0000","last_undegraded":"2024-09-21T06:10:46.663041+0000","last_fullsized":"2024-09-21T06:10:46.663041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.665738+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:10:46.665738+0000","last_peered":"2024-09-21T06:10:46.665738+0000","last_clean":"2024-09-21T06:10:46.665738+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:10:46.665738+0000","last_undegraded":"2024-09-21T06:10:46.665738+0000","last_fullsized":"2024-09-21T06:10:46.665738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.667042+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:10:46.667042+0000","last_peered":"2024-09-21T06:10:46.667042+0000","last_clean":"2024-09-21T06:10:46.667042+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:10:46.667042+0000","last_undegraded":"2024-09-21T06:10:46.667042+0000","last_fullsized":"2024-09-21T06:10:46.667042+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.781465+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:10:46.781465+0000","last_peered":"2024-09-21T06:10:46.781465+0000","last_clean":"2024-09-21T06:10:46.781465+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:10:46.781465+0000","last_undegraded":"2024-09-21T06:10:46.781465+0000","last_fullsized":"2024-09-21T06:10:46.781465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.782015+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:10:46.782015+0000","last_peered":"2024-09-21T06:10:46.782015+0000","last_clean":"2024-09-21T06:10:46.782015+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:10:46.782015+0000","last_undegraded":"2024-09-21T06:10:46.782015+0000","last_fullsized":"2024-09-21T06:10:46.782015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T06:10:46.662821+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:10:46.662821+0000","last_peered":"2024-09-21T06:10:46.662821+0000","last_clean":"2024-09-21T06:10:46.662821+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:10:46.662821+0000","last_undegraded":"2024-09-21T06:10:46.662821+0000","last_fullsized":"2024-09-21T06:10:46.662821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60154,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":120,"num_read_kb":122,"num_write":161,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":180462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":454850,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1098640,"data_compressed":59761,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070499,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":459160,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":454962,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":1050502,"data_compressed":59761,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":450240,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1046090,"data_compressed":59761,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":454890,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":450434,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":508044,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":506694,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":451628,"data_compressed":23468,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:11:18.261 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:11:18.261 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T06:11:18.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T06:11:18.262 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:17 smithi081 ceph-mon[33870]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:18.523 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.931 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:18 smithi017 ceph-mon[31080]: pgmap v328: 129 pgs: 129 active+clean; 636 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-21T06:11:18.931 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:18 smithi017 ceph-mon[31080]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 -- 172.21.15.17:0/3084763049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c1068d0 msgr2=0x7f3c0c108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 --2- 172.21.15.17:0/3084763049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c1068d0 0x7f3c0c108d30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009900 tx=0x7f3c0002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 -- 172.21.15.17:0/3084763049 shutdown_connections 2024-09-21T06:11:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 --2- 172.21.15.17:0/3084763049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c1068d0 0x7f3c0c108d30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 --2- 172.21.15.17:0/3084763049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c109470 0x7f3c0c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 --2- 172.21.15.17:0/3084763049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0c06b980 0x7f3c0c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 -- 172.21.15.17:0/3084763049 >> 172.21.15.17:0/3084763049 conn(0x7f3c0c0fdfb0 msgr2=0x7f3c0c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 -- 172.21.15.17:0/3084763049 shutdown_connections 2024-09-21T06:11:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.029+0000 7f3c14778640 1 -- 172.21.15.17:0/3084763049 wait complete. 2024-09-21T06:11:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 Processor -- start 2024-09-21T06:11:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 -- start start 2024-09-21T06:11:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c06b980 0x7f3c0c199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0c1068d0 0x7f3c0c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 0x7f3c0c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c10f210 con 0x7f3c0c109470 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c10f090 con 0x7f3c0c1068d0 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.030+0000 7f3c14778640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c10f390 con 0x7f3c0c06b980 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 0x7f3c0c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 0x7f3c0c19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54832/0 (socket says 172.21.15.17:54832) 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 -- 172.21.15.17:0/2198523813 learned_addr learned my addr 172.21.15.17:0/2198523813 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c11d13640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0c1068d0 0x7f3c0c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12514640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c06b980 0x7f3c0c199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 -- 172.21.15.17:0/2198523813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c06b980 msgr2=0x7f3c0c199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c06b980 0x7f3c0c199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 -- 172.21.15.17:0/2198523813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0c1068d0 msgr2=0x7f3c0c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0c1068d0 0x7f3c0c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 -- 172.21.15.17:0/2198523813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c19b860 con 0x7f3c0c109470 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12514640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c06b980 0x7f3c0c199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:19.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c12d15640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 0x7f3c0c19b0d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c970 tx=0x7f3bfc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc007bb0 con 0x7f3c0c109470 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bfc007d50 con 0x7f3c0c109470 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.031+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c19bb50 con 0x7f3c0c109470 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.032+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc018660 con 0x7f3c0c109470 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.032+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c1a22e0 con 0x7f3c0c109470 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.033+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c0ffad0 con 0x7f3c0c109470 2024-09-21T06:11:19.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.034+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3bfc00f970 con 0x7f3c0c109470 2024-09-21T06:11:19.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.035+0000 7f3c0b7fe640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3bf40b6620 0x7f3bf40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:19.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.035+0000 7f3c12514640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3bf40b6620 0x7f3bf40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:19.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.035+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f3bfc0e7b30 con 0x7f3c0c109470 2024-09-21T06:11:19.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.036+0000 7f3c12514640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3bf40b6620 0x7f3bf40b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c04005fd0 tx=0x7f3c04009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:19.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.038+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bfc014030 con 0x7f3c0c109470 2024-09-21T06:11:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:18 smithi089 ceph-mon[33879]: pgmap v328: 129 pgs: 129 active+clean; 636 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-21T06:11:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:18 smithi089 ceph-mon[33879]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:18 smithi081 ceph-mon[33870]: pgmap v328: 129 pgs: 129 active+clean; 636 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-21T06:11:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:18 smithi081 ceph-mon[33870]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.300+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f3c0c02e640 con 0x7f3c0c109470 2024-09-21T06:11:19.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.304+0000 7f3c0b7fe640 1 -- 172.21.15.17:0/2198523813 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f3bfc0adf80 con 0x7f3c0c109470 2024-09-21T06:11:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-21T06:11:19.306 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCHY+5mnSEPEhAAykPMVBfgk6unT/sUl6aPiA== 2024-09-21T06:11:19.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3bf40b6620 msgr2=0x7f3bf40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3bf40b6620 0x7f3bf40b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c04005fd0 tx=0x7f3c04009520 comp rx=0 tx=0).stop 2024-09-21T06:11:19.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 msgr2=0x7f3c0c19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 0x7f3c0c19b0d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c970 tx=0x7f3bfc00ce30 comp rx=0 tx=0).stop 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 shutdown_connections 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3bf40b6620 0x7f3bf40b8b30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c0c109470 0x7f3c0c19b0d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0c1068d0 0x7f3c0c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 --2- 172.21.15.17:0/2198523813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c0c06b980 0x7f3c0c199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 >> 172.21.15.17:0/2198523813 conn(0x7f3c0c0fdfb0 msgr2=0x7f3c0c104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 shutdown_connections 2024-09-21T06:11:19.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:19.306+0000 7f3c14778640 1 -- 172.21.15.17:0/2198523813 wait complete. 2024-09-21T06:11:20.020 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2198523813' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:11:20.020 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2198523813' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:11:20.049 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:11:20.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T06:11:20.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:11:20.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T06:11:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2198523813' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:11:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2198523813' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:11:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2198523813' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:11:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2198523813' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:11:20.381 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:20.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 -- 172.21.15.17:0/2731330519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 msgr2=0x7f19a41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 --2- 172.21.15.17:0/2731330519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a41098c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1998009900 tx=0x7f199802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:20.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 -- 172.21.15.17:0/2731330519 shutdown_connections 2024-09-21T06:11:20.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 --2- 172.21.15.17:0/2731330519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a41098c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 --2- 172.21.15.17:0/2731330519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19a4109e00 0x7f19a4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 --2- 172.21.15.17:0/2731330519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19a4103bc0 0x7f19a4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 -- 172.21.15.17:0/2731330519 >> 172.21.15.17:0/2731330519 conn(0x7f19a407b910 msgr2=0x7f19a407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 -- 172.21.15.17:0/2731330519 shutdown_connections 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.831+0000 7f19a9df6640 1 -- 172.21.15.17:0/2731330519 wait complete. 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 Processor -- start 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 -- start start 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19a4103bc0 0x7f19a419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19a4109e00 0x7f19a419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4113970 con 0x7f19a41094b0 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19a41137f0 con 0x7f19a4103bc0 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.832+0000 7f19a9df6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4113af0 con 0x7f19a4109e00 2024-09-21T06:11:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a419a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54846/0 (socket says 172.21.15.17:54846) 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 -- 172.21.15.17:0/1113392494 learned_addr learned my addr 172.21.15.17:0/1113392494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a37fe640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19a4103bc0 0x7f19a419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a3fff640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19a4109e00 0x7f19a419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 -- 172.21.15.17:0/1113392494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19a4109e00 msgr2=0x7f19a419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19a4109e00 0x7f19a419fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 -- 172.21.15.17:0/1113392494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19a4103bc0 msgr2=0x7f19a419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19a4103bc0 0x7f19a419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 -- 172.21.15.17:0/1113392494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a41a0350 con 0x7f19a41094b0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a2ffd640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a419a980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1998005940 tx=0x7f1998005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199803f030 con 0x7f19a41094b0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19980043d0 con 0x7f19a41094b0 2024-09-21T06:11:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a41a05e0 con 0x7f19a41094b0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998035070 con 0x7f19a41094b0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.833+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41a6da0 con 0x7f19a41094b0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.834+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a4104df0 con 0x7f19a41094b0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.836+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1998042030 con 0x7f19a41094b0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.837+0000 7f19a0ff9640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f198c0b65a0 0x7f198c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.837+0000 7f19a37fe640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f198c0b65a0 0x7f198c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.837+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f1998107fc0 con 0x7f19a41094b0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.838+0000 7f19a37fe640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f198c0b65a0 0x7f198c0b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1994009bd0 tx=0x7f1994005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:20.841+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19980ce390 con 0x7f19a41094b0 2024-09-21T06:11:21.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.029+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f19a410bbf0 con 0x7f19a41094b0 2024-09-21T06:11:21.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.029+0000 7f19a0ff9640 1 -- 172.21.15.17:0/1113392494 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v52) ==== 86+0+133 (secure 0 0 0) 0x7f19980d2770 con 0x7f19a41094b0 2024-09-21T06:11:21.032 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f198c0b65a0 msgr2=0x7f198c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f198c0b65a0 0x7f198c0b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1994009bd0 tx=0x7f1994005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 msgr2=0x7f19a419a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a419a980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1998005940 tx=0x7f1998005e10 comp rx=0 tx=0).stop 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 shutdown_connections 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f198c0b65a0 0x7f198c0b8ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a41094b0 0x7f19a419a980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19a4109e00 0x7f19a419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 --2- 172.21.15.17:0/1113392494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19a4103bc0 0x7f19a419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 >> 172.21.15.17:0/1113392494 conn(0x7f19a407b910 msgr2=0x7f19a41075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 shutdown_connections 2024-09-21T06:11:21.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:21.032+0000 7f19a9df6640 1 -- 172.21.15.17:0/1113392494 wait complete. 2024-09-21T06:11:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:20 smithi089 ceph-mon[33879]: pgmap v329: 129 pgs: 129 active+clean; 636 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-21T06:11:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:20 smithi017 ceph-mon[31080]: pgmap v329: 129 pgs: 129 active+clean; 636 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-21T06:11:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:20 smithi081 ceph-mon[33870]: pgmap v329: 129 pgs: 129 active+clean; 636 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-21T06:11:21.780 INFO:teuthology.orchestra.run.smithi017.stdout:[{"version":52,"timestamp":"2024-09-21T06:10:06.905032+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T06:11:21.780 INFO:tasks.ceph_manager:config epoch is 52 2024-09-21T06:11:21.781 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:11:21.781 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:11:21.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T06:11:22.045 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:21 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1113392494' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:11:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:21 smithi089 ceph-mon[33879]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-21T06:11:22.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:21 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1113392494' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:11:22.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:21 smithi017 ceph-mon[31080]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-21T06:11:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:21 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1113392494' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:11:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:21 smithi081 ceph-mon[33870]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-09-21T06:11:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 -- 172.21.15.17:0/3434399826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 msgr2=0x7f70881098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 --2- 172.21.15.17:0/3434399826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f70881098b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7078009900 tx=0x7f707802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 -- 172.21.15.17:0/3434399826 shutdown_connections 2024-09-21T06:11:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 --2- 172.21.15.17:0/3434399826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f70881098b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 --2- 172.21.15.17:0/3434399826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7088109df0 0x7f7088110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 --2- 172.21.15.17:0/3434399826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088103b60 0x7f7088103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 -- 172.21.15.17:0/3434399826 >> 172.21.15.17:0/3434399826 conn(0x7f708807b850 msgr2=0x7f708807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 -- 172.21.15.17:0/3434399826 shutdown_connections 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 -- 172.21.15.17:0/3434399826 wait complete. 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 Processor -- start 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.652+0000 7f7090288640 1 -- start start 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f7090288640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7088103b60 0x7f708819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f7090288640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f708819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f7090288640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088109df0 0x7f708819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f7090288640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113960 con 0x7f70881094a0 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f7090288640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70881137e0 con 0x7f7088109df0 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f7090288640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7088113ae0 con 0x7f7088103b60 2024-09-21T06:11:22.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f708819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f708819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54852/0 (socket says 172.21.15.17:54852) 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 -- 172.21.15.17:0/1583159781 learned_addr learned my addr 172.21.15.17:0/1583159781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708e024640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7088103b60 0x7f708819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708e825640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088109df0 0x7f708819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 -- 172.21.15.17:0/1583159781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7088103b60 msgr2=0x7f708819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7088103b60 0x7f708819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 -- 172.21.15.17:0/1583159781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088109df0 msgr2=0x7f708819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088109df0 0x7f708819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 -- 172.21.15.17:0/1583159781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70881a02e0 con 0x7f70881094a0 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708e825640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088109df0 0x7f708819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.653+0000 7f708d823640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f708819a9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7078005940 tx=0x7f70780040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.654+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707803f030 con 0x7f70881094a0 2024-09-21T06:11:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.654+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7078003a80 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.654+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70881a0570 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.654+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078035070 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.654+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70881a0a50 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.655+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7088103f70 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.656+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7078042030 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.657+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f70740b65d0 0x7f70740b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.657+0000 7f708e024640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f70740b65d0 0x7f70740b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.658+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f7078107df0 con 0x7f70881094a0 2024-09-21T06:11:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.658+0000 7f708e024640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f70740b65d0 0x7f70740b8ae0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7084005e10 tx=0x7f7084005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.663+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70780ce1c0 con 0x7f70881094a0 2024-09-21T06:11:22.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.901+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f708810b650 con 0x7f70881094a0 2024-09-21T06:11:22.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.906+0000 7f707f7fe640 1 -- 172.21.15.17:0/1583159781 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296436 (secure 0 0 0) 0x7f70780d25a0 con 0x7f70881094a0 2024-09-21T06:11:22.912 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:22.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f70740b65d0 msgr2=0x7f70740b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f70740b65d0 0x7f70740b8ae0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7084005e10 tx=0x7f7084005da0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 msgr2=0x7f708819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f708819a9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7078005940 tx=0x7f70780040e0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 shutdown_connections 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f70740b65d0 0x7f70740b8ae0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70881094a0 0x7f708819a9d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7088109df0 0x7f708819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 --2- 172.21.15.17:0/1583159781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7088103b60 0x7f708819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 >> 172.21.15.17:0/1583159781 conn(0x7f708807b850 msgr2=0x7f70881076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 shutdown_connections 2024-09-21T06:11:22.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:22.909+0000 7f7090288640 1 -- 172.21.15.17:0/1583159781 wait complete. 2024-09-21T06:11:23.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:22 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1583159781' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:11:23.289 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:22 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1583159781' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:11:23.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:22 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1583159781' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:11:23.662 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1923174301},{"type":"v1","addr":"172.21.15.17:6801","nonce":1923174301}]},"active_addr":"172.21.15.17:6801/1923174301","active_change":"2024-09-21T06:02:45.023166+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24118,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24134,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":4286381233}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1781694430}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2386741731}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":894474877}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":537815198}]}]} 2024-09-21T06:11:23.669 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T06:11:23.669 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T06:11:23.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:11:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:24.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:23 smithi081 ceph-mon[33870]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T06:11:24.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:23 smithi017 ceph-mon[31080]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T06:11:24.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:23 smithi089 ceph-mon[33879]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T06:11:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 -- 172.21.15.17:0/482288537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e381083c0 msgr2=0x7f9e381087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/482288537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e381083c0 0x7f9e381087d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009900 tx=0x7f9e2c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 -- 172.21.15.17:0/482288537 shutdown_connections 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/482288537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e381083c0 0x7f9e381087d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/482288537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38108d10 0x7f9e3810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/482288537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e38102a80 0x7f9e38102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 -- 172.21.15.17:0/482288537 >> 172.21.15.17:0/482288537 conn(0x7f9e38079740 msgr2=0x7f9e38079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 -- 172.21.15.17:0/482288537 shutdown_connections 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.409+0000 7f9e3ce13640 1 -- 172.21.15.17:0/482288537 wait complete. 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.410+0000 7f9e3ce13640 1 Processor -- start 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.410+0000 7f9e3ce13640 1 -- start start 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3ce13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38102a80 0x7f9e3819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3ce13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e381083c0 0x7f9e3819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3ce13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 0x7f9e381a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3ce13640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38112830 con 0x7f9e38108d10 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3ce13640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e381126b0 con 0x7f9e381083c0 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3ce13640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9e381129b0 con 0x7f9e38102a80 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 0x7f9e381a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 0x7f9e381a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54864/0 (socket says 172.21.15.17:54864) 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 -- 172.21.15.17:0/1267892180 learned_addr learned my addr 172.21.15.17:0/1267892180 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e35d9b640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e381083c0 0x7f9e3819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3659c640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38102a80 0x7f9e3819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 -- 172.21.15.17:0/1267892180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38102a80 msgr2=0x7f9e3819c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38102a80 0x7f9e3819c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 -- 172.21.15.17:0/1267892180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e381083c0 msgr2=0x7f9e3819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e381083c0 0x7f9e3819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 -- 172.21.15.17:0/1267892180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e381a24e0 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e3659c640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38102a80 0x7f9e3819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.411+0000 7f9e36d9d640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 0x7f9e381a1e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c970 tx=0x7f9e3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.412+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30007bb0 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.412+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e30007d50 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.412+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e381a27d0 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.412+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30018660 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.412+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e381a2c90 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.413+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e38103d00 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.415+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e3000f970 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.415+0000 7f9e277fe640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9e200b65d0 0x7f9e200b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.416+0000 7f9e3659c640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9e200b65d0 0x7f9e200b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.416+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f9e300e79d0 con 0x7f9e38108d10 2024-09-21T06:11:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.416+0000 7f9e3659c640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9e200b65d0 0x7f9e200b8ae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005c40 tx=0x7f9e2800a430 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:24.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.419+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e30056710 con 0x7f9e38108d10 2024-09-21T06:11:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.607+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e381006f0 con 0x7f9e38108d10 2024-09-21T06:11:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.609+0000 7f9e277fe640 1 -- 172.21.15.17:0/1267892180 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24681 (secure 0 0 0) 0x7f9e30014030 con 0x7f9e38108d10 2024-09-21T06:11:24.611 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:46.657720+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.611+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9e200b65d0 msgr2=0x7f9e200b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.611+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9e200b65d0 0x7f9e200b8ae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005c40 tx=0x7f9e2800a430 comp rx=0 tx=0).stop 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.611+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 msgr2=0x7f9e381a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.611+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 0x7f9e381a1e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c970 tx=0x7f9e3000ce30 comp rx=0 tx=0).stop 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 shutdown_connections 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9e200b65d0 0x7f9e200b8ae0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e38108d10 0x7f9e381a1e70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e381083c0 0x7f9e3819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 --2- 172.21.15.17:0/1267892180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e38102a80 0x7f9e3819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 >> 172.21.15.17:0/1267892180 conn(0x7f9e38079740 msgr2=0x7f9e38104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 shutdown_connections 2024-09-21T06:11:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:24.612+0000 7f9e3ce13640 1 -- 172.21.15.17:0/1267892180 wait complete. 2024-09-21T06:11:25.241 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:24 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1267892180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:25.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:24 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1267892180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:25.271 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T06:11:25.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:11:25.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:24 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1267892180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:25.529 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:26.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 -- 172.21.15.17:0/2686091362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 msgr2=0x7f4af81066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 --2- 172.21.15.17:0/2686091362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af81066f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009900 tx=0x7f4ae802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:26.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 -- 172.21.15.17:0/2686091362 shutdown_connections 2024-09-21T06:11:26.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 --2- 172.21.15.17:0/2686091362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af81066f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 --2- 172.21.15.17:0/2686091362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 0x7f4af8110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 --2- 172.21.15.17:0/2686091362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4af8102000 0x7f4af8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 -- 172.21.15.17:0/2686091362 >> 172.21.15.17:0/2686091362 conn(0x7f4af8079e40 msgr2=0x7f4af807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 -- 172.21.15.17:0/2686091362 shutdown_connections 2024-09-21T06:11:26.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.028+0000 7f4aff80c640 1 -- 172.21.15.17:0/2686091362 wait complete. 2024-09-21T06:11:26.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.029+0000 7f4aff80c640 1 Processor -- start 2024-09-21T06:11:26.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.029+0000 7f4aff80c640 1 -- start start 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.029+0000 7f4aff80c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4af8102000 0x7f4af819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.029+0000 7f4aff80c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aff80c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 0x7f4af81a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aff80c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8113940 con 0x7f4af81062e0 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aff80c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81137c0 con 0x7f4af8106c30 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aff80c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8113ac0 con 0x7f4af8102000 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54884/0 (socket says 172.21.15.17:54884) 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 -- 172.21.15.17:0/1064451173 learned_addr learned my addr 172.21.15.17:0/1064451173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afdda9640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 0x7f4af81a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afd5a8640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4af8102000 0x7f4af819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 -- 172.21.15.17:0/1064451173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4af8102000 msgr2=0x7f4af819c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4af8102000 0x7f4af819c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 -- 172.21.15.17:0/1064451173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 msgr2=0x7f4af81a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 0x7f4af81a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 -- 172.21.15.17:0/1064451173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af81a25a0 con 0x7f4af81062e0 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afdda9640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 0x7f4af81a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4afcda7640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af819cbd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8005940 tx=0x7f4ae8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae803f030 con 0x7f4af81062e0 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ae8004440 con 0x7f4af81062e0 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8035070 con 0x7f4af81062e0 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.030+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af81a2830 con 0x7f4af81062e0 2024-09-21T06:11:26.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.031+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af81a2cc0 con 0x7f4af81062e0 2024-09-21T06:11:26.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.032+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af8102410 con 0x7f4af81062e0 2024-09-21T06:11:26.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.033+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4ae8042030 con 0x7f4af81062e0 2024-09-21T06:11:26.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.034+0000 7f4aee7fc640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4ae40b65a0 0x7f4ae40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.034+0000 7f4afd5a8640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4ae40b65a0 0x7f4ae40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.034+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f4ae8107db0 con 0x7f4af81062e0 2024-09-21T06:11:26.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.034+0000 7f4afd5a8640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4ae40b65a0 0x7f4ae40b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4af40058c0 tx=0x7f4af400a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.038+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ae810c070 con 0x7f4af81062e0 2024-09-21T06:11:26.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.227+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4af81a91b0 con 0x7f4af81062e0 2024-09-21T06:11:26.229 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:25 smithi017 ceph-mon[31080]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T06:11:26.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.229+0000 7f4aee7fc640 1 -- 172.21.15.17:0/1064451173 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24681 (secure 0 0 0) 0x7f4af81a2cc0 con 0x7f4af81062e0 2024-09-21T06:11:26.231 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:26.231 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:10:46.657720+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4ae40b65a0 msgr2=0x7f4ae40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4ae40b65a0 0x7f4ae40b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4af40058c0 tx=0x7f4af400a4c0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 msgr2=0x7f4af819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af819cbd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8005940 tx=0x7f4ae8004040 comp rx=0 tx=0).stop 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 shutdown_connections 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4ae40b65a0 0x7f4ae40b8ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4af81062e0 0x7f4af819cbd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af8106c30 0x7f4af81a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 --2- 172.21.15.17:0/1064451173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4af8102000 0x7f4af819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 >> 172.21.15.17:0/1064451173 conn(0x7f4af8079e40 msgr2=0x7f4af81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 shutdown_connections 2024-09-21T06:11:26.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:26.232+0000 7f4aff80c640 1 -- 172.21.15.17:0/1064451173 wait complete. 2024-09-21T06:11:26.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:25 smithi081 ceph-mon[33870]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T06:11:26.267 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:25 smithi089 ceph-mon[33879]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-21T06:11:26.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T06:11:26.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T06:11:26.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T06:11:26.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T06:11:26.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T06:11:26.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T06:11:26.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T06:11:26.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T06:11:26.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T06:11:26.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T06:11:26.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T06:11:26.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T06:11:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:26 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1064451173' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:27.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:26 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1064451173' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:27.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:26 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1064451173' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:11:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:27.766 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:28.021 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:28.025 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:28.090 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:27 smithi017 ceph-mon[31080]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-21T06:11:28.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:27 smithi081 ceph-mon[33870]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-21T06:11:28.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:27 smithi089 ceph-mon[33879]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 -- 172.21.15.17:0/2324829359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79681094e0 msgr2=0x7f79681098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2324829359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79681094e0 0x7f79681098f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f795c009900 tx=0x7f795c02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 -- 172.21.15.17:0/2324829359 shutdown_connections 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2324829359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79681094e0 0x7f79681098f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2324829359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7968109e30 0x7f7968110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2324829359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968103ba0 0x7f7968103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 -- 172.21.15.17:0/2324829359 >> 172.21.15.17:0/2324829359 conn(0x7f79680ff630 msgr2=0x7f7968101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 -- 172.21.15.17:0/2324829359 shutdown_connections 2024-09-21T06:11:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.965+0000 7f796e6d8640 1 -- 172.21.15.17:0/2324829359 wait complete. 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 Processor -- start 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 -- start start 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968103ba0 0x7f796819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79681094e0 0x7f796819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7968109e30 0x7f796819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f79681139a0 con 0x7f7968109e30 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7968113820 con 0x7f79681094e0 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796e6d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7968113b20 con 0x7f7968103ba0 2024-09-21T06:11:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796cc75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7968109e30 0x7f796819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.966+0000 7f796cc75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7968109e30 0x7f796819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38664/0 (socket says 172.21.15.17:38664) 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 -- 172.21.15.17:0/2839049927 learned_addr learned my addr 172.21.15.17:0/2839049927 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f7967fff640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968103ba0 0x7f796819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f79677fe640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79681094e0 0x7f796819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 -- 172.21.15.17:0/2839049927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968103ba0 msgr2=0x7f796819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968103ba0 0x7f796819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 -- 172.21.15.17:0/2839049927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79681094e0 msgr2=0x7f796819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79681094e0 0x7f796819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 -- 172.21.15.17:0/2839049927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79681a0280 con 0x7f7968109e30 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796cc75640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7968109e30 0x7f796819fc10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f796000eaa0 tx=0x7f796000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960004d20 con 0x7f7968109e30 2024-09-21T06:11:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79681a0570 con 0x7f7968109e30 2024-09-21T06:11:28.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7960005020 con 0x7f7968109e30 2024-09-21T06:11:28.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.967+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600116d0 con 0x7f7968109e30 2024-09-21T06:11:28.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.968+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79681a6d90 con 0x7f7968109e30 2024-09-21T06:11:28.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.969+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7968063b50 con 0x7f7968109e30 2024-09-21T06:11:28.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.970+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f79600051d0 con 0x7f7968109e30 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.971+0000 7f79657fa640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f79500b65d0 0x7f79500b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.971+0000 7f7967fff640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f79500b65d0 0x7f79500b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.971+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f79600e7d30 con 0x7f7968109e30 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.971+0000 7f79657fa640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] conn(0x7f79500c16e0 0x7f79500c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.971+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 --> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7960018ec0 con 0x7f79500c16e0 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.971+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f79600e8180 con 0x7f7968109e30 2024-09-21T06:11:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.972+0000 7f79677fe640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] conn(0x7f79500c16e0 0x7f79500c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.972+0000 7f7967fff640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f79500b65d0 0x7f79500b8ae0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f795800abe0 tx=0x7f795800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.972+0000 7f79677fe640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] conn(0x7f79500c16e0 0x7f79500c3bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.973+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== osd.3 v2:172.21.15.17:6810/1314832581 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7960018ec0 con 0x7f79500c16e0 2024-09-21T06:11:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.987+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 --> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7968063fd0 con 0x7f79500c16e0 2024-09-21T06:11:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.987+0000 7f79657fa640 1 -- 172.21.15.17:0/2839049927 <== osd.3 v2:172.21.15.17:6810/1314832581 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7968063fd0 con 0x7f79500c16e0 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] conn(0x7f79500c16e0 msgr2=0x7f79500c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] conn(0x7f79500c16e0 0x7f79500c3bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f79500b65d0 msgr2=0x7f79500b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f79500b65d0 0x7f79500b8ae0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f795800abe0 tx=0x7f795800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7968109e30 msgr2=0x7f796819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 --2- 172.21.15.17:0/2839049927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7968109e30 0x7f796819fc10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f796000eaa0 tx=0x7f796000eea0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796cc75640 1 -- 172.21.15.17:0/2839049927 reap_dead start 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 shutdown_connections 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 >> 172.21.15.17:0/2839049927 conn(0x7f79680ff630 msgr2=0x7f7968101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 shutdown_connections 2024-09-21T06:11:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:28.988+0000 7f796e6d8640 1 -- 172.21.15.17:0/2839049927 wait complete. 2024-09-21T06:11:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 -- 172.21.15.17:0/1525337697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 msgr2=0x7ff688110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 --2- 172.21.15.17:0/1525337697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff688110320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff680009ca0 tx=0x7ff68002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 -- 172.21.15.17:0/1525337697 shutdown_connections 2024-09-21T06:11:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 --2- 172.21.15.17:0/1525337697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff688110320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 --2- 172.21.15.17:0/1525337697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff688105320 0x7ff68810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 --2- 172.21.15.17:0/1525337697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6881049d0 0x7ff688104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 -- 172.21.15.17:0/1525337697 >> 172.21.15.17:0/1525337697 conn(0x7ff688079740 msgr2=0x7ff688079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 -- 172.21.15.17:0/1525337697 shutdown_connections 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 -- 172.21.15.17:0/1525337697 wait complete. 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.536+0000 7ff68db75640 1 Processor -- start 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 -- start start 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6881049d0 0x7ff68819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff688105320 0x7ff68819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff68819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff6881139b0 con 0x7ff68810de30 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff688113830 con 0x7ff6881049d0 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff68db75640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff688113b30 con 0x7ff688105320 2024-09-21T06:11:29.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff687fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff68819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff687fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff68819fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38698/0 (socket says 172.21.15.17:38698) 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff687fff640 1 -- 172.21.15.17:0/948890875 learned_addr learned my addr 172.21.15.17:0/948890875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff6877fe640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6881049d0 0x7ff68819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff686ffd640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff688105320 0x7ff68819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.537+0000 7ff687fff640 1 -- 172.21.15.17:0/948890875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff688105320 msgr2=0x7ff68819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff687fff640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff688105320 0x7ff68819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff687fff640 1 -- 172.21.15.17:0/948890875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6881049d0 msgr2=0x7ff68819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff687fff640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6881049d0 0x7ff68819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff687fff640 1 -- 172.21.15.17:0/948890875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6881a0330 con 0x7ff68810de30 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff6877fe640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6881049d0 0x7ff68819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff687fff640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff68819fc00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff680005cc0 tx=0x7ff680003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680032c10 con 0x7ff68810de30 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff680032db0 con 0x7ff68810de30 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6881a05c0 con 0x7ff68810de30 2024-09-21T06:11:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680030a60 con 0x7ff68810de30 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.538+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6881a6d80 con 0x7ff68810de30 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.539+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff688100fe0 con 0x7ff68810de30 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.541+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff680030c00 con 0x7ff68810de30 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff684ff9640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff6700b65a0 0x7ff6700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff6877fe640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff6700b65a0 0x7ff6700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff680108c50 con 0x7ff68810de30 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff684ff9640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] conn(0x7ff6700c16b0 0x7ff6700c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 --> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff680004830 con 0x7ff6700c16b0 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff6801090a0 con 0x7ff68810de30 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff686ffd640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] conn(0x7ff6700c16b0 0x7ff6700c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.542+0000 7ff6877fe640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff6700b65a0 0x7ff6700b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff68806c940 tx=0x7ff678005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.543+0000 7ff686ffd640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] conn(0x7ff6700c16b0 0x7ff6700c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.543+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== osd.0 v2:172.21.15.17:6802/4212452176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff680004830 con 0x7ff6700c16b0 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 --> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff68806b390 con 0x7ff6700c16b0 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff684ff9640 1 -- 172.21.15.17:0/948890875 <== osd.0 v2:172.21.15.17:6802/4212452176 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff68806b390 con 0x7ff6700c16b0 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] conn(0x7ff6700c16b0 msgr2=0x7ff6700c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] conn(0x7ff6700c16b0 0x7ff6700c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff6700b65a0 msgr2=0x7ff6700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff6700b65a0 0x7ff6700b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff68806c940 tx=0x7ff678005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 msgr2=0x7ff68819fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 --2- 172.21.15.17:0/948890875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff68810de30 0x7ff68819fc00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff680005cc0 tx=0x7ff680003f90 comp rx=0 tx=0).stop 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff687fff640 1 -- 172.21.15.17:0/948890875 reap_dead start 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 shutdown_connections 2024-09-21T06:11:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 >> 172.21.15.17:0/948890875 conn(0x7ff688079740 msgr2=0x7ff6880ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 shutdown_connections 2024-09-21T06:11:29.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.557+0000 7ff68db75640 1 -- 172.21.15.17:0/948890875 wait complete. 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 -- 172.21.15.17:0/4256835834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0010102a60 msgr2=0x7f0010102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 --2- 172.21.15.17:0/4256835834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0010102a60 0x7f0010102e70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f000402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 -- 172.21.15.17:0/4256835834 shutdown_connections 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 --2- 172.21.15.17:0/4256835834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0010108cf0 0x7f001010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 --2- 172.21.15.17:0/4256835834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00101083a0 0x7f00101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 --2- 172.21.15.17:0/4256835834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0010102a60 0x7f0010102e70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 -- 172.21.15.17:0/4256835834 >> 172.21.15.17:0/4256835834 conn(0x7f0010079730 msgr2=0x7f0010079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 -- 172.21.15.17:0/4256835834 shutdown_connections 2024-09-21T06:11:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.073+0000 7f0016cc2640 1 -- 172.21.15.17:0/4256835834 wait complete. 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 Processor -- start 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 -- start start 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0010102a60 0x7f001019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00101083a0 0x7f001019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0010108cf0 0x7f00101a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112810 con 0x7f00101083a0 2024-09-21T06:11:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112690 con 0x7f0010102a60 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0016cc2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112990 con 0x7f0010108cf0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f000ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00101083a0 0x7f001019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f000ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00101083a0 0x7f001019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38716/0 (socket says 172.21.15.17:38716) 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f000ffff640 1 -- 172.21.15.17:0/1174358201 learned_addr learned my addr 172.21.15.17:0/1174358201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f001525f640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0010108cf0 0x7f00101a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.074+0000 7f0014a5e640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0010102a60 0x7f001019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000ffff640 1 -- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0010108cf0 msgr2=0x7f00101a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000ffff640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0010108cf0 0x7f00101a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000ffff640 1 -- 172.21.15.17:0/1174358201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0010102a60 msgr2=0x7f001019c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000ffff640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0010102a60 0x7f001019c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000ffff640 1 -- 172.21.15.17:0/1174358201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00101a2440 con 0x7f00101083a0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000ffff640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00101083a0 0x7f001019cb30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c970 tx=0x7efffc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc007bb0 con 0x7f00101083a0 2024-09-21T06:11:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efffc007d50 con 0x7f00101083a0 2024-09-21T06:11:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00101a2730 con 0x7f00101083a0 2024-09-21T06:11:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc004e10 con 0x7f00101083a0 2024-09-21T06:11:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.075+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00101a8f50 con 0x7f00101083a0 2024-09-21T06:11:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.076+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0010063b50 con 0x7f00101083a0 2024-09-21T06:11:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.078+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efffc004fb0 con 0x7f00101083a0 2024-09-21T06:11:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f000dffb640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00000b65d0 0x7f00000b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f0014a5e640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00000b65d0 0x7f00000b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7efffc0e7840 con 0x7f00101083a0 2024-09-21T06:11:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f000dffb640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] conn(0x7f00000c16e0 0x7f00000c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 --> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00000c42a0 con 0x7f00000c16e0 2024-09-21T06:11:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7efffc0e7c90 con 0x7f00101083a0 2024-09-21T06:11:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f001525f640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] conn(0x7f00000c16e0 0x7f00000c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.079+0000 7f0014a5e640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00000b65d0 0x7f00000b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00040057c0 tx=0x7f00040058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.080+0000 7f001525f640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] conn(0x7f00000c16e0 0x7f00000c3bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.081+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== osd.11 v2:172.21.15.89:6824/1527798982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00000c42a0 con 0x7f00000c16e0 2024-09-21T06:11:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.094+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 --> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0010063fd0 con 0x7f00000c16e0 2024-09-21T06:11:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f000dffb640 1 -- 172.21.15.17:0/1174358201 <== osd.11 v2:172.21.15.89:6824/1527798982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0010063fd0 con 0x7f00000c16e0 2024-09-21T06:11:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] conn(0x7f00000c16e0 msgr2=0x7f00000c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f0016cc2640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] conn(0x7f00000c16e0 0x7f00000c3bd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00000b65d0 msgr2=0x7f00000b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f0016cc2640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f00000b65d0 0x7f00000b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00040057c0 tx=0x7f00040058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00101083a0 msgr2=0x7f001019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.095+0000 7f0016cc2640 1 --2- 172.21.15.17:0/1174358201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00101083a0 0x7f001019cb30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c970 tx=0x7efffc00ce30 comp rx=0 tx=0).stop 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.096+0000 7f001525f640 1 -- 172.21.15.17:0/1174358201 reap_dead start 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.096+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 shutdown_connections 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.096+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 >> 172.21.15.17:0/1174358201 conn(0x7f0010079730 msgr2=0x7f0010101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.096+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 shutdown_connections 2024-09-21T06:11:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:30.096+0000 7f0016cc2640 1 -- 172.21.15.17:0/1174358201 wait complete. 2024-09-21T06:11:30.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 -- 172.21.15.17:0/1085174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1580102a60 msgr2=0x7f1580102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 --2- 172.21.15.17:0/1085174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1580102a60 0x7f1580102e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1570009900 tx=0x7f157002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 -- 172.21.15.17:0/1085174751 shutdown_connections 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 --2- 172.21.15.17:0/1085174751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1580108cf0 0x7f158010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 --2- 172.21.15.17:0/1085174751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801083a0 0x7f15801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 --2- 172.21.15.17:0/1085174751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1580102a60 0x7f1580102e70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 -- 172.21.15.17:0/1085174751 >> 172.21.15.17:0/1085174751 conn(0x7f1580079730 msgr2=0x7f1580079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 -- 172.21.15.17:0/1085174751 shutdown_connections 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.433+0000 7f1586bf1640 1 -- 172.21.15.17:0/1085174751 wait complete. 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 Processor -- start 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 -- start start 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1580102a60 0x7f158019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15801083a0 0x7f158019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1580108cf0 0x7f158019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1580113930 con 0x7f15801083a0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15801137b0 con 0x7f1580102a60 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f1586bf1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1580113ab0 con 0x7f1580108cf0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f157ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15801083a0 0x7f158019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f157ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15801083a0 0x7f158019a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38690/0 (socket says 172.21.15.17:38690) 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f157ffff640 1 -- 172.21.15.17:0/3461023460 learned_addr learned my addr 172.21.15.17:0/3461023460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.434+0000 7f158498d640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1580102a60 0x7f158019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f158518e640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1580108cf0 0x7f158019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157ffff640 1 -- 172.21.15.17:0/3461023460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1580108cf0 msgr2=0x7f158019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157ffff640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1580108cf0 0x7f158019fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157ffff640 1 -- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1580102a60 msgr2=0x7f158019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157ffff640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1580102a60 0x7f158019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157ffff640 1 -- 172.21.15.17:0/3461023460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15801a0230 con 0x7f15801083a0 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f158518e640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1580108cf0 0x7f158019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157ffff640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15801083a0 0x7f158019a920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f156800c970 tx=0x7f156800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1568007bb0 con 0x7f15801083a0 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15801a0520 con 0x7f15801083a0 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1568007d50 con 0x7f15801083a0 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1568018660 con 0x7f15801083a0 2024-09-21T06:11:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.435+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15801a6d40 con 0x7f15801083a0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.436+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1580063ad0 con 0x7f15801083a0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.438+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f156800f970 con 0x7f15801083a0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.438+0000 7f157dffb640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f156c0b65d0 0x7f156c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f158498d640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f156c0b65d0 0x7f156c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f15680e7f30 con 0x7f15801083a0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f157dffb640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] conn(0x7f156c0c16e0 0x7f156c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 --> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f156c0c42a0 con 0x7f156c0c16e0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f15680e82e0 con 0x7f15801083a0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f158498d640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f156c0b65d0 0x7f156c0b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1570000c00 tx=0x7f1570009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.439+0000 7f158518e640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] conn(0x7f156c0c16e0 0x7f156c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.440+0000 7f158518e640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] conn(0x7f156c0c16e0 0x7f156c0c3bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.440+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== osd.4 v2:172.21.15.81:6808/4268623175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f156c0c42a0 con 0x7f156c0c16e0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.454+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 --> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1580063f50 con 0x7f156c0c16e0 2024-09-21T06:11:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f157dffb640 1 -- 172.21.15.17:0/3461023460 <== osd.4 v2:172.21.15.81:6808/4268623175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1580063f50 con 0x7f156c0c16e0 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] conn(0x7f156c0c16e0 msgr2=0x7f156c0c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f1586bf1640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] conn(0x7f156c0c16e0 0x7f156c0c3bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f156c0b65d0 msgr2=0x7f156c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f1586bf1640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f156c0b65d0 0x7f156c0b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1570000c00 tx=0x7f1570009680 comp rx=0 tx=0).stop 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15801083a0 msgr2=0x7f158019a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f1586bf1640 1 --2- 172.21.15.17:0/3461023460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15801083a0 0x7f158019a920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f156800c970 tx=0x7f156800ce30 comp rx=0 tx=0).stop 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.455+0000 7f158518e640 1 -- 172.21.15.17:0/3461023460 reap_dead start 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.456+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 shutdown_connections 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.456+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 >> 172.21.15.17:0/3461023460 conn(0x7f1580079730 msgr2=0x7f1580101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.456+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 shutdown_connections 2024-09-21T06:11:30.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:29.456+0000 7f1586bf1640 1 -- 172.21.15.17:0/3461023460 wait complete. 2024-09-21T06:11:30.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:30 smithi017 ceph-mon[31080]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-21T06:11:30.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:30 smithi081 ceph-mon[33870]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-21T06:11:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:30 smithi089 ceph-mon[33879]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-21T06:11:30.869 INFO:teuthology.orchestra.run.smithi017.stdout:34359738452 2024-09-21T06:11:30.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T06:11:31.510 INFO:teuthology.orchestra.run.smithi017.stdout:292057776156 2024-09-21T06:11:31.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T06:11:31.987 INFO:teuthology.orchestra.run.smithi017.stdout:137438953536 2024-09-21T06:11:31.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T06:11:32.218 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:32 smithi017 ceph-mon[31080]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:11:32.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 -- 172.21.15.17:0/90911714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 msgr2=0x7fbedc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 --2- 172.21.15.17:0/90911714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc1098b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009900 tx=0x7fbed002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 -- 172.21.15.17:0/90911714 shutdown_connections 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 --2- 172.21.15.17:0/90911714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc1098b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 --2- 172.21.15.17:0/90911714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbedc109df0 0x7fbedc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 --2- 172.21.15.17:0/90911714 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc103b60 0x7fbedc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 -- 172.21.15.17:0/90911714 >> 172.21.15.17:0/90911714 conn(0x7fbedc07b850 msgr2=0x7fbedc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 -- 172.21.15.17:0/90911714 shutdown_connections 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.216+0000 7fbee4510640 1 -- 172.21.15.17:0/90911714 wait complete. 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.217+0000 7fbee4510640 1 Processor -- start 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.217+0000 7fbee4510640 1 -- start start 2024-09-21T06:11:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.217+0000 7fbee4510640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc103b60 0x7fbedc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee4510640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee4510640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbedc109df0 0x7fbedc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee4510640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc113960 con 0x7fbedc1094a0 2024-09-21T06:11:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee4510640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc1137e0 con 0x7fbedc109df0 2024-09-21T06:11:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee4510640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc113ae0 con 0x7fbedc103b60 2024-09-21T06:11:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38734/0 (socket says 172.21.15.17:38734) 2024-09-21T06:11:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 -- 172.21.15.17:0/794135605 learned_addr learned my addr 172.21.15.17:0/794135605 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee22ac640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc103b60 0x7fbedc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee2aad640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbedc109df0 0x7fbedc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 -- 172.21.15.17:0/794135605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc103b60 msgr2=0x7fbedc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbedc103b60 0x7fbedc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 -- 172.21.15.17:0/794135605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbedc109df0 msgr2=0x7fbedc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbedc109df0 0x7fbedc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 -- 172.21.15.17:0/794135605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc1a8670 con 0x7fbedc1094a0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbee1aab640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc075c50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005940 tx=0x7fbed00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.218+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed003f030 con 0x7fbedc1094a0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.219+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc1a8900 con 0x7fbedc1094a0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.219+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbed0003a80 con 0x7fbedc1094a0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.219+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed003f030 con 0x7fbedc1094a0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.219+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc1a8e30 con 0x7fbedc1094a0 2024-09-21T06:11:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.220+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbedc063b50 con 0x7fbedc1094a0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.221+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbed0042030 con 0x7fbedc1094a0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.222+0000 7fbecf7fe640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbec80b6820 0x7fbec80b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.222+0000 7fbee22ac640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbec80b6820 0x7fbec80b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.222+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7fbed0107d50 con 0x7fbedc1094a0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.222+0000 7fbecf7fe640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] conn(0x7fbec80c1930 0x7fbec80c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.222+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 --> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbec80c44f0 con 0x7fbec80c1930 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.222+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fbed0108100 con 0x7fbedc1094a0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.223+0000 7fbee2aad640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] conn(0x7fbec80c1930 0x7fbec80c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.223+0000 7fbee22ac640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbec80b6820 0x7fbec80b8d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbedc077160 tx=0x7fbed800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.223+0000 7fbee2aad640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] conn(0x7fbec80c1930 0x7fbec80c3e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.224+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== osd.6 v2:172.21.15.17:6818/1345802272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbec80c44f0 con 0x7fbec80c1930 2024-09-21T06:11:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.237+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 --> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbedc063f50 con 0x7fbec80c1930 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbecf7fe640 1 -- 172.21.15.17:0/794135605 <== osd.6 v2:172.21.15.17:6818/1345802272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbedc063f50 con 0x7fbec80c1930 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] conn(0x7fbec80c1930 msgr2=0x7fbec80c3e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] conn(0x7fbec80c1930 0x7fbec80c3e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbec80b6820 msgr2=0x7fbec80b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbec80b6820 0x7fbec80b8d30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbedc077160 tx=0x7fbed800b390 comp rx=0 tx=0).stop 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 msgr2=0x7fbedc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 --2- 172.21.15.17:0/794135605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbedc1094a0 0x7fbedc075c50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005940 tx=0x7fbed00040e0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee2aad640 1 -- 172.21.15.17:0/794135605 reap_dead start 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 shutdown_connections 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 >> 172.21.15.17:0/794135605 conn(0x7fbedc07b850 msgr2=0x7fbedc1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 shutdown_connections 2024-09-21T06:11:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:32.238+0000 7fbee4510640 1 -- 172.21.15.17:0/794135605 wait complete. 2024-09-21T06:11:32.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:32 smithi081 ceph-mon[33870]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:11:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:32 smithi089 ceph-mon[33879]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:11:32.945 INFO:teuthology.orchestra.run.smithi017.stdout:184683593782 2024-09-21T06:11:32.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T06:11:33.606 INFO:teuthology.orchestra.run.smithi017.stdout:111669149765 2024-09-21T06:11:33.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T06:11:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.665 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.666 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.671 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.673 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.673 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.679 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:34.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:34 smithi081 ceph-mon[33870]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:11:34.511 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:34 smithi017 ceph-mon[31080]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:11:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:34 smithi089 ceph-mon[33879]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:11:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.134+0000 7ff8db001640 1 -- 172.21.15.17:0/3561529541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 msgr2=0x7ff8d4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.134+0000 7ff8db001640 1 --2- 172.21.15.17:0/3561529541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d4102e80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009900 tx=0x7ff8c802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.134+0000 7ff8db001640 1 -- 172.21.15.17:0/3561529541 shutdown_connections 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.134+0000 7ff8db001640 1 --2- 172.21.15.17:0/3561529541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d4108d00 0x7ff8d410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 --2- 172.21.15.17:0/3561529541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8d41083b0 0x7ff8d41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 --2- 172.21.15.17:0/3561529541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d4102e80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 -- 172.21.15.17:0/3561529541 >> 172.21.15.17:0/3561529541 conn(0x7ff8d4079730 msgr2=0x7ff8d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 -- 172.21.15.17:0/3561529541 shutdown_connections 2024-09-21T06:11:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 -- 172.21.15.17:0/3561529541 wait complete. 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 Processor -- start 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.135+0000 7ff8db001640 1 -- start start 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8db001640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8db001640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d41083b0 0x7ff8d419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8db001640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8d4108d00 0x7ff8d419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8db001640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4112820 con 0x7ff8d4102a70 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8db001640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d41126a0 con 0x7ff8d41083b0 2024-09-21T06:11:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8db001640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d41129a0 con 0x7ff8d4108d00 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d419b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38754/0 (socket says 172.21.15.17:38754) 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 -- 172.21.15.17:0/1767858280 learned_addr learned my addr 172.21.15.17:0/1767858280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d959e640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8d4108d00 0x7ff8d419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d3fff640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d41083b0 0x7ff8d419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 -- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8d4108d00 msgr2=0x7ff8d419bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8d4108d00 0x7ff8d419bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 -- 172.21.15.17:0/1767858280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d41083b0 msgr2=0x7ff8d419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d41083b0 0x7ff8d419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d8d9d640 1 -- 172.21.15.17:0/1767858280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d41a6510 con 0x7ff8d4102a70 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.136+0000 7ff8d3fff640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d41083b0 0x7ff8d419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.137+0000 7ff8d8d9d640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d419b310 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009230 tx=0x7ff8c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.137+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c803f030 con 0x7ff8d4102a70 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.137+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d41a67a0 con 0x7ff8d4102a70 2024-09-21T06:11:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.137+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8c8003a80 con 0x7ff8d4102a70 2024-09-21T06:11:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.137+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8035070 con 0x7ff8d4102a70 2024-09-21T06:11:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.137+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41a6cd0 con 0x7ff8d4102a70 2024-09-21T06:11:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.138+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8d4063ad0 con 0x7ff8d4102a70 2024-09-21T06:11:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.140+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff8c8042030 con 0x7ff8d4102a70 2024-09-21T06:11:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.140+0000 7ff8d1ffb640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8c40b65d0 0x7ff8c40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d3fff640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8c40b65d0 0x7ff8c40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff8c8108500 con 0x7ff8d4102a70 2024-09-21T06:11:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d1ffb640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] conn(0x7ff8c40c16e0 0x7ff8c40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 --> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8c40c42a0 con 0x7ff8c40c16e0 2024-09-21T06:11:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff8c8108950 con 0x7ff8d4102a70 2024-09-21T06:11:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d3fff640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8c40b65d0 0x7ff8c40b8ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4079ea0 tx=0x7ff8c0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.141+0000 7ff8d959e640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] conn(0x7ff8c40c16e0 0x7ff8c40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.142+0000 7ff8d959e640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] conn(0x7ff8c40c16e0 0x7ff8c40c3bd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.143+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== osd.8 v2:172.21.15.89:6816/4122778161 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8c40c42a0 con 0x7ff8c40c16e0 2024-09-21T06:11:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.157+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 --> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8d4063ed0 con 0x7ff8c40c16e0 2024-09-21T06:11:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.157+0000 7ff8d1ffb640 1 -- 172.21.15.17:0/1767858280 <== osd.8 v2:172.21.15.89:6816/4122778161 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff8d4063ed0 con 0x7ff8c40c16e0 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] conn(0x7ff8c40c16e0 msgr2=0x7ff8c40c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] conn(0x7ff8c40c16e0 0x7ff8c40c3bd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8c40b65d0 msgr2=0x7ff8c40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff8c40b65d0 0x7ff8c40b8ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4079ea0 tx=0x7ff8c0005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 msgr2=0x7ff8d419b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 --2- 172.21.15.17:0/1767858280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8d4102a70 0x7ff8d419b310 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009230 tx=0x7ff8c8004270 comp rx=0 tx=0).stop 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8d959e640 1 -- 172.21.15.17:0/1767858280 reap_dead start 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 shutdown_connections 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 >> 172.21.15.17:0/1767858280 conn(0x7ff8d4079730 msgr2=0x7ff8d4101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 shutdown_connections 2024-09-21T06:11:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.158+0000 7ff8db001640 1 -- 172.21.15.17:0/1767858280 wait complete. 2024-09-21T06:11:35.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 -- 172.21.15.17:0/223596288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 msgr2=0x7f13c410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/223596288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c410fb80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009900 tx=0x7f13b802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:35.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 -- 172.21.15.17:0/223596288 shutdown_connections 2024-09-21T06:11:35.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/223596288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c410fb80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/223596288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c41100c0 0x7f13c4112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/223596288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c40757b0 0x7f13c4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 -- 172.21.15.17:0/223596288 >> 172.21.15.17:0/223596288 conn(0x7f13c407b850 msgr2=0x7f13c407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 -- 172.21.15.17:0/223596288 shutdown_connections 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 -- 172.21.15.17:0/223596288 wait complete. 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.768+0000 7f13c8cbf640 1 Processor -- start 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 -- start start 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c40757b0 0x7f13c419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c41100c0 0x7f13c41a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4115b20 con 0x7f13c4076100 2024-09-21T06:11:35.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41159a0 con 0x7f13c40757b0 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c8cbf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4115ca0 con 0x7f13c41100c0 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38812/0 (socket says 172.21.15.17:38812) 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 -- 172.21.15.17:0/3703642208 learned_addr learned my addr 172.21.15.17:0/3703642208 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c259c640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c40757b0 0x7f13c419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c2d9d640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c41100c0 0x7f13c41a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 -- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c41100c0 msgr2=0x7f13c41a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c41100c0 0x7f13c41a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 -- 172.21.15.17:0/3703642208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c40757b0 msgr2=0x7f13c419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13c40757b0 0x7f13c419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c1d9b640 1 -- 172.21.15.17:0/3703642208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c41a25a0 con 0x7f13c4076100 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.769+0000 7f13c2d9d640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13c41100c0 0x7f13c41a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.770+0000 7f13c1d9b640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c419cbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005940 tx=0x7f13b8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.770+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b803f030 con 0x7f13c4076100 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.770+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13b8004440 con 0x7f13c4076100 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.770+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c41a2830 con 0x7f13c4076100 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.770+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8035070 con 0x7f13c4076100 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.770+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c41a8ff0 con 0x7f13c4076100 2024-09-21T06:11:35.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.771+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13c4063b10 con 0x7f13c4076100 2024-09-21T06:11:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.773+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f13b8042030 con 0x7f13c4076100 2024-09-21T06:11:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.773+0000 7f13b37fe640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f13ac0b65a0 0x7f13ac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13c259c640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f13ac0b65a0 0x7f13ac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f13b8108230 con 0x7f13c4076100 2024-09-21T06:11:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13b37fe640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] conn(0x7f13ac0c1580 0x7f13ac0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 --> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13ac0c4140 con 0x7f13ac0c1580 2024-09-21T06:11:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f13b8108680 con 0x7f13c4076100 2024-09-21T06:11:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13c2d9d640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] conn(0x7f13ac0c1580 0x7f13ac0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.774+0000 7f13c259c640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f13ac0b65a0 0x7f13ac0b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13b40058c0 tx=0x7f13b400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.775+0000 7f13c2d9d640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] conn(0x7f13ac0c1580 0x7f13ac0c3a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.775+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== osd.5 v2:172.21.15.89:6808/1915302245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13ac0c4140 con 0x7f13ac0c1580 2024-09-21T06:11:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.789+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 --> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13c4063f10 con 0x7f13ac0c1580 2024-09-21T06:11:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13b37fe640 1 -- 172.21.15.17:0/3703642208 <== osd.5 v2:172.21.15.89:6808/1915302245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f13c4063f10 con 0x7f13ac0c1580 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] conn(0x7f13ac0c1580 msgr2=0x7f13ac0c3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] conn(0x7f13ac0c1580 0x7f13ac0c3a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f13ac0b65a0 msgr2=0x7f13ac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f13ac0b65a0 0x7f13ac0b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13b40058c0 tx=0x7f13b400a250 comp rx=0 tx=0).stop 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 msgr2=0x7f13c419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 --2- 172.21.15.17:0/3703642208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c4076100 0x7f13c419cbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005940 tx=0x7f13b8004040 comp rx=0 tx=0).stop 2024-09-21T06:11:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c2d9d640 1 -- 172.21.15.17:0/3703642208 reap_dead start 2024-09-21T06:11:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 shutdown_connections 2024-09-21T06:11:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 >> 172.21.15.17:0/3703642208 conn(0x7f13c407b850 msgr2=0x7f13c41008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 shutdown_connections 2024-09-21T06:11:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.790+0000 7f13c8cbf640 1 -- 172.21.15.17:0/3703642208 wait complete. 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 -- 172.21.15.17:0/3138455030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848108d20 msgr2=0x7f284810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 --2- 172.21.15.17:0/3138455030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848108d20 0x7f284810f550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2840009ca0 tx=0x7f284002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 -- 172.21.15.17:0/3138455030 shutdown_connections 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 --2- 172.21.15.17:0/3138455030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848108d20 0x7f284810f550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 --2- 172.21.15.17:0/3138455030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28481083d0 0x7f28481087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 --2- 172.21.15.17:0/3138455030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2848102ae0 0x7f2848102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 -- 172.21.15.17:0/3138455030 >> 172.21.15.17:0/3138455030 conn(0x7f2848079760 msgr2=0x7f2848079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 -- 172.21.15.17:0/3138455030 shutdown_connections 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.335+0000 7f284e63e640 1 -- 172.21.15.17:0/3138455030 wait complete. 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.336+0000 7f284e63e640 1 Processor -- start 2024-09-21T06:11:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.336+0000 7f284e63e640 1 -- start start 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284e63e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848102ae0 0x7f2848199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284e63e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28481083d0 0x7f28481997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284e63e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2848108d20 0x7f284819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284e63e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112890 con 0x7f2848102ae0 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284e63e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112710 con 0x7f2848108d20 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284e63e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112a10 con 0x7f28481083d0 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848102ae0 0x7f2848199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848102ae0 0x7f2848199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38772/0 (socket says 172.21.15.17:38772) 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 -- 172.21.15.17:0/1475545258 learned_addr learned my addr 172.21.15.17:0/1475545258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f28477fe640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28481083d0 0x7f28481997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284cbdb640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2848108d20 0x7f284819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 -- 172.21.15.17:0/1475545258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28481083d0 msgr2=0x7f28481997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28481083d0 0x7f28481997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 -- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2848108d20 msgr2=0x7f284819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2848108d20 0x7f284819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 -- 172.21.15.17:0/1475545258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284819f0b0 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f284cbdb640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2848108d20 0x7f284819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.337+0000 7f2847fff640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848102ae0 0x7f2848199200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f283800d950 tx=0x7f283800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.338+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838017070 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.338+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f283800de80 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.338+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284819f3a0 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.338+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283800f620 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.338+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28481a5bc0 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.339+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2848063b50 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.340+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2838009c30 con 0x7f2848102ae0 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.341+0000 7f28457fa640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f28300b65d0 0x7f28300b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.341+0000 7f28477fe640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f28300b65d0 0x7f28300b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.341+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f28380e77f0 con 0x7f2848102ae0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.341+0000 7f28457fa640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] conn(0x7f28300c16e0 0x7f28300c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.342+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 --> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2838012e50 con 0x7f28300c16e0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.342+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f28380e7c40 con 0x7f2848102ae0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.342+0000 7f28477fe640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f28300b65d0 0x7f28300b8ae0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2848079dd0 tx=0x7f283c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.342+0000 7f284cbdb640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] conn(0x7f28300c16e0 0x7f28300c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.342+0000 7f284cbdb640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] conn(0x7f28300c16e0 0x7f28300c3bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.343+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== osd.1 v2:172.21.15.81:6800/3959009249 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2838012e50 con 0x7f28300c16e0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.357+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 --> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2848063fd0 con 0x7f28300c16e0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f28457fa640 1 -- 172.21.15.17:0/1475545258 <== osd.1 v2:172.21.15.81:6800/3959009249 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2848063fd0 con 0x7f28300c16e0 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] conn(0x7f28300c16e0 msgr2=0x7f28300c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] conn(0x7f28300c16e0 0x7f28300c3bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f28300b65d0 msgr2=0x7f28300b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f28300b65d0 0x7f28300b8ae0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2848079dd0 tx=0x7f283c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848102ae0 msgr2=0x7f2848199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 --2- 172.21.15.17:0/1475545258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848102ae0 0x7f2848199200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f283800d950 tx=0x7f283800dd50 comp rx=0 tx=0).stop 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284cbdb640 1 -- 172.21.15.17:0/1475545258 reap_dead start 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 shutdown_connections 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 >> 172.21.15.17:0/1475545258 conn(0x7f2848079760 msgr2=0x7f2848104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 shutdown_connections 2024-09-21T06:11:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.358+0000 7f284e63e640 1 -- 172.21.15.17:0/1475545258 wait complete. 2024-09-21T06:11:36.131 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:36.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:36 smithi017 ceph-mon[31080]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:11:36.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:36 smithi081 ceph-mon[33870]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:11:36.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:36 smithi089 ceph-mon[33879]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:11:36.779 INFO:teuthology.orchestra.run.smithi017.stdout:158913790012 2024-09-21T06:11:36.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 -- 172.21.15.17:0/3963353617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9468109df0 msgr2=0x7f9468110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3963353617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9468109df0 0x7f9468110620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9460009900 tx=0x7f946002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 -- 172.21.15.17:0/3963353617 shutdown_connections 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3963353617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9468109df0 0x7f9468110620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3963353617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94681094a0 0x7f94681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3963353617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9468103b60 0x7f9468103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 -- 172.21.15.17:0/3963353617 >> 172.21.15.17:0/3963353617 conn(0x7f946807b850 msgr2=0x7f946807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:36.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 -- 172.21.15.17:0/3963353617 shutdown_connections 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.967+0000 7f946f3cd640 1 -- 172.21.15.17:0/3963353617 wait complete. 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 Processor -- start 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 -- start start 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468103b60 0x7f946819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94681094a0 0x7f946819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9468109df0 0x7f946819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9468113960 con 0x7f94681094a0 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94681137e0 con 0x7f9468103b60 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946f3cd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9468113ae0 con 0x7f9468109df0 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946c968640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94681094a0 0x7f946819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946c968640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94681094a0 0x7f946819a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38832/0 (socket says 172.21.15.17:38832) 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946c968640 1 -- 172.21.15.17:0/3032366079 learned_addr learned my addr 172.21.15.17:0/3032366079 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946d96a640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9468109df0 0x7f946819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.968+0000 7f946d169640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468103b60 0x7f946819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946c968640 1 -- 172.21.15.17:0/3032366079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9468109df0 msgr2=0x7f946819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946c968640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9468109df0 0x7f946819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946c968640 1 -- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468103b60 msgr2=0x7f946819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946c968640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468103b60 0x7f946819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946c968640 1 -- 172.21.15.17:0/3032366079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94681a02a0 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946d169640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468103b60 0x7f946819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946c968640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94681094a0 0x7f946819a8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f945800d740 tx=0x7f945800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458017070 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94681a0590 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f945800de50 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945800f620 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.969+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681a6cf0 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.970+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9468063b50 con 0x7f94681094a0 2024-09-21T06:11:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.973+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f945801a070 con 0x7f94681094a0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f945e7fc640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94540b65a0 0x7f94540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f946d169640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94540b65a0 0x7f94540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f94580e75c0 con 0x7f94681094a0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f945e7fc640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] conn(0x7f94540c16b0 0x7f94540c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 --> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94540c4270 con 0x7f94540c16b0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f94580e7a10 con 0x7f94681094a0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.974+0000 7f946d169640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94540b65a0 0x7f94540b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9464005fd0 tx=0x7f9464009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.975+0000 7f946d96a640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] conn(0x7f94540c16b0 0x7f94540c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.975+0000 7f946d96a640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] conn(0x7f94540c16b0 0x7f94540c3ba0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:36.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.976+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== osd.7 v2:172.21.15.81:6816/900845162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94540c4270 con 0x7f94540c16b0 2024-09-21T06:11:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.991+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 --> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9468063f50 con 0x7f94540c16b0 2024-09-21T06:11:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.991+0000 7f945e7fc640 1 -- 172.21.15.17:0/3032366079 <== osd.7 v2:172.21.15.81:6816/900845162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9468063f50 con 0x7f94540c16b0 2024-09-21T06:11:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] conn(0x7f94540c16b0 msgr2=0x7f94540c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] conn(0x7f94540c16b0 0x7f94540c3ba0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94540b65a0 msgr2=0x7f94540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94540b65a0 0x7f94540b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9464005fd0 tx=0x7f9464009600 comp rx=0 tx=0).stop 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94681094a0 msgr2=0x7f946819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 --2- 172.21.15.17:0/3032366079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94681094a0 0x7f946819a8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f945800d740 tx=0x7f945800dc00 comp rx=0 tx=0).stop 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946d96a640 1 -- 172.21.15.17:0/3032366079 reap_dead start 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 shutdown_connections 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 >> 172.21.15.17:0/3032366079 conn(0x7f946807b850 msgr2=0x7f94681074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 shutdown_connections 2024-09-21T06:11:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:36.992+0000 7f946f3cd640 1 -- 172.21.15.17:0/3032366079 wait complete. 2024-09-21T06:11:38.449 INFO:teuthology.orchestra.run.smithi017.stdout:206158430257 2024-09-21T06:11:38.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T06:11:38.474 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:38 smithi017 ceph-mon[31080]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:11:38.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:38 smithi081 ceph-mon[33870]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:11:38.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:38 smithi089 ceph-mon[33879]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:11:38.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 -- 172.21.15.17:0/2998374279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e010de10 msgr2=0x7f64e0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/2998374279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e010de10 0x7f64e0110300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009ca0 tx=0x7f64d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 -- 172.21.15.17:0/2998374279 shutdown_connections 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/2998374279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e010de10 0x7f64e0110300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/2998374279 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e0105300 0x7f64e010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/2998374279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e01049b0 0x7f64e0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 -- 172.21.15.17:0/2998374279 >> 172.21.15.17:0/2998374279 conn(0x7f64e0079730 msgr2=0x7f64e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 -- 172.21.15.17:0/2998374279 shutdown_connections 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.734+0000 7f64e4bc4640 1 -- 172.21.15.17:0/2998374279 wait complete. 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.735+0000 7f64e4bc4640 1 Processor -- start 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.735+0000 7f64e4bc4640 1 -- start start 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64e4bc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e01049b0 0x7f64e019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64e4bc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e0105300 0x7f64e019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64e4bc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e010de10 0x7f64e019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64e4bc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0113970 con 0x7f64e0105300 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64e4bc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64e01137f0 con 0x7f64e01049b0 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64e4bc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0113af0 con 0x7f64e010de10 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e0105300 0x7f64e019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e0105300 0x7f64e019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53602/0 (socket says 172.21.15.17:53602) 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 -- 172.21.15.17:0/3460591564 learned_addr learned my addr 172.21.15.17:0/3460591564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64de59c640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e01049b0 0x7f64e019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ded9d640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e010de10 0x7f64e019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 -- 172.21.15.17:0/3460591564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e010de10 msgr2=0x7f64e019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e010de10 0x7f64e019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 -- 172.21.15.17:0/3460591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e01049b0 msgr2=0x7f64e019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e01049b0 0x7f64e019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 -- 172.21.15.17:0/3460591564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e01a0310 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.736+0000 7f64ddd9b640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e0105300 0x7f64e019a940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f64d400e9f0 tx=0x7f64d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.737+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d400ccc0 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.737+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e01a0600 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.737+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64d40108c0 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.737+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4018660 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.737+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e01a6d60 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.738+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64e0063b50 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.740+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f64d4010430 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64cf7fe640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f64c80b65a0 0x7f64c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64de59c640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f64c80b65a0 0x7f64c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f64d40e8390 con 0x7f64e0105300 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64cf7fe640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] conn(0x7f64c80c16b0 0x7f64c80c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 --> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64c80c4270 con 0x7f64c80c16b0 2024-09-21T06:11:38.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f64d40e8740 con 0x7f64e0105300 2024-09-21T06:11:38.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.741+0000 7f64ded9d640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] conn(0x7f64c80c16b0 0x7f64c80c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.742+0000 7f64de59c640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f64c80b65a0 0x7f64c80b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64d0005fd0 tx=0x7f64d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.742+0000 7f64ded9d640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] conn(0x7f64c80c16b0 0x7f64c80c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.743+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== osd.9 v2:172.21.15.17:6826/1763624071 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64c80c4270 con 0x7f64c80c16b0 2024-09-21T06:11:38.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.756+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 --> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64e0063f50 con 0x7f64c80c16b0 2024-09-21T06:11:38.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64cf7fe640 1 -- 172.21.15.17:0/3460591564 <== osd.9 v2:172.21.15.17:6826/1763624071 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f64e0063f50 con 0x7f64c80c16b0 2024-09-21T06:11:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] conn(0x7f64c80c16b0 msgr2=0x7f64c80c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] conn(0x7f64c80c16b0 0x7f64c80c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f64c80b65a0 msgr2=0x7f64c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f64c80b65a0 0x7f64c80b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64d0005fd0 tx=0x7f64d000b410 comp rx=0 tx=0).stop 2024-09-21T06:11:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e0105300 msgr2=0x7f64e019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 --2- 172.21.15.17:0/3460591564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e0105300 0x7f64e019a940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f64d400e9f0 tx=0x7f64d400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64ded9d640 1 -- 172.21.15.17:0/3460591564 reap_dead start 2024-09-21T06:11:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 shutdown_connections 2024-09-21T06:11:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 >> 172.21.15.17:0/3460591564 conn(0x7f64e0079730 msgr2=0x7f64e01007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 shutdown_connections 2024-09-21T06:11:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.757+0000 7f64e4bc4640 1 -- 172.21.15.17:0/3460591564 wait complete. 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 -- 172.21.15.17:0/1610984741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c104840 msgr2=0x7f9d4c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/1610984741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c104840 0x7f9d4c104c50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009900 tx=0x7f9d4002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 -- 172.21.15.17:0/1610984741 shutdown_connections 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/1610984741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4c10ddf0 0x7f9d4c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/1610984741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d4c105270 0x7f9d4c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/1610984741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c104840 0x7f9d4c104c50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 -- 172.21.15.17:0/1610984741 >> 172.21.15.17:0/1610984741 conn(0x7f9d4c079730 msgr2=0x7f9d4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 -- 172.21.15.17:0/1610984741 shutdown_connections 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.633+0000 7f9d52bd0640 1 -- 172.21.15.17:0/1610984741 wait complete. 2024-09-21T06:11:39.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.634+0000 7f9d52bd0640 1 Processor -- start 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.634+0000 7f9d52bd0640 1 -- start start 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d52bd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4c104840 0x7f9d4c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d52bd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 0x7f9d4c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d52bd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d4c10ddf0 0x7f9d4c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d52bd0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c113940 con 0x7f9d4c105270 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d52bd0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c1137c0 con 0x7f9d4c104840 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d52bd0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c113ac0 con 0x7f9d4c10ddf0 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 0x7f9d4c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 0x7f9d4c19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53580/0 (socket says 172.21.15.17:53580) 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d4bfff640 1 -- 172.21.15.17:0/106847749 learned_addr learned my addr 172.21.15.17:0/106847749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d5096c640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4c104840 0x7f9d4c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.635+0000 7f9d5116d640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d4c10ddf0 0x7f9d4c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d4bfff640 1 -- 172.21.15.17:0/106847749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d4c10ddf0 msgr2=0x7f9d4c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d4bfff640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d4c10ddf0 0x7f9d4c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d4bfff640 1 -- 172.21.15.17:0/106847749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4c104840 msgr2=0x7f9d4c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d4bfff640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4c104840 0x7f9d4c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d4bfff640 1 -- 172.21.15.17:0/106847749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c1a0320 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d4bfff640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 0x7f9d4c19a950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800e9c0 tx=0x7f9d3800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800ccc0 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c1a0610 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d380054b0 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38010430 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.636+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1a6d70 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.637+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c104c50 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.639+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9d38004f00 con 0x7f9d4c105270 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.640+0000 7f9d49ffb640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9d3c0b65a0 0x7f9d3c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:39.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.640+0000 7f9d5096c640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9d3c0b65a0 0x7f9d3c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.641+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f9d380e7cf0 con 0x7f9d4c105270 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.641+0000 7f9d5096c640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9d3c0b65a0 0x7f9d3c0b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d40004770 tx=0x7f9d400058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.647+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d38056710 con 0x7f9d4c105270 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.848+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9d4c19b4e0 con 0x7f9d4c105270 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.848+0000 7f9d49ffb640 1 -- 172.21.15.17:0/106847749 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9d4c19b4e0 con 0x7f9d4c105270 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9d3c0b65a0 msgr2=0x7f9d3c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9d3c0b65a0 0x7f9d3c0b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d40004770 tx=0x7f9d400058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 msgr2=0x7f9d4c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 0x7f9d4c19a950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800e9c0 tx=0x7f9d3800ee80 comp rx=0 tx=0).stop 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 shutdown_connections 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f9d3c0b65a0 0x7f9d3c0b8ab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4c105270 0x7f9d4c19a950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d4c10ddf0 0x7f9d4c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 --2- 172.21.15.17:0/106847749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d4c104840 0x7f9d4c19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:39.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 >> 172.21.15.17:0/106847749 conn(0x7f9d4c079730 msgr2=0x7f9d4c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:39.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 shutdown_connections 2024-09-21T06:11:39.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:38.851+0000 7f9d52bd0640 1 -- 172.21.15.17:0/106847749 wait complete. 2024-09-21T06:11:39.491 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:39 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/106847749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:11:39.491 INFO:teuthology.orchestra.run.smithi017.stdout:184683593783 2024-09-21T06:11:39.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:39 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/106847749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:11:39.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:39 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/106847749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:11:40.141 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593782 got 184683593783 for osd.6 2024-09-21T06:11:40.141 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 -- 172.21.15.17:0/1936909120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 msgr2=0x7f592410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 --2- 172.21.15.17:0/1936909120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 0x7f592410d870 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5914009ca0 tx=0x7f591402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 -- 172.21.15.17:0/1936909120 shutdown_connections 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 --2- 172.21.15.17:0/1936909120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 0x7f592410d870 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 --2- 172.21.15.17:0/1936909120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592410de30 0x7f5924110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 --2- 172.21.15.17:0/1936909120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59241049d0 0x7f5924104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 -- 172.21.15.17:0/1936909120 >> 172.21.15.17:0/1936909120 conn(0x7f5924079740 msgr2=0x7f5924079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 -- 172.21.15.17:0/1936909120 shutdown_connections 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.673+0000 7f592ab15640 1 -- 172.21.15.17:0/1936909120 wait complete. 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.674+0000 7f592ab15640 1 Processor -- start 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.674+0000 7f592ab15640 1 -- start start 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f592ab15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59241049d0 0x7f592419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f592ab15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 0x7f592419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f592ab15640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592410de30 0x7f592419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f592ab15640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5924113990 con 0x7f5924105320 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f592ab15640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5924113810 con 0x7f592410de30 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f592ab15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5924113b10 con 0x7f59241049d0 2024-09-21T06:11:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f59288b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59241049d0 0x7f592419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f5923fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 0x7f592419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f59288b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59241049d0 0x7f592419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:35924/0 (socket says 172.21.15.17:35924) 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f59288b1640 1 -- 172.21.15.17:0/2510167085 learned_addr learned my addr 172.21.15.17:0/2510167085 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f59290b2640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592410de30 0x7f592419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f5923fff640 1 -- 172.21.15.17:0/2510167085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59241049d0 msgr2=0x7f592419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f5923fff640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59241049d0 0x7f592419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f5923fff640 1 -- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592410de30 msgr2=0x7f592419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f5923fff640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592410de30 0x7f592419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f5923fff640 1 -- 172.21.15.17:0/2510167085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59241a03f0 con 0x7f5924105320 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.675+0000 7f59290b2640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592410de30 0x7f592419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.676+0000 7f5923fff640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 0x7f592419aa20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f591402ade0 tx=0x7f5914003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.676+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914032c90 con 0x7f5924105320 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.676+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5914032e30 con 0x7f5924105320 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.676+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914030a90 con 0x7f5924105320 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.676+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59241a0680 con 0x7f5924105320 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.676+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59241a6e40 con 0x7f5924105320 2024-09-21T06:11:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.677+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5924063ad0 con 0x7f5924105320 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.679+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5914030c30 con 0x7f5924105320 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.680+0000 7f5921ffb640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f59100b65a0 0x7f59100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.680+0000 7f59288b1640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f59100b65a0 0x7f59100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.680+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f5914108b50 con 0x7f5924105320 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.681+0000 7f5921ffb640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] conn(0x7f59100c16b0 0x7f59100c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.681+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 --> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59100c4270 con 0x7f59100c16b0 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.681+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5914108f00 con 0x7f5924105320 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.681+0000 7f59288b1640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f59100b65a0 0x7f59100b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f590c00bc80 tx=0x7f590c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.681+0000 7f59290b2640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] conn(0x7f59100c16b0 0x7f59100c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.681+0000 7f59290b2640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] conn(0x7f59100c16b0 0x7f59100c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.682+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== osd.10 v2:172.21.15.81:6824/4282741036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59100c4270 con 0x7f59100c16b0 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.696+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 --> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5924063ed0 con 0x7f59100c16b0 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f5921ffb640 1 -- 172.21.15.17:0/2510167085 <== osd.10 v2:172.21.15.81:6824/4282741036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5924063ed0 con 0x7f59100c16b0 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] conn(0x7f59100c16b0 msgr2=0x7f59100c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] conn(0x7f59100c16b0 0x7f59100c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f59100b65a0 msgr2=0x7f59100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f59100b65a0 0x7f59100b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f590c00bc80 tx=0x7f590c00b410 comp rx=0 tx=0).stop 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 msgr2=0x7f592419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 --2- 172.21.15.17:0/2510167085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5924105320 0x7f592419aa20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f591402ade0 tx=0x7f5914003f90 comp rx=0 tx=0).stop 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f59290b2640 1 -- 172.21.15.17:0/2510167085 reap_dead start 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 shutdown_connections 2024-09-21T06:11:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 >> 172.21.15.17:0/2510167085 conn(0x7f5924079740 msgr2=0x7f59241008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 shutdown_connections 2024-09-21T06:11:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:35.697+0000 7f592ab15640 1 -- 172.21.15.17:0/2510167085 wait complete. 2024-09-21T06:11:40.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:40 smithi017 ceph-mon[31080]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:11:40.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:40 smithi081 ceph-mon[33870]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:11:40.555 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:40.556 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:40.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:40 smithi089 ceph-mon[33879]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:11:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:55834574929 2024-09-21T06:11:40.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T06:11:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 -- 172.21.15.17:0/1252292899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 msgr2=0x7f882c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 --2- 172.21.15.17:0/1252292899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c110630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8824009ca0 tx=0x7f882402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 -- 172.21.15.17:0/1252292899 shutdown_connections 2024-09-21T06:11:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 --2- 172.21.15.17:0/1252292899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c110630 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 --2- 172.21.15.17:0/1252292899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f882c1094b0 0x7f882c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 --2- 172.21.15.17:0/1252292899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c101f70 0x7f882c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 -- 172.21.15.17:0/1252292899 >> 172.21.15.17:0/1252292899 conn(0x7f882c077c60 msgr2=0x7f882c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 -- 172.21.15.17:0/1252292899 shutdown_connections 2024-09-21T06:11:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 -- 172.21.15.17:0/1252292899 wait complete. 2024-09-21T06:11:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.151+0000 7f8832766640 1 Processor -- start 2024-09-21T06:11:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 -- start start 2024-09-21T06:11:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c101f70 0x7f882c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f882c1094b0 0x7f882c103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f882c1139c0 con 0x7f882c109e00 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f882c113840 con 0x7f882c101f70 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8832766640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f882c113b40 con 0x7f882c1094b0 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8830d03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8830d03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c103990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53620/0 (socket says 172.21.15.17:53620) 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f8830d03640 1 -- 172.21.15.17:0/1940110350 learned_addr learned my addr 172.21.15.17:0/1940110350 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f882b7fe640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f882c1094b0 0x7f882c103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.152+0000 7f882bfff640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c101f70 0x7f882c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8830d03640 1 -- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f882c1094b0 msgr2=0x7f882c103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8830d03640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f882c1094b0 0x7f882c103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8830d03640 1 -- 172.21.15.17:0/1940110350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c101f70 msgr2=0x7f882c102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8830d03640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f882c101f70 0x7f882c102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8830d03640 1 -- 172.21.15.17:0/1940110350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c1a8630 con 0x7f882c109e00 2024-09-21T06:11:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8830d03640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c103990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8824005e30 tx=0x7f88240093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824032d10 con 0x7f882c109e00 2024-09-21T06:11:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8824032eb0 con 0x7f882c109e00 2024-09-21T06:11:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c1a88c0 con 0x7f882c109e00 2024-09-21T06:11:41.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824030b20 con 0x7f882c109e00 2024-09-21T06:11:41.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.153+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c1a8e50 con 0x7f882c109e00 2024-09-21T06:11:41.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.154+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f882c063b50 con 0x7f882c109e00 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.156+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8824030cc0 con 0x7f882c109e00 2024-09-21T06:11:41.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.157+0000 7f88297fa640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88140b6620 0x7f88140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.157+0000 7f882bfff640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88140b6620 0x7f88140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.157+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f8824108c00 con 0x7f882c109e00 2024-09-21T06:11:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.158+0000 7f88297fa640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] conn(0x7f88140c1730 0x7f88140c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.158+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 --> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88140c42f0 con 0x7f88140c1730 2024-09-21T06:11:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.158+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f8824109050 con 0x7f882c109e00 2024-09-21T06:11:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.158+0000 7f882bfff640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88140b6620 0x7f88140b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f882c104960 tx=0x7f881c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.158+0000 7f882b7fe640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] conn(0x7f88140c1730 0x7f88140c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.158+0000 7f882b7fe640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] conn(0x7f88140c1730 0x7f88140c3c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.159+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== osd.2 v2:172.21.15.89:6800/4023376220 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88140c42f0 con 0x7f88140c1730 2024-09-21T06:11:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.173+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 --> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f882c063f80 con 0x7f88140c1730 2024-09-21T06:11:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.174+0000 7f88297fa640 1 -- 172.21.15.17:0/1940110350 <== osd.2 v2:172.21.15.89:6800/4023376220 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f882c063f80 con 0x7f88140c1730 2024-09-21T06:11:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] conn(0x7f88140c1730 msgr2=0x7f88140c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] conn(0x7f88140c1730 0x7f88140c3c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88140b6620 msgr2=0x7f88140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88140b6620 0x7f88140b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f882c104960 tx=0x7f881c005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 msgr2=0x7f882c103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 --2- 172.21.15.17:0/1940110350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f882c109e00 0x7f882c103990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8824005e30 tx=0x7f88240093d0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8830d03640 1 -- 172.21.15.17:0/1940110350 reap_dead start 2024-09-21T06:11:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 shutdown_connections 2024-09-21T06:11:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 >> 172.21.15.17:0/1940110350 conn(0x7f882c077c60 msgr2=0x7f882c1074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 shutdown_connections 2024-09-21T06:11:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:41.175+0000 7f8832766640 1 -- 172.21.15.17:0/1940110350 wait complete. 2024-09-21T06:11:41.967 INFO:teuthology.orchestra.run.smithi017.stdout:227633266732 2024-09-21T06:11:41.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T06:11:42.386 INFO:teuthology.orchestra.run.smithi017.stdout:77309411403 2024-09-21T06:11:42.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T06:11:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.626+0000 7f88e0fcc640 1 -- 172.21.15.17:0/3285245476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc1094c0 msgr2=0x7f88dc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.626+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/3285245476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc1094c0 0x7f88dc1098d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009900 tx=0x7f88d002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 -- 172.21.15.17:0/3285245476 shutdown_connections 2024-09-21T06:11:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/3285245476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc1094c0 0x7f88dc1098d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/3285245476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc109e10 0x7f88dc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/3285245476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc103b80 0x7f88dc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 -- 172.21.15.17:0/3285245476 >> 172.21.15.17:0/3285245476 conn(0x7f88dc0ff5d0 msgr2=0x7f88dc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 -- 172.21.15.17:0/3285245476 shutdown_connections 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.627+0000 7f88e0fcc640 1 -- 172.21.15.17:0/3285245476 wait complete. 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 Processor -- start 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 -- start start 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc103b80 0x7f88dc19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc1094c0 0x7f88dc19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 0x7f88dc1a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc1139a0 con 0x7f88dc109e10 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc113820 con 0x7f88dc103b80 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88e0fcc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc113b20 con 0x7f88dc1094c0 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 0x7f88dc1a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 0x7f88dc1a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53632/0 (socket says 172.21.15.17:53632) 2024-09-21T06:11:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 -- 172.21.15.17:0/2348312120 learned_addr learned my addr 172.21.15.17:0/2348312120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88d9d9b640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc1094c0 0x7f88dc19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88da59c640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc103b80 0x7f88dc19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 -- 172.21.15.17:0/2348312120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc1094c0 msgr2=0x7f88dc19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc1094c0 0x7f88dc19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 -- 172.21.15.17:0/2348312120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc103b80 msgr2=0x7f88dc19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc103b80 0x7f88dc19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.628+0000 7f88dad9d640 1 -- 172.21.15.17:0/2348312120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc1a25c0 con 0x7f88dc109e10 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.629+0000 7f88dad9d640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 0x7f88dc1a1e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88d400b970 tx=0x7f88d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.629+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4019070 con 0x7f88dc109e10 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.629+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88dc1a28b0 con 0x7f88dc109e10 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.629+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88d4014440 con 0x7f88dc109e10 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.629+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d40075d0 con 0x7f88dc109e10 2024-09-21T06:11:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.629+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc1a9010 con 0x7f88dc109e10 2024-09-21T06:11:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.630+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88dc103f90 con 0x7f88dc109e10 2024-09-21T06:11:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.632+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f88d401c070 con 0x7f88dc109e10 2024-09-21T06:11:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.632+0000 7f88cb7fe640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88c40b6620 0x7f88c40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.633+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f88d40e71b0 con 0x7f88dc109e10 2024-09-21T06:11:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.633+0000 7f88da59c640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88c40b6620 0x7f88c40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.633+0000 7f88da59c640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88c40b6620 0x7f88c40b8b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00bbe0 tx=0x7f88cc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.636+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88d40b1900 con 0x7f88dc109e10 2024-09-21T06:11:42.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.833+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f88dc19d780 con 0x7f88dc109e10 2024-09-21T06:11:42.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.834+0000 7f88cb7fe640 1 -- 172.21.15.17:0/2348312120 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88dc19d780 con 0x7f88dc109e10 2024-09-21T06:11:42.836 INFO:teuthology.orchestra.run.smithi017.stdout:34359738454 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88c40b6620 msgr2=0x7f88c40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88c40b6620 0x7f88c40b8b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00bbe0 tx=0x7f88cc00b390 comp rx=0 tx=0).stop 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 msgr2=0x7f88dc1a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 0x7f88dc1a1e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88d400b970 tx=0x7f88d400be30 comp rx=0 tx=0).stop 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 shutdown_connections 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f88c40b6620 0x7f88c40b8b30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88dc109e10 0x7f88dc1a1e90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88dc1094c0 0x7f88dc19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 --2- 172.21.15.17:0/2348312120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc103b80 0x7f88dc19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 >> 172.21.15.17:0/2348312120 conn(0x7f88dc0ff5d0 msgr2=0x7f88dc0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 shutdown_connections 2024-09-21T06:11:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:42.836+0000 7f88e0fcc640 1 -- 172.21.15.17:0/2348312120 wait complete. 2024-09-21T06:11:42.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:42 smithi017 ceph-mon[31080]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:11:43.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:42 smithi081 ceph-mon[33870]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:11:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:42 smithi089 ceph-mon[33879]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:11:43.540 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738452 got 34359738454 for osd.0 2024-09-21T06:11:43.541 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:43.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:43 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2348312120' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:11:43.980 INFO:teuthology.orchestra.run.smithi017.stdout:253403070504 2024-09-21T06:11:43.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T06:11:44.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:43 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2348312120' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:11:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:43 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2348312120' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:11:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 -- 172.21.15.17:0/3397440969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8108d20 msgr2=0x7f2ee810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 --2- 172.21.15.17:0/3397440969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8108d20 0x7f2ee810f550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009ca0 tx=0x7f2ee002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 -- 172.21.15.17:0/3397440969 shutdown_connections 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 --2- 172.21.15.17:0/3397440969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8108d20 0x7f2ee810f550 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 --2- 172.21.15.17:0/3397440969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee81083d0 0x7f2ee81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 --2- 172.21.15.17:0/3397440969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee8102ae0 0x7f2ee8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 -- 172.21.15.17:0/3397440969 >> 172.21.15.17:0/3397440969 conn(0x7f2ee80797b0 msgr2=0x7f2ee8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 -- 172.21.15.17:0/3397440969 shutdown_connections 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 -- 172.21.15.17:0/3397440969 wait complete. 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.364+0000 7f2eef42d640 1 Processor -- start 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 -- start start 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 0x7f2ee80ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee81083d0 0x7f2ee80ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee8108d20 0x7f2ee81000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81128e0 con 0x7f2ee8102ae0 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8112760 con 0x7f2ee8108d20 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eef42d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8112a60 con 0x7f2ee81083d0 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 0x7f2ee80ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 0x7f2ee80ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53664/0 (socket says 172.21.15.17:53664) 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 -- 172.21.15.17:0/4193148727 learned_addr learned my addr 172.21.15.17:0/4193148727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eec9c8640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee81083d0 0x7f2ee80ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed9ca640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee8108d20 0x7f2ee81000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 -- 172.21.15.17:0/4193148727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee81083d0 msgr2=0x7f2ee80ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee81083d0 0x7f2ee80ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 -- 172.21.15.17:0/4193148727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee8108d20 msgr2=0x7f2ee81000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee8108d20 0x7f2ee81000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 -- 172.21.15.17:0/4193148727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee81a86a0 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.365+0000 7f2eed1c9640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 0x7f2ee80ff670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400d950 tx=0x7f2ee400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.366+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4017070 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.366+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ee4009c30 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.366+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400f620 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.366+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee81a8990 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.366+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81a8f20 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.367+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee8102ef0 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.368+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2ee4010460 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.369+0000 7f2ede7fc640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2ed40b6620 0x7f2ed40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.369+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7f2ee40e7450 con 0x7f2ee8102ae0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.369+0000 7f2eec9c8640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2ed40b6620 0x7f2ed40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.370+0000 7f2eec9c8640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2ed40b6620 0x7f2ed40b8b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8079cd0 tx=0x7f2ed8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:44.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.372+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ee40ad8a0 con 0x7f2ee8102ae0 2024-09-21T06:11:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.569+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2ee802e640 con 0x7f2ee8102ae0 2024-09-21T06:11:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.570+0000 7f2ede7fc640 1 -- 172.21.15.17:0/4193148727 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2ee4009de0 con 0x7f2ee8102ae0 2024-09-21T06:11:44.571 INFO:teuthology.orchestra.run.smithi017.stdout:292057776159 2024-09-21T06:11:44.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2ed40b6620 msgr2=0x7f2ed40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2ed40b6620 0x7f2ed40b8b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8079cd0 tx=0x7f2ed8005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 msgr2=0x7f2ee80ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 0x7f2ee80ff670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400d950 tx=0x7f2ee400de10 comp rx=0 tx=0).stop 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 shutdown_connections 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2ed40b6620 0x7f2ed40b8b30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee8108d20 0x7f2ee81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee81083d0 0x7f2ee80ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 --2- 172.21.15.17:0/4193148727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee8102ae0 0x7f2ee80ff670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 >> 172.21.15.17:0/4193148727 conn(0x7f2ee80797b0 msgr2=0x7f2ee8101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 shutdown_connections 2024-09-21T06:11:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.572+0000 7f2eef42d640 1 -- 172.21.15.17:0/4193148727 wait complete. 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 -- 172.21.15.17:0/2989658679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c102a60 msgr2=0x7ff51c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 --2- 172.21.15.17:0/2989658679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c102a60 0x7ff51c102e70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff518009900 tx=0x7ff51802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 -- 172.21.15.17:0/2989658679 shutdown_connections 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 --2- 172.21.15.17:0/2989658679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c108cf0 0x7ff51c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 --2- 172.21.15.17:0/2989658679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff51c1083a0 0x7ff51c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 --2- 172.21.15.17:0/2989658679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c102a60 0x7ff51c102e70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 -- 172.21.15.17:0/2989658679 >> 172.21.15.17:0/2989658679 conn(0x7ff51c079730 msgr2=0x7ff51c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 -- 172.21.15.17:0/2989658679 shutdown_connections 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.584+0000 7ff524614640 1 -- 172.21.15.17:0/2989658679 wait complete. 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 Processor -- start 2024-09-21T06:11:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 -- start start 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c102a60 0x7ff51c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 0x7ff51c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff51c108cf0 0x7ff51c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c112870 con 0x7ff51c1083a0 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1126f0 con 0x7ff51c102a60 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff524614640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c1129f0 con 0x7ff51c108cf0 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff521baf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 0x7ff51c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff521baf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 0x7ff51c19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53670/0 (socket says 172.21.15.17:53670) 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff521baf640 1 -- 172.21.15.17:0/3192824041 learned_addr learned my addr 172.21.15.17:0/3192824041 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.585+0000 7ff5223b0640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c102a60 0x7ff51c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff522bb1640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff51c108cf0 0x7ff51c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5223b0640 1 -- 172.21.15.17:0/3192824041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff51c108cf0 msgr2=0x7ff51c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5223b0640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff51c108cf0 0x7ff51c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5223b0640 1 -- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 msgr2=0x7ff51c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5223b0640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 0x7ff51c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5223b0640 1 -- 172.21.15.17:0/3192824041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c1a0340 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff521baf640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 0x7ff51c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5223b0640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c102a60 0x7ff51c19a3d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff518005940 tx=0x7ff5180042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51803f070 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c1a05d0 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c104430 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff51803b460 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.586+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518035070 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.587+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c102e70 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.590+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff51803b610 con 0x7ff51c102a60 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.590+0000 7ff5137fe640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5080b65a0 0x7ff5080b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.590+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9092+0+0 (secure 0 0 0) 0x7ff518108230 con 0x7ff51c102a60 2024-09-21T06:11:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.590+0000 7ff521baf640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5080b65a0 0x7ff5080b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.591+0000 7ff521baf640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5080b65a0 0x7ff5080b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff51c079da0 tx=0x7ff50c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.593+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5180d29e0 con 0x7ff51c102a60 2024-09-21T06:11:44.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.791+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff51c1047e0 con 0x7ff51c102a60 2024-09-21T06:11:44.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.792+0000 7ff5137fe640 1 -- 172.21.15.17:0/3192824041 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff5180d7920 con 0x7ff51c102a60 2024-09-21T06:11:44.794 INFO:teuthology.orchestra.run.smithi017.stdout:137438953539 2024-09-21T06:11:44.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5080b65a0 msgr2=0x7ff5080b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5080b65a0 0x7ff5080b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff51c079da0 tx=0x7ff50c009190 comp rx=0 tx=0).stop 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c102a60 msgr2=0x7ff51c19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c102a60 0x7ff51c19a3d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff518005940 tx=0x7ff5180042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 shutdown_connections 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5080b65a0 0x7ff5080b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff51c1083a0 0x7ff51c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff51c108cf0 0x7ff51c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 --2- 172.21.15.17:0/3192824041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff51c102a60 0x7ff51c19a3d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 >> 172.21.15.17:0/3192824041 conn(0x7ff51c079730 msgr2=0x7ff51c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 shutdown_connections 2024-09-21T06:11:44.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:44.795+0000 7ff524614640 1 -- 172.21.15.17:0/3192824041 wait complete. 2024-09-21T06:11:44.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:44 smithi017 ceph-mon[31080]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:11:44.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:44 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/4193148727' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:11:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:44 smithi081 ceph-mon[33870]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:11:45.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:44 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/4193148727' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:11:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:44 smithi089 ceph-mon[33879]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:11:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:44 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/4193148727' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:11:45.525 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953536 got 137438953539 for osd.4 2024-09-21T06:11:45.525 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:45.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:45 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3192824041' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:11:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:45 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3192824041' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:11:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.044 INFO:teuthology.orchestra.run.smithi017.stdout:270582939683 2024-09-21T06:11:46.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T06:11:46.048 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.071 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.083 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:46.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:45 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3192824041' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:11:46.634 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776159 for osd.11 2024-09-21T06:11:46.634 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:46.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:46 smithi017 ceph-mon[31080]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:11:46.873 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T06:11:46.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:46 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T06:11:47.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:46 smithi081 ceph-mon[33870]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:11:47.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T06:11:47.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:46 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T06:11:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:46 smithi089 ceph-mon[33879]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:11:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T06:11:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:46 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T06:11:47.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 -- 172.21.15.17:0/566708446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c105320 msgr2=0x7f583c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 --2- 172.21.15.17:0/566708446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c105320 0x7f583c10d870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5830009900 tx=0x7f583002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 -- 172.21.15.17:0/566708446 shutdown_connections 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 --2- 172.21.15.17:0/566708446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c105320 0x7f583c10d870 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 --2- 172.21.15.17:0/566708446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c10de30 0x7f583c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 --2- 172.21.15.17:0/566708446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c1049d0 0x7f583c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 -- 172.21.15.17:0/566708446 >> 172.21.15.17:0/566708446 conn(0x7f583c079740 msgr2=0x7f583c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 -- 172.21.15.17:0/566708446 shutdown_connections 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.194+0000 7f584164d640 1 -- 172.21.15.17:0/566708446 wait complete. 2024-09-21T06:11:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 Processor -- start 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 -- start start 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 0x7f583c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c105320 0x7f583c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c10de30 0x7f583c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f583c113940 con 0x7f583c1049d0 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f583c1137c0 con 0x7f583c105320 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f584164d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f583c113ac0 con 0x7f583c10de30 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f583affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 0x7f583c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f583affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 0x7f583c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53688/0 (socket says 172.21.15.17:53688) 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f583affd640 1 -- 172.21.15.17:0/2999701067 learned_addr learned my addr 172.21.15.17:0/2999701067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.195+0000 7f583a7fc640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c105320 0x7f583c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583b7fe640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c10de30 0x7f583c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583affd640 1 -- 172.21.15.17:0/2999701067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c10de30 msgr2=0x7f583c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583affd640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c10de30 0x7f583c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583affd640 1 -- 172.21.15.17:0/2999701067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c105320 msgr2=0x7f583c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583affd640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c105320 0x7f583c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583affd640 1 -- 172.21.15.17:0/2999701067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583c1a0360 con 0x7f583c1049d0 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583b7fe640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c10de30 0x7f583c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f583affd640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 0x7f583c19a3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f582c00eaa0 tx=0x7f582c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:47.423 INFO:teuthology.orchestra.run.smithi017.stdout:111669149768 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c016070 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583c1a0650 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f582c00ce10 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c011470 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.196+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f583c1a6db0 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.197+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583c104de0 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.199+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f582c019070 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.200+0000 7f5823fff640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f58240b65a0 0x7f58240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.200+0000 7f583a7fc640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f58240b65a0 0x7f58240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.200+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9150+0+0 (secure 0 0 0) 0x7f582c0e7d80 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.200+0000 7f583a7fc640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f58240b65a0 0x7f58240b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58300057c0 tx=0x7f5830000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.203+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f582c0ae120 con 0x7f583c1049d0 2024-09-21T06:11:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.400+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f583c19b520 con 0x7f583c1049d0 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.400+0000 7f5823fff640 1 -- 172.21.15.17:0/2999701067 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f582c0b2500 con 0x7f583c1049d0 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f58240b65a0 msgr2=0x7f58240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f58240b65a0 0x7f58240b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58300057c0 tx=0x7f5830000bc0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 msgr2=0x7f583c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 0x7f583c19a3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f582c00eaa0 tx=0x7f582c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 shutdown_connections 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f58240b65a0 0x7f58240b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f583c10de30 0x7f583c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f583c105320 0x7f583c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 --2- 172.21.15.17:0/2999701067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f583c1049d0 0x7f583c19a3f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 >> 172.21.15.17:0/2999701067 conn(0x7f583c079740 msgr2=0x7f583c100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 shutdown_connections 2024-09-21T06:11:47.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.403+0000 7f584164d640 1 -- 172.21.15.17:0/2999701067 wait complete. 2024-09-21T06:11:48.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:47 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T06:11:48.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:47 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T06:11:48.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:47 smithi081 ceph-mon[33870]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:11:48.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:47 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2999701067' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:11:48.020 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:47 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T06:11:48.020 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:47 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T06:11:48.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:47 smithi017 ceph-mon[31080]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:11:48.021 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:47 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2999701067' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:11:48.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:47 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T06:11:48.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:47 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T06:11:48.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:47 smithi089 ceph-mon[33879]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:11:48.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:47 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2999701067' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:11:48.935 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:48 smithi017 ceph-mon[31080]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:11:48.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:48 smithi017 ceph-mon[31080]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:11:48.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:48 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/299438253' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:11:48.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:48 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2689948869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:11:48.937 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149765 got 111669149768 for osd.3 2024-09-21T06:11:48.937 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:48 smithi081 ceph-mon[33870]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:11:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:48 smithi081 ceph-mon[33870]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:11:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:48 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/299438253' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:11:49.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:48 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2689948869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:11:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:48 smithi089 ceph-mon[33879]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:11:49.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:48 smithi089 ceph-mon[33879]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:11:49.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:48 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/299438253' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:11:49.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:48 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2689948869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:11:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 -- 172.21.15.17:0/136077692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94301031d0 msgr2=0x7f94301035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 --2- 172.21.15.17:0/136077692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94301031d0 0x7f94301035e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9420009900 tx=0x7f942002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 -- 172.21.15.17:0/136077692 shutdown_connections 2024-09-21T06:11:49.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 --2- 172.21.15.17:0/136077692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9430108f60 0x7f943010f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 --2- 172.21.15.17:0/136077692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9430108610 0x7f9430108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 --2- 172.21.15.17:0/136077692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94301031d0 0x7f94301035e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 -- 172.21.15.17:0/136077692 >> 172.21.15.17:0/136077692 conn(0x7f9430079e40 msgr2=0x7f943007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 -- 172.21.15.17:0/136077692 shutdown_connections 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.126+0000 7f9435337640 1 -- 172.21.15.17:0/136077692 wait complete. 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 Processor -- start 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 -- start start 2024-09-21T06:11:49.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301031d0 0x7f943019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9430108610 0x7f943019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 0x7f943019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9430112ad0 con 0x7f9430108f60 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9430112950 con 0x7f94301031d0 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.127+0000 7f9435337640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9430112c50 con 0x7f9430108610 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 0x7f943019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 0x7f943019fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54252/0 (socket says 172.21.15.17:54252) 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 -- 172.21.15.17:0/2955856309 learned_addr learned my addr 172.21.15.17:0/2955856309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942effd640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301031d0 0x7f943019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942e7fc640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9430108610 0x7f943019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 -- 172.21.15.17:0/2955856309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9430108610 msgr2=0x7f943019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9430108610 0x7f943019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 -- 172.21.15.17:0/2955856309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301031d0 msgr2=0x7f943019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301031d0 0x7f943019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 -- 172.21.15.17:0/2955856309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94301a0580 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f942f7fe640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 0x7f943019fe50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f942800eaa0 tx=0x7f942800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942800cdb0 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9428005020 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301a0870 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94280116d0 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.128+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301a6fd0 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.129+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94301035e0 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.132+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f94280051d0 con 0x7f9430108f60 2024-09-21T06:11:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.132+0000 7f9417fff640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94180b65a0 0x7f94180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.132+0000 7f942effd640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94180b65a0 0x7f94180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.133+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f94280e7ee0 con 0x7f9430108f60 2024-09-21T06:11:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.133+0000 7f942effd640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94180b65a0 0x7f94180b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9420000c00 tx=0x7f9420009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.136+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9428016030 con 0x7f9430108f60 2024-09-21T06:11:49.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.336+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f943019b740 con 0x7f9430108f60 2024-09-21T06:11:49.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.337+0000 7f9417fff640 1 -- 172.21.15.17:0/2955856309 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f943019b740 con 0x7f9430108f60 2024-09-21T06:11:49.338 INFO:teuthology.orchestra.run.smithi017.stdout:253403070506 2024-09-21T06:11:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94180b65a0 msgr2=0x7f94180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94180b65a0 0x7f94180b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9420000c00 tx=0x7f9420009680 comp rx=0 tx=0).stop 2024-09-21T06:11:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 msgr2=0x7f943019fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 0x7f943019fe50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f942800eaa0 tx=0x7f942800ef60 comp rx=0 tx=0).stop 2024-09-21T06:11:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 shutdown_connections 2024-09-21T06:11:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f94180b65a0 0x7f94180b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9430108f60 0x7f943019fe50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9430108610 0x7f943019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 --2- 172.21.15.17:0/2955856309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94301031d0 0x7f943019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 >> 172.21.15.17:0/2955856309 conn(0x7f9430079e40 msgr2=0x7f9430101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:49.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 shutdown_connections 2024-09-21T06:11:49.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.339+0000 7f9435337640 1 -- 172.21.15.17:0/2955856309 wait complete. 2024-09-21T06:11:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 -- 172.21.15.17:0/3328071604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 msgr2=0x7f90dc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 --2- 172.21.15.17:0/3328071604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc10f540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009900 tx=0x7f90d402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 -- 172.21.15.17:0/3328071604 shutdown_connections 2024-09-21T06:11:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 --2- 172.21.15.17:0/3328071604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc10f540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 --2- 172.21.15.17:0/3328071604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 0x7f90dc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 --2- 172.21.15.17:0/3328071604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 0x7f90dc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 -- 172.21.15.17:0/3328071604 >> 172.21.15.17:0/3328071604 conn(0x7f90dc079740 msgr2=0x7f90dc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 -- 172.21.15.17:0/3328071604 shutdown_connections 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.391+0000 7f90e30c6640 1 -- 172.21.15.17:0/3328071604 wait complete. 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 Processor -- start 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 -- start start 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 0x7f90dc19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 0x7f90dc19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc112830 con 0x7f90dc108d10 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1126b0 con 0x7f90dc102a80 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.392+0000 7f90e30c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1129b0 con 0x7f90dc1083c0 2024-09-21T06:11:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc1a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54280/0 (socket says 172.21.15.17:54280) 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 -- 172.21.15.17:0/1253525840 learned_addr learned my addr 172.21.15.17:0/1253525840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e0e62640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 0x7f90dc19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90dbfff640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 0x7f90dc19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 -- 172.21.15.17:0/1253525840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 msgr2=0x7f90dc19cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 0x7f90dc19cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 -- 172.21.15.17:0/1253525840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 msgr2=0x7f90dc19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 0x7f90dc19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 -- 172.21.15.17:0/1253525840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc1a24b0 con 0x7f90dc108d10 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90dbfff640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 0x7f90dc19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e0e62640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 0x7f90dc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e1663640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc1a1d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f90d4004770 tx=0x7f90d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d403f030 con 0x7f90dc108d10 2024-09-21T06:11:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.393+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc1a2740 con 0x7f90dc108d10 2024-09-21T06:11:49.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.394+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90dc1a8f00 con 0x7f90dc108d10 2024-09-21T06:11:49.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.394+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90d4004440 con 0x7f90dc108d10 2024-09-21T06:11:49.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.394+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4049060 con 0x7f90dc108d10 2024-09-21T06:11:49.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.395+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc005290 con 0x7f90dc108d10 2024-09-21T06:11:49.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.396+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f90d4042030 con 0x7f90dc108d10 2024-09-21T06:11:49.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.397+0000 7f90d9ffb640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90c80b6620 0x7f90c80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.397+0000 7f90e0e62640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90c80b6620 0x7f90c80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.397+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f90d41080b0 con 0x7f90dc108d10 2024-09-21T06:11:49.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.398+0000 7f90e0e62640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90c80b6620 0x7f90c80b8b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009c20 tx=0x7f90c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:49.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.400+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90d40ce3f0 con 0x7f90dc108d10 2024-09-21T06:11:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.590+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f90bc005850 con 0x7f90dc108d10 2024-09-21T06:11:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.590+0000 7f90d9ffb640 1 -- 172.21.15.17:0/1253525840 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f90d40d27d0 con 0x7f90dc108d10 2024-09-21T06:11:49.592 INFO:teuthology.orchestra.run.smithi017.stdout:227633266735 2024-09-21T06:11:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90c80b6620 msgr2=0x7f90c80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90c80b6620 0x7f90c80b8b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009c20 tx=0x7f90c4005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 msgr2=0x7f90dc1a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc1a1d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f90d4004770 tx=0x7f90d4004040 comp rx=0 tx=0).stop 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 shutdown_connections 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f90c80b6620 0x7f90c80b8b30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90dc108d10 0x7f90dc1a1d80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90dc1083c0 0x7f90dc19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 --2- 172.21.15.17:0/1253525840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90dc102a80 0x7f90dc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 >> 172.21.15.17:0/1253525840 conn(0x7f90dc079740 msgr2=0x7f90dc104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 shutdown_connections 2024-09-21T06:11:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:49.593+0000 7f90e30c6640 1 -- 172.21.15.17:0/1253525840 wait complete. 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 -- 172.21.15.17:0/1668331476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 msgr2=0x7f6f201087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/1668331476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f201087e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009900 tx=0x7f6f1c02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 -- 172.21.15.17:0/1668331476 shutdown_connections 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/1668331476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f201087e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/1668331476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f20108d20 0x7f6f2010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/1668331476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f20102ae0 0x7f6f20102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 -- 172.21.15.17:0/1668331476 >> 172.21.15.17:0/1668331476 conn(0x7f6f200797b0 msgr2=0x7f6f20079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 -- 172.21.15.17:0/1668331476 shutdown_connections 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.876+0000 7f6f27b3c640 1 -- 172.21.15.17:0/1668331476 wait complete. 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 Processor -- start 2024-09-21T06:11:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 -- start start 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f20102ae0 0x7f6f201992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f20199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f20108d20 0x7f6f2019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20112890 con 0x7f6f201083d0 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20112710 con 0x7f6f20102ae0 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.877+0000 7f6f27b3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20112a10 con 0x7f6f20108d20 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f20199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f20199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53706/0 (socket says 172.21.15.17:53706) 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 -- 172.21.15.17:0/299438253 learned_addr learned my addr 172.21.15.17:0/299438253 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f258d8640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f20102ae0 0x7f6f201992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f260d9640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f20108d20 0x7f6f2019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 -- 172.21.15.17:0/299438253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f20108d20 msgr2=0x7f6f2019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f20108d20 0x7f6f2019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 -- 172.21.15.17:0/299438253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f20102ae0 msgr2=0x7f6f201992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f20102ae0 0x7f6f201992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 -- 172.21.15.17:0/299438253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2019f230 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f250d7640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f20199860 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c004770 tx=0x7f6f1c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.878+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c03f030 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.879+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f1c004440 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.879+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2019f460 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.879+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c035070 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.879+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2006b820 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.880+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f20103d10 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.882+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6f1c042030 con 0x7f6f201083d0 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.883+0000 7f6f12ffd640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6f0c0b65a0 0x7f6f0c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:49.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.883+0000 7f6f258d8640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6f0c0b65a0 0x7f6f0c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.883+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f6f1c107fb0 con 0x7f6f201083d0 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.883+0000 7f6f258d8640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6f0c0b65a0 0x7f6f0c0b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400bbe0 tx=0x7f6f1400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:47.887+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f1c0d2730 con 0x7f6f201083d0 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.083+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6f2006c240 con 0x7f6f201083d0 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.084+0000 7f6f12ffd640 1 -- 172.21.15.17:0/299438253 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6f1c0d7670 con 0x7f6f201083d0 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stdout:158913790015 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6f0c0b65a0 msgr2=0x7f6f0c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6f0c0b65a0 0x7f6f0c0b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400bbe0 tx=0x7f6f1400b390 comp rx=0 tx=0).stop 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 msgr2=0x7f6f20199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f20199860 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c004770 tx=0x7f6f1c004040 comp rx=0 tx=0).stop 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 shutdown_connections 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6f0c0b65a0 0x7f6f0c0b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f201083d0 0x7f6f20199860 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f20108d20 0x7f6f2019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 --2- 172.21.15.17:0/299438253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f20102ae0 0x7f6f201992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 >> 172.21.15.17:0/299438253 conn(0x7f6f200797b0 msgr2=0x7f6f201064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 shutdown_connections 2024-09-21T06:11:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.086+0000 7f6f27b3c640 1 -- 172.21.15.17:0/299438253 wait complete. 2024-09-21T06:11:49.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:49 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2955856309' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:11:49.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:49 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1253525840' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:11:50.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:49 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2955856309' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:11:50.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:49 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1253525840' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:11:50.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:49 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2955856309' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:11:50.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:49 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1253525840' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:11:50.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790012 got 158913790015 for osd.5 2024-09-21T06:11:50.417 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 -- 172.21.15.17:0/740098360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac108d10 msgr2=0x7f92ac10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 --2- 172.21.15.17:0/740098360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac108d10 0x7f92ac10f540 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009ca0 tx=0x7f92a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 -- 172.21.15.17:0/740098360 shutdown_connections 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 --2- 172.21.15.17:0/740098360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac108d10 0x7f92ac10f540 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 --2- 172.21.15.17:0/740098360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac1083c0 0x7f92ac1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 --2- 172.21.15.17:0/740098360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac102a80 0x7f92ac102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 -- 172.21.15.17:0/740098360 >> 172.21.15.17:0/740098360 conn(0x7f92ac079740 msgr2=0x7f92ac079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 -- 172.21.15.17:0/740098360 shutdown_connections 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.472+0000 7f92b410f640 1 -- 172.21.15.17:0/740098360 wait complete. 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 Processor -- start 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 -- start start 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac102a80 0x7f92ac19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 0x7f92ac19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac108d10 0x7f92ac19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac112880 con 0x7f92ac1083c0 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac112700 con 0x7f92ac102a80 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b410f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac112a00 con 0x7f92ac108d10 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.473+0000 7f92b16aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 0x7f92ac19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 0x7f92ac19a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53736/0 (socket says 172.21.15.17:53736) 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 -- 172.21.15.17:0/2689948869 learned_addr learned my addr 172.21.15.17:0/2689948869 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b1eab640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac102a80 0x7f92ac19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b26ac640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac108d10 0x7f92ac19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 -- 172.21.15.17:0/2689948869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac108d10 msgr2=0x7f92ac19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac108d10 0x7f92ac19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 -- 172.21.15.17:0/2689948869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac102a80 msgr2=0x7f92ac19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac102a80 0x7f92ac19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 -- 172.21.15.17:0/2689948869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac1a0270 con 0x7f92ac1083c0 2024-09-21T06:11:50.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b16aa640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 0x7f92ac19a8a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d770 tx=0x7f929c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c017070 con 0x7f92ac1083c0 2024-09-21T06:11:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f929c009c30 con 0x7f92ac1083c0 2024-09-21T06:11:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ac1a0560 con 0x7f92ac1083c0 2024-09-21T06:11:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c00f620 con 0x7f92ac1083c0 2024-09-21T06:11:50.522 INFO:teuthology.orchestra.run.smithi017.stdout:77309411404 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.474+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ac1a6cc0 con 0x7f92ac1083c0 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.475+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92ac103d00 con 0x7f92ac1083c0 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.477+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f929c01a070 con 0x7f92ac1083c0 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.478+0000 7f92a2ffd640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92980b65a0 0x7f92980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.478+0000 7f92b1eab640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92980b65a0 0x7f92980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.478+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f929c0e7380 con 0x7f92ac1083c0 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.479+0000 7f92b1eab640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92980b65a0 0x7f92980b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f92a800bbe0 tx=0x7f92a800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.483+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f929c009de0 con 0x7f92ac1083c0 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.673+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f92ac10b560 con 0x7f92ac1083c0 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.674+0000 7f92a2ffd640 1 -- 172.21.15.17:0/2689948869 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f929c0b4e20 con 0x7f92ac1083c0 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92980b65a0 msgr2=0x7f92980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92980b65a0 0x7f92980b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f92a800bbe0 tx=0x7f92a800b390 comp rx=0 tx=0).stop 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 msgr2=0x7f92ac19a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 0x7f92ac19a8a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d770 tx=0x7f929c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 shutdown_connections 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92980b65a0 0x7f92980b8ab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92ac1083c0 0x7f92ac19a8a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac108d10 0x7f92ac19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 --2- 172.21.15.17:0/2689948869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac102a80 0x7f92ac19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 >> 172.21.15.17:0/2689948869 conn(0x7f92ac079740 msgr2=0x7f92ac06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.676+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 shutdown_connections 2024-09-21T06:11:50.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:48.677+0000 7f92b410f640 1 -- 172.21.15.17:0/2689948869 wait complete. 2024-09-21T06:11:51.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:50 smithi081 ceph-mon[33870]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:51.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:50 smithi089 ceph-mon[33879]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:50 smithi017 ceph-mon[31080]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:51.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411403 got 77309411404 for osd.2 2024-09-21T06:11:51.220 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:52.015 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266732 got 227633266735 for osd.8 2024-09-21T06:11:52.016 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 -- 172.21.15.17:0/2994716925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0108cf0 msgr2=0x7fafc010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 --2- 172.21.15.17:0/2994716925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0108cf0 0x7fafc010f520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009ca0 tx=0x7fafb802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 -- 172.21.15.17:0/2994716925 shutdown_connections 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 --2- 172.21.15.17:0/2994716925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0108cf0 0x7fafc010f520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 --2- 172.21.15.17:0/2994716925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 0x7fafc01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 --2- 172.21.15.17:0/2994716925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc0102a60 0x7fafc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 -- 172.21.15.17:0/2994716925 >> 172.21.15.17:0/2994716925 conn(0x7fafc0079730 msgr2=0x7fafc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:52.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 -- 172.21.15.17:0/2994716925 shutdown_connections 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.653+0000 7fafc8407640 1 -- 172.21.15.17:0/2994716925 wait complete. 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 Processor -- start 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 -- start start 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 0x7fafc019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 0x7fafc019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc0108cf0 0x7fafc019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0112860 con 0x7fafc0102a60 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafc01126e0 con 0x7fafc0108cf0 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc8407640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fafc01129e0 con 0x7fafc01083a0 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc61a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 0x7fafc019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc61a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 0x7fafc019a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54292/0 (socket says 172.21.15.17:54292) 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.654+0000 7fafc61a3640 1 -- 172.21.15.17:0/3668561137 learned_addr learned my addr 172.21.15.17:0/3668561137 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:52.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc69a4640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc0108cf0 0x7fafc019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc59a2640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 0x7fafc019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc61a3640 1 -- 172.21.15.17:0/3668561137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 msgr2=0x7fafc019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc61a3640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 0x7fafc019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc61a3640 1 -- 172.21.15.17:0/3668561137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc0108cf0 msgr2=0x7fafc019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc61a3640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc0108cf0 0x7fafc019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc61a3640 1 -- 172.21.15.17:0/3668561137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc01a02b0 con 0x7fafc0102a60 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc59a2640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 0x7fafc019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc61a3640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 0x7fafc019a340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00e9f0 tx=0x7fafbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00cd80 con 0x7fafc0102a60 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc01a05a0 con 0x7fafc0102a60 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafbc0108c0 con 0x7fafc0102a60 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0187c0 con 0x7fafc0102a60 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.655+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc01a6d00 con 0x7fafc0102a60 2024-09-21T06:11:52.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.656+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc0102e70 con 0x7fafc0102a60 2024-09-21T06:11:52.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.658+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fafbc010430 con 0x7fafc0102a60 2024-09-21T06:11:52.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.659+0000 7fafb77fe640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fafac0b65a0 0x7fafac0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.659+0000 7fafc59a2640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fafac0b65a0 0x7fafac0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.659+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fafbc0e7d00 con 0x7fafc0102a60 2024-09-21T06:11:52.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.659+0000 7fafc59a2640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fafac0b65a0 0x7fafac0b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fafc0102630 tx=0x7fafb0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:52.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.663+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafbc0ae0a0 con 0x7fafc0102a60 2024-09-21T06:11:52.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.856+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fafc010b560 con 0x7fafc0102a60 2024-09-21T06:11:52.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.856+0000 7fafb77fe640 1 -- 172.21.15.17:0/3668561137 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fafbc0b2480 con 0x7fafc0102a60 2024-09-21T06:11:52.858 INFO:teuthology.orchestra.run.smithi017.stdout:55834574932 2024-09-21T06:11:52.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fafac0b65a0 msgr2=0x7fafac0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fafac0b65a0 0x7fafac0b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fafc0102630 tx=0x7fafb0005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:52.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 msgr2=0x7fafc019a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 0x7fafc019a340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00e9f0 tx=0x7fafbc00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 shutdown_connections 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fafac0b65a0 0x7fafac0b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafc0108cf0 0x7fafc019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fafc01083a0 0x7fafc019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 --2- 172.21.15.17:0/3668561137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc0102a60 0x7fafc019a340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 >> 172.21.15.17:0/3668561137 conn(0x7fafc0079730 msgr2=0x7fafc006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.858+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 shutdown_connections 2024-09-21T06:11:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.859+0000 7fafc8407640 1 -- 172.21.15.17:0/3668561137 wait complete. 2024-09-21T06:11:52.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.861+0000 7f6748997640 1 -- 172.21.15.17:0/4291786583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 msgr2=0x7f674410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.861+0000 7f6748997640 1 --2- 172.21.15.17:0/4291786583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f674410f520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f673c009ca0 tx=0x7f673c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 -- 172.21.15.17:0/4291786583 shutdown_connections 2024-09-21T06:11:52.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 --2- 172.21.15.17:0/4291786583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f674410f520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 --2- 172.21.15.17:0/4291786583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67441083a0 0x7f67441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 --2- 172.21.15.17:0/4291786583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6744102a60 0x7f6744102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 -- 172.21.15.17:0/4291786583 >> 172.21.15.17:0/4291786583 conn(0x7f6744079730 msgr2=0x7f6744079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:52.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 -- 172.21.15.17:0/4291786583 shutdown_connections 2024-09-21T06:11:52.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.862+0000 7f6748997640 1 -- 172.21.15.17:0/4291786583 wait complete. 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 Processor -- start 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 -- start start 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744102a60 0x7f674419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67441083a0 0x7f674419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f67441a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6744112860 con 0x7f6744108cf0 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67441126e0 con 0x7f67441083a0 2024-09-21T06:11:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6748997640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f67441129e0 con 0x7f6744102a60 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6742d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f67441a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6742d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f67441a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54306/0 (socket says 172.21.15.17:54306) 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6742d9d640 1 -- 172.21.15.17:0/3806998567 learned_addr learned my addr 172.21.15.17:0/3806998567 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f674259c640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744102a60 0x7f674419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.863+0000 7f6741d9b640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67441083a0 0x7f674419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6742d9d640 1 -- 172.21.15.17:0/3806998567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744102a60 msgr2=0x7f674419c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6742d9d640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744102a60 0x7f674419c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6742d9d640 1 -- 172.21.15.17:0/3806998567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67441083a0 msgr2=0x7f674419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6742d9d640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67441083a0 0x7f674419cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6742d9d640 1 -- 172.21.15.17:0/3806998567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67441a23f0 con 0x7f6744108cf0 2024-09-21T06:11:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6742d9d640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f67441a1d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f673c031040 tx=0x7f673c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c004040 con 0x7f6744108cf0 2024-09-21T06:11:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f673c004670 con 0x7f6744108cf0 2024-09-21T06:11:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c030bb0 con 0x7f6744108cf0 2024-09-21T06:11:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67441a2680 con 0x7f6744108cf0 2024-09-21T06:11:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.864+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67441a2b70 con 0x7f6744108cf0 2024-09-21T06:11:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.866+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6744102e70 con 0x7f6744108cf0 2024-09-21T06:11:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.868+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f673c0041e0 con 0x7f6744108cf0 2024-09-21T06:11:52.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.868+0000 7f67337fe640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f672c0b6650 0x7f672c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.869+0000 7f674259c640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f672c0b6650 0x7f672c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.869+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f673c108aa0 con 0x7f6744108cf0 2024-09-21T06:11:52.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.869+0000 7f674259c640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f672c0b6650 0x7f672c0b8b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f673400abe0 tx=0x7f673400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:52.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:52.872+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f673c0cee40 con 0x7f6744108cf0 2024-09-21T06:11:53.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:52 smithi081 ceph-mon[33870]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:53.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.062+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f67441a9120 con 0x7f6744108cf0 2024-09-21T06:11:53.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:52 smithi017 ceph-mon[31080]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:53.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.062+0000 7f67337fe640 1 -- 172.21.15.17:0/3806998567 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f673c0d3220 con 0x7f6744108cf0 2024-09-21T06:11:53.064 INFO:teuthology.orchestra.run.smithi017.stdout:206158430260 2024-09-21T06:11:53.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f672c0b6650 msgr2=0x7f672c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:53.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f672c0b6650 0x7f672c0b8b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f673400abe0 tx=0x7f673400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 msgr2=0x7f67441a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f67441a1d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f673c031040 tx=0x7f673c032bc0 comp rx=0 tx=0).stop 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 shutdown_connections 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f672c0b6650 0x7f672c0b8b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6744108cf0 0x7f67441a1d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67441083a0 0x7f674419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 --2- 172.21.15.17:0/3806998567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6744102a60 0x7f674419c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 >> 172.21.15.17:0/3806998567 conn(0x7f6744079730 msgr2=0x7f6744104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 shutdown_connections 2024-09-21T06:11:53.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:53.065+0000 7f6748997640 1 -- 172.21.15.17:0/3806998567 wait complete. 2024-09-21T06:11:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:52 smithi089 ceph-mon[33879]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:53 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3668561137' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:11:53.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:53 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3806998567' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:11:53.962 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430257 got 206158430260 for osd.7 2024-09-21T06:11:53.962 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:54.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:53 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3668561137' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:11:54.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:53 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3806998567' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:11:54.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:53 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3668561137' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:11:54.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:53 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3806998567' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:11:54.492 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070504 got 253403070506 for osd.9 2024-09-21T06:11:54.492 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:54 smithi017 ceph-mon[31080]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:55.008 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574929 got 55834574932 for osd.1 2024-09-21T06:11:55.008 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:55.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:54 smithi081 ceph-mon[33870]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:55.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:54 smithi089 ceph-mon[33879]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:55.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 -- 172.21.15.17:0/1823779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc109df0 msgr2=0x7f43cc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 --2- 172.21.15.17:0/1823779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc109df0 0x7f43cc110620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009ca0 tx=0x7f43c402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 -- 172.21.15.17:0/1823779997 shutdown_connections 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 --2- 172.21.15.17:0/1823779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc109df0 0x7f43cc110620 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 --2- 172.21.15.17:0/1823779997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc1094a0 0x7f43cc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 --2- 172.21.15.17:0/1823779997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc103b60 0x7f43cc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 -- 172.21.15.17:0/1823779997 >> 172.21.15.17:0/1823779997 conn(0x7f43cc07b850 msgr2=0x7f43cc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 -- 172.21.15.17:0/1823779997 shutdown_connections 2024-09-21T06:11:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 -- 172.21.15.17:0/1823779997 wait complete. 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 Processor -- start 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.557+0000 7f43d2722640 1 -- start start 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d2722640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 0x7f43cc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d2722640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc1094a0 0x7f43cc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d2722640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc109df0 0x7f43cc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d2722640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc1139b0 con 0x7f43cc103b60 2024-09-21T06:11:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d2722640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc113830 con 0x7f43cc109df0 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d2722640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc113b30 con 0x7f43cc1094a0 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 0x7f43cc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 0x7f43cc19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54326/0 (socket says 172.21.15.17:54326) 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 -- 172.21.15.17:0/1412519633 learned_addr learned my addr 172.21.15.17:0/1412519633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43d0cbf640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc109df0 0x7f43cc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cb7fe640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc1094a0 0x7f43cc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 -- 172.21.15.17:0/1412519633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc1094a0 msgr2=0x7f43cc19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc1094a0 0x7f43cc19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 -- 172.21.15.17:0/1412519633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc109df0 msgr2=0x7f43cc19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc109df0 0x7f43cc19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.558+0000 7f43cbfff640 1 -- 172.21.15.17:0/1412519633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc1a0350 con 0x7f43cc103b60 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.559+0000 7f43cbfff640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 0x7f43cc19a3e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00d950 tx=0x7f43bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.559+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc017070 con 0x7f43cc103b60 2024-09-21T06:11:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.559+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc1a0640 con 0x7f43cc103b60 2024-09-21T06:11:55.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.559+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43bc009c30 con 0x7f43cc103b60 2024-09-21T06:11:55.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.559+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00f620 con 0x7f43cc103b60 2024-09-21T06:11:55.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.559+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc1a6da0 con 0x7f43cc103b60 2024-09-21T06:11:55.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.561+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc103f70 con 0x7f43cc103b60 2024-09-21T06:11:55.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.562+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f43bc005030 con 0x7f43cc103b60 2024-09-21T06:11:55.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.563+0000 7f43c97fa640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f43b40b65a0 0x7f43b40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:55.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.563+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f43bc0e7370 con 0x7f43cc103b60 2024-09-21T06:11:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.563+0000 7f43cb7fe640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f43b40b65a0 0x7f43b40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.564+0000 7f43cb7fe640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f43b40b65a0 0x7f43b40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005fd0 tx=0x7f43c0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:55.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.566+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43bc0ad7b0 con 0x7f43cc103b60 2024-09-21T06:11:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.756+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f43cc10bbe0 con 0x7f43cc103b60 2024-09-21T06:11:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.757+0000 7f43c97fa640 1 -- 172.21.15.17:0/1412519633 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f43bc009de0 con 0x7f43cc103b60 2024-09-21T06:11:55.758 INFO:teuthology.orchestra.run.smithi017.stdout:270582939686 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f43b40b65a0 msgr2=0x7f43b40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f43b40b65a0 0x7f43b40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005fd0 tx=0x7f43c0005850 comp rx=0 tx=0).stop 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 msgr2=0x7f43cc19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 0x7f43cc19a3e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00d950 tx=0x7f43bc00de10 comp rx=0 tx=0).stop 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 shutdown_connections 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f43b40b65a0 0x7f43b40b8ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc109df0 0x7f43cc19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43cc1094a0 0x7f43cc19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 --2- 172.21.15.17:0/1412519633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43cc103b60 0x7f43cc19a3e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 >> 172.21.15.17:0/1412519633 conn(0x7f43cc07b850 msgr2=0x7f43cc105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 shutdown_connections 2024-09-21T06:11:55.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:55.759+0000 7f43d2722640 1 -- 172.21.15.17:0/1412519633 wait complete. 2024-09-21T06:11:56.512 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939683 got 270582939686 for osd.10 2024-09-21T06:11:56.512 DEBUG:teuthology.parallel:result is None 2024-09-21T06:11:56.512 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:11:56.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:11:56.817 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:56.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:56 smithi017 ceph-mon[31080]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:56.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:56 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1412519633' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:11:57.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:56 smithi081 ceph-mon[33870]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:57.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:56 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1412519633' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:11:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:56 smithi089 ceph-mon[33879]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:56 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1412519633' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:11:57.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.353+0000 7efd99b20640 1 -- 172.21.15.17:0/4036108018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 msgr2=0x7efd941098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.353+0000 7efd99b20640 1 --2- 172.21.15.17:0/4036108018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd941098b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009900 tx=0x7efd7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 -- 172.21.15.17:0/4036108018 shutdown_connections 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 --2- 172.21.15.17:0/4036108018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd941098b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 --2- 172.21.15.17:0/4036108018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 0x7efd94110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 --2- 172.21.15.17:0/4036108018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 0x7efd94103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 -- 172.21.15.17:0/4036108018 >> 172.21.15.17:0/4036108018 conn(0x7efd9407b850 msgr2=0x7efd9407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 -- 172.21.15.17:0/4036108018 shutdown_connections 2024-09-21T06:11:57.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 -- 172.21.15.17:0/4036108018 wait complete. 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.354+0000 7efd99b20640 1 Processor -- start 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 -- start start 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 0x7efd9419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd9419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 0x7efd9419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd94113960 con 0x7efd941094a0 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd941137e0 con 0x7efd94109df0 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd99b20640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efd94113ae0 con 0x7efd94103b60 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd9419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd9419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54346/0 (socket says 172.21.15.17:54346) 2024-09-21T06:11:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 -- 172.21.15.17:0/2765063667 learned_addr learned my addr 172.21.15.17:0/2765063667 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd93fff640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 0x7efd9419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd937fe640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 0x7efd9419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 -- 172.21.15.17:0/2765063667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 msgr2=0x7efd9419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 0x7efd9419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 -- 172.21.15.17:0/2765063667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 msgr2=0x7efd9419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 0x7efd9419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd92ffd640 1 -- 172.21.15.17:0/2765063667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd941a0360 con 0x7efd941094a0 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd937fe640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 0x7efd9419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.355+0000 7efd93fff640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 0x7efd9419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.356+0000 7efd92ffd640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd9419a990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efd7c004770 tx=0x7efd7c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.356+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c03f030 con 0x7efd941094a0 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.356+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd7c004440 con 0x7efd941094a0 2024-09-21T06:11:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.356+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd941a05f0 con 0x7efd941094a0 2024-09-21T06:11:57.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.356+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c035070 con 0x7efd941094a0 2024-09-21T06:11:57.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.356+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd941a6db0 con 0x7efd941094a0 2024-09-21T06:11:57.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.357+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd94104de0 con 0x7efd941094a0 2024-09-21T06:11:57.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.359+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efd7c042030 con 0x7efd941094a0 2024-09-21T06:11:57.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.360+0000 7efd90ff9640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd800b65a0 0x7efd800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:57.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.360+0000 7efd937fe640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd800b65a0 0x7efd800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:57.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.360+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7efd7c108010 con 0x7efd941094a0 2024-09-21T06:11:57.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.361+0000 7efd937fe640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd800b65a0 0x7efd800b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efd84005fd0 tx=0x7efd84009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:57.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.363+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd7c0ce3b0 con 0x7efd941094a0 2024-09-21T06:11:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.546+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd94063800 con 0x7efd800b65a0 2024-09-21T06:11:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.552+0000 7efd90ff9640 1 -- 172.21.15.17:0/2765063667 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340570 (secure 0 0 0) 0x7efd94063800 con 0x7efd800b65a0 2024-09-21T06:11:57.557 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd800b65a0 msgr2=0x7efd800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd800b65a0 0x7efd800b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efd84005fd0 tx=0x7efd84009520 comp rx=0 tx=0).stop 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 msgr2=0x7efd9419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd9419a990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efd7c004770 tx=0x7efd7c004040 comp rx=0 tx=0).stop 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 shutdown_connections 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd800b65a0 0x7efd800b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd941094a0 0x7efd9419a990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94109df0 0x7efd9419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 --2- 172.21.15.17:0/2765063667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd94103b60 0x7efd9419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 >> 172.21.15.17:0/2765063667 conn(0x7efd9407b850 msgr2=0x7efd94105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 shutdown_connections 2024-09-21T06:11:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:57.556+0000 7efd99b20640 1 -- 172.21.15.17:0/2765063667 wait complete. 2024-09-21T06:11:58.236 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-21T06:11:57.151624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660424,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":438,"num_read_kb":317,"num_write":291,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373012,"kb_used_data":11216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568812,"statfs":{"total":1151940427776,"available":1151558463488,"internally_reserved":0,"allocated":11485184,"data_stored":7640426,"data_compressed":461643,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003107"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888658+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:11:47.888658+0000","last_peered":"2024-09-21T06:11:47.888658+0000","last_clean":"2024-09-21T06:11:47.888658+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:11:47.888658+0000","last_undegraded":"2024-09-21T06:11:47.888658+0000","last_fullsized":"2024-09-21T06:11:47.888658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684377+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:11:47.684377+0000","last_peered":"2024-09-21T06:11:47.684377+0000","last_clean":"2024-09-21T06:11:47.684377+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:11:47.684377+0000","last_undegraded":"2024-09-21T06:11:47.684377+0000","last_fullsized":"2024-09-21T06:11:47.684377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683054+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:11:47.683054+0000","last_peered":"2024-09-21T06:11:47.683054+0000","last_clean":"2024-09-21T06:11:47.683054+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:11:47.683054+0000","last_undegraded":"2024-09-21T06:11:47.683054+0000","last_fullsized":"2024-09-21T06:11:47.683054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684627+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:11:47.684627+0000","last_peered":"2024-09-21T06:11:47.684627+0000","last_clean":"2024-09-21T06:11:47.684627+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:11:47.684627+0000","last_undegraded":"2024-09-21T06:11:47.684627+0000","last_fullsized":"2024-09-21T06:11:47.684627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953505+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:11:47.953505+0000","last_peered":"2024-09-21T06:11:47.953505+0000","last_clean":"2024-09-21T06:11:47.953505+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:11:47.953505+0000","last_undegraded":"2024-09-21T06:11:47.953505+0000","last_fullsized":"2024-09-21T06:11:47.953505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766526+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:11:47.766526+0000","last_peered":"2024-09-21T06:11:47.766526+0000","last_clean":"2024-09-21T06:11:47.766526+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:11:47.766526+0000","last_undegraded":"2024-09-21T06:11:47.766526+0000","last_fullsized":"2024-09-21T06:11:47.766526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685224+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:11:47.685224+0000","last_peered":"2024-09-21T06:11:47.685224+0000","last_clean":"2024-09-21T06:11:47.685224+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:11:47.685224+0000","last_undegraded":"2024-09-21T06:11:47.685224+0000","last_fullsized":"2024-09-21T06:11:47.685224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678243+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:11:47.678243+0000","last_peered":"2024-09-21T06:11:47.678243+0000","last_clean":"2024-09-21T06:11:47.678243+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:11:47.678243+0000","last_undegraded":"2024-09-21T06:11:47.678243+0000","last_fullsized":"2024-09-21T06:11:47.678243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766810+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:11:47.766810+0000","last_peered":"2024-09-21T06:11:47.766810+0000","last_clean":"2024-09-21T06:11:47.766810+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:11:47.766810+0000","last_undegraded":"2024-09-21T06:11:47.766810+0000","last_fullsized":"2024-09-21T06:11:47.766810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685451+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:11:47.685451+0000","last_peered":"2024-09-21T06:11:47.685451+0000","last_clean":"2024-09-21T06:11:47.685451+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:11:47.685451+0000","last_undegraded":"2024-09-21T06:11:47.685451+0000","last_fullsized":"2024-09-21T06:11:47.685451+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678704+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:11:47.678704+0000","last_peered":"2024-09-21T06:11:47.678704+0000","last_clean":"2024-09-21T06:11:47.678704+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:11:47.678704+0000","last_undegraded":"2024-09-21T06:11:47.678704+0000","last_fullsized":"2024-09-21T06:11:47.678704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766802+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:11:47.766802+0000","last_peered":"2024-09-21T06:11:47.766802+0000","last_clean":"2024-09-21T06:11:47.766802+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:11:47.766802+0000","last_undegraded":"2024-09-21T06:11:47.766802+0000","last_fullsized":"2024-09-21T06:11:47.766802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680621+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:11:47.680621+0000","last_peered":"2024-09-21T06:11:47.680621+0000","last_clean":"2024-09-21T06:11:47.680621+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:11:47.680621+0000","last_undegraded":"2024-09-21T06:11:47.680621+0000","last_fullsized":"2024-09-21T06:11:47.680621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684862+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:11:47.684862+0000","last_peered":"2024-09-21T06:11:47.684862+0000","last_clean":"2024-09-21T06:11:47.684862+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:11:47.684862+0000","last_undegraded":"2024-09-21T06:11:47.684862+0000","last_fullsized":"2024-09-21T06:11:47.684862+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767178+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:11:47.767178+0000","last_peered":"2024-09-21T06:11:47.767178+0000","last_clean":"2024-09-21T06:11:47.767178+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:11:47.767178+0000","last_undegraded":"2024-09-21T06:11:47.767178+0000","last_fullsized":"2024-09-21T06:11:47.767178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684171+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:11:47.684171+0000","last_peered":"2024-09-21T06:11:47.684171+0000","last_clean":"2024-09-21T06:11:47.684171+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:11:47.684171+0000","last_undegraded":"2024-09-21T06:11:47.684171+0000","last_fullsized":"2024-09-21T06:11:47.684171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.689397+0000","last_change":"2024-09-21T06:11:47.688842+0000","last_active":"2024-09-21T06:11:47.689397+0000","last_peered":"2024-09-21T06:11:47.689397+0000","last_clean":"2024-09-21T06:11:47.689397+0000","last_became_active":"2024-09-21T06:11:47.685980+0000","last_became_peered":"2024-09-21T06:11:47.685980+0000","last_unstale":"2024-09-21T06:11:47.689397+0000","last_undegraded":"2024-09-21T06:11:47.689397+0000","last_fullsized":"2024-09-21T06:11:47.689397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:40.815179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767087+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:11:47.767087+0000","last_peered":"2024-09-21T06:11:47.767087+0000","last_clean":"2024-09-21T06:11:47.767087+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:11:47.767087+0000","last_undegraded":"2024-09-21T06:11:47.767087+0000","last_fullsized":"2024-09-21T06:11:47.767087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682020+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:11:47.682020+0000","last_peered":"2024-09-21T06:11:47.682020+0000","last_clean":"2024-09-21T06:11:47.682020+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:11:47.682020+0000","last_undegraded":"2024-09-21T06:11:47.682020+0000","last_fullsized":"2024-09-21T06:11:47.682020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684558+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:11:47.684558+0000","last_peered":"2024-09-21T06:11:47.684558+0000","last_clean":"2024-09-21T06:11:47.684558+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:11:47.684558+0000","last_undegraded":"2024-09-21T06:11:47.684558+0000","last_fullsized":"2024-09-21T06:11:47.684558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684970+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:11:47.684970+0000","last_peered":"2024-09-21T06:11:47.684970+0000","last_clean":"2024-09-21T06:11:47.684970+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:11:47.684970+0000","last_undegraded":"2024-09-21T06:11:47.684970+0000","last_fullsized":"2024-09-21T06:11:47.684970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684768+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:11:47.684768+0000","last_peered":"2024-09-21T06:11:47.684768+0000","last_clean":"2024-09-21T06:11:47.684768+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:11:47.684768+0000","last_undegraded":"2024-09-21T06:11:47.684768+0000","last_fullsized":"2024-09-21T06:11:47.684768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678024+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:11:47.678024+0000","last_peered":"2024-09-21T06:11:47.678024+0000","last_clean":"2024-09-21T06:11:47.678024+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:11:47.678024+0000","last_undegraded":"2024-09-21T06:11:47.678024+0000","last_fullsized":"2024-09-21T06:11:47.678024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767291+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:11:47.767291+0000","last_peered":"2024-09-21T06:11:47.767291+0000","last_clean":"2024-09-21T06:11:47.767291+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:11:47.767291+0000","last_undegraded":"2024-09-21T06:11:47.767291+0000","last_fullsized":"2024-09-21T06:11:47.767291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953311+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:11:47.953311+0000","last_peered":"2024-09-21T06:11:47.953311+0000","last_clean":"2024-09-21T06:11:47.953311+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:11:47.953311+0000","last_undegraded":"2024-09-21T06:11:47.953311+0000","last_fullsized":"2024-09-21T06:11:47.953311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767514+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:11:47.767514+0000","last_peered":"2024-09-21T06:11:47.767514+0000","last_clean":"2024-09-21T06:11:47.767514+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:11:47.767514+0000","last_undegraded":"2024-09-21T06:11:47.767514+0000","last_fullsized":"2024-09-21T06:11:47.767514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683285+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:11:47.683285+0000","last_peered":"2024-09-21T06:11:47.683285+0000","last_clean":"2024-09-21T06:11:47.683285+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:11:47.683285+0000","last_undegraded":"2024-09-21T06:11:47.683285+0000","last_fullsized":"2024-09-21T06:11:47.683285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684559+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:11:47.684559+0000","last_peered":"2024-09-21T06:11:47.684559+0000","last_clean":"2024-09-21T06:11:47.684559+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:11:47.684559+0000","last_undegraded":"2024-09-21T06:11:47.684559+0000","last_fullsized":"2024-09-21T06:11:47.684559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888515+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:11:47.888515+0000","last_peered":"2024-09-21T06:11:47.888515+0000","last_clean":"2024-09-21T06:11:47.888515+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:11:47.888515+0000","last_undegraded":"2024-09-21T06:11:47.888515+0000","last_fullsized":"2024-09-21T06:11:47.888515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684158+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:11:47.684158+0000","last_peered":"2024-09-21T06:11:47.684158+0000","last_clean":"2024-09-21T06:11:47.684158+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:11:47.684158+0000","last_undegraded":"2024-09-21T06:11:47.684158+0000","last_fullsized":"2024-09-21T06:11:47.684158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677581+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:11:47.677581+0000","last_peered":"2024-09-21T06:11:47.677581+0000","last_clean":"2024-09-21T06:11:47.677581+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:11:47.677581+0000","last_undegraded":"2024-09-21T06:11:47.677581+0000","last_fullsized":"2024-09-21T06:11:47.677581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685414+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:11:47.685414+0000","last_peered":"2024-09-21T06:11:47.685414+0000","last_clean":"2024-09-21T06:11:47.685414+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:11:47.685414+0000","last_undegraded":"2024-09-21T06:11:47.685414+0000","last_fullsized":"2024-09-21T06:11:47.685414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682105+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:11:47.682105+0000","last_peered":"2024-09-21T06:11:47.682105+0000","last_clean":"2024-09-21T06:11:47.682105+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:11:47.682105+0000","last_undegraded":"2024-09-21T06:11:47.682105+0000","last_fullsized":"2024-09-21T06:11:47.682105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817812+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:11:47.817812+0000","last_peered":"2024-09-21T06:11:47.817812+0000","last_clean":"2024-09-21T06:11:47.817812+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:11:47.817812+0000","last_undegraded":"2024-09-21T06:11:47.817812+0000","last_fullsized":"2024-09-21T06:11:47.817812+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888234+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:11:47.888234+0000","last_peered":"2024-09-21T06:11:47.888234+0000","last_clean":"2024-09-21T06:11:47.888234+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:11:47.888234+0000","last_undegraded":"2024-09-21T06:11:47.888234+0000","last_fullsized":"2024-09-21T06:11:47.888234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685063+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:11:47.685063+0000","last_peered":"2024-09-21T06:11:47.685063+0000","last_clean":"2024-09-21T06:11:47.685063+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:11:47.685063+0000","last_undegraded":"2024-09-21T06:11:47.685063+0000","last_fullsized":"2024-09-21T06:11:47.685063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817604+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:11:47.817604+0000","last_peered":"2024-09-21T06:11:47.817604+0000","last_clean":"2024-09-21T06:11:47.817604+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:11:47.817604+0000","last_undegraded":"2024-09-21T06:11:47.817604+0000","last_fullsized":"2024-09-21T06:11:47.817604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680887+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:11:47.680887+0000","last_peered":"2024-09-21T06:11:47.680887+0000","last_clean":"2024-09-21T06:11:47.680887+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:11:47.680887+0000","last_undegraded":"2024-09-21T06:11:47.680887+0000","last_fullsized":"2024-09-21T06:11:47.680887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677434+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:11:47.677434+0000","last_peered":"2024-09-21T06:11:47.677434+0000","last_clean":"2024-09-21T06:11:47.677434+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:11:47.677434+0000","last_undegraded":"2024-09-21T06:11:47.677434+0000","last_fullsized":"2024-09-21T06:11:47.677434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678422+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:11:47.678422+0000","last_peered":"2024-09-21T06:11:47.678422+0000","last_clean":"2024-09-21T06:11:47.678422+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:11:47.678422+0000","last_undegraded":"2024-09-21T06:11:47.678422+0000","last_fullsized":"2024-09-21T06:11:47.678422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:51.818938+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:11:51.818938+0000","last_peered":"2024-09-21T06:11:51.818938+0000","last_clean":"2024-09-21T06:11:51.818938+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:11:51.818938+0000","last_undegraded":"2024-09-21T06:11:51.818938+0000","last_fullsized":"2024-09-21T06:11:51.818938+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677703+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:11:47.677703+0000","last_peered":"2024-09-21T06:11:47.677703+0000","last_clean":"2024-09-21T06:11:47.677703+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:11:47.677703+0000","last_undegraded":"2024-09-21T06:11:47.677703+0000","last_fullsized":"2024-09-21T06:11:47.677703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677047+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:11:47.677047+0000","last_peered":"2024-09-21T06:11:47.677047+0000","last_clean":"2024-09-21T06:11:47.677047+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:11:47.677047+0000","last_undegraded":"2024-09-21T06:11:47.677047+0000","last_fullsized":"2024-09-21T06:11:47.677047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680506+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:11:47.680506+0000","last_peered":"2024-09-21T06:11:47.680506+0000","last_clean":"2024-09-21T06:11:47.680506+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:11:47.680506+0000","last_undegraded":"2024-09-21T06:11:47.680506+0000","last_fullsized":"2024-09-21T06:11:47.680506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678653+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:11:47.678653+0000","last_peered":"2024-09-21T06:11:47.678653+0000","last_clean":"2024-09-21T06:11:47.678653+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:11:47.678653+0000","last_undegraded":"2024-09-21T06:11:47.678653+0000","last_fullsized":"2024-09-21T06:11:47.678653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684616+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:11:47.684616+0000","last_peered":"2024-09-21T06:11:47.684616+0000","last_clean":"2024-09-21T06:11:47.684616+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:11:47.684616+0000","last_undegraded":"2024-09-21T06:11:47.684616+0000","last_fullsized":"2024-09-21T06:11:47.684616+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767081+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:11:47.767081+0000","last_peered":"2024-09-21T06:11:47.767081+0000","last_clean":"2024-09-21T06:11:47.767081+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:11:47.767081+0000","last_undegraded":"2024-09-21T06:11:47.767081+0000","last_fullsized":"2024-09-21T06:11:47.767081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681028+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:11:47.681028+0000","last_peered":"2024-09-21T06:11:47.681028+0000","last_clean":"2024-09-21T06:11:47.681028+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:11:47.681028+0000","last_undegraded":"2024-09-21T06:11:47.681028+0000","last_fullsized":"2024-09-21T06:11:47.681028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681125+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:11:47.681125+0000","last_peered":"2024-09-21T06:11:47.681125+0000","last_clean":"2024-09-21T06:11:47.681125+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:11:47.681125+0000","last_undegraded":"2024-09-21T06:11:47.681125+0000","last_fullsized":"2024-09-21T06:11:47.681125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681349+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:11:47.681349+0000","last_peered":"2024-09-21T06:11:47.681349+0000","last_clean":"2024-09-21T06:11:47.681349+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:11:47.681349+0000","last_undegraded":"2024-09-21T06:11:47.681349+0000","last_fullsized":"2024-09-21T06:11:47.681349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684644+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:11:47.684644+0000","last_peered":"2024-09-21T06:11:47.684644+0000","last_clean":"2024-09-21T06:11:47.684644+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:11:47.684644+0000","last_undegraded":"2024-09-21T06:11:47.684644+0000","last_fullsized":"2024-09-21T06:11:47.684644+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677992+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:11:47.677992+0000","last_peered":"2024-09-21T06:11:47.677992+0000","last_clean":"2024-09-21T06:11:47.677992+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:11:47.677992+0000","last_undegraded":"2024-09-21T06:11:47.677992+0000","last_fullsized":"2024-09-21T06:11:47.677992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680946+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:11:47.680946+0000","last_peered":"2024-09-21T06:11:47.680946+0000","last_clean":"2024-09-21T06:11:47.680946+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:11:47.680946+0000","last_undegraded":"2024-09-21T06:11:47.680946+0000","last_fullsized":"2024-09-21T06:11:47.680946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678946+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:11:47.678946+0000","last_peered":"2024-09-21T06:11:47.678946+0000","last_clean":"2024-09-21T06:11:47.678946+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:11:47.678946+0000","last_undegraded":"2024-09-21T06:11:47.678946+0000","last_fullsized":"2024-09-21T06:11:47.678946+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953440+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:11:47.953440+0000","last_peered":"2024-09-21T06:11:47.953440+0000","last_clean":"2024-09-21T06:11:47.953440+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:11:47.953440+0000","last_undegraded":"2024-09-21T06:11:47.953440+0000","last_fullsized":"2024-09-21T06:11:47.953440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681189+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:11:47.681189+0000","last_peered":"2024-09-21T06:11:47.681189+0000","last_clean":"2024-09-21T06:11:47.681189+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:11:47.681189+0000","last_undegraded":"2024-09-21T06:11:47.681189+0000","last_fullsized":"2024-09-21T06:11:47.681189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677687+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:11:47.677687+0000","last_peered":"2024-09-21T06:11:47.677687+0000","last_clean":"2024-09-21T06:11:47.677687+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:11:47.677687+0000","last_undegraded":"2024-09-21T06:11:47.677687+0000","last_fullsized":"2024-09-21T06:11:47.677687+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678022+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:11:47.678022+0000","last_peered":"2024-09-21T06:11:47.678022+0000","last_clean":"2024-09-21T06:11:47.678022+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:11:47.678022+0000","last_undegraded":"2024-09-21T06:11:47.678022+0000","last_fullsized":"2024-09-21T06:11:47.678022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682533+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:11:47.682533+0000","last_peered":"2024-09-21T06:11:47.682533+0000","last_clean":"2024-09-21T06:11:47.682533+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:11:47.682533+0000","last_undegraded":"2024-09-21T06:11:47.682533+0000","last_fullsized":"2024-09-21T06:11:47.682533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682618+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:11:47.682618+0000","last_peered":"2024-09-21T06:11:47.682618+0000","last_clean":"2024-09-21T06:11:47.682618+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:11:47.682618+0000","last_undegraded":"2024-09-21T06:11:47.682618+0000","last_fullsized":"2024-09-21T06:11:47.682618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678203+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:11:47.678203+0000","last_peered":"2024-09-21T06:11:47.678203+0000","last_clean":"2024-09-21T06:11:47.678203+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:11:47.678203+0000","last_undegraded":"2024-09-21T06:11:47.678203+0000","last_fullsized":"2024-09-21T06:11:47.678203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678385+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:11:47.678385+0000","last_peered":"2024-09-21T06:11:47.678385+0000","last_clean":"2024-09-21T06:11:47.678385+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:11:47.678385+0000","last_undegraded":"2024-09-21T06:11:47.678385+0000","last_fullsized":"2024-09-21T06:11:47.678385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685008+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:11:47.685008+0000","last_peered":"2024-09-21T06:11:47.685008+0000","last_clean":"2024-09-21T06:11:47.685008+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:11:47.685008+0000","last_undegraded":"2024-09-21T06:11:47.685008+0000","last_fullsized":"2024-09-21T06:11:47.685008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677637+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:11:47.677637+0000","last_peered":"2024-09-21T06:11:47.677637+0000","last_clean":"2024-09-21T06:11:47.677637+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:11:47.677637+0000","last_undegraded":"2024-09-21T06:11:47.677637+0000","last_fullsized":"2024-09-21T06:11:47.677637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680652+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:11:47.680652+0000","last_peered":"2024-09-21T06:11:47.680652+0000","last_clean":"2024-09-21T06:11:47.680652+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:11:47.680652+0000","last_undegraded":"2024-09-21T06:11:47.680652+0000","last_fullsized":"2024-09-21T06:11:47.680652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:53.823468+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:11:53.823468+0000","last_peered":"2024-09-21T06:11:53.823468+0000","last_clean":"2024-09-21T06:11:53.823468+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:11:53.823468+0000","last_undegraded":"2024-09-21T06:11:53.823468+0000","last_fullsized":"2024-09-21T06:11:53.823468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888565+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:11:47.888565+0000","last_peered":"2024-09-21T06:11:47.888565+0000","last_clean":"2024-09-21T06:11:47.888565+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:11:47.888565+0000","last_undegraded":"2024-09-21T06:11:47.888565+0000","last_fullsized":"2024-09-21T06:11:47.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680740+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:11:47.680740+0000","last_peered":"2024-09-21T06:11:47.680740+0000","last_clean":"2024-09-21T06:11:47.680740+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:11:47.680740+0000","last_undegraded":"2024-09-21T06:11:47.680740+0000","last_fullsized":"2024-09-21T06:11:47.680740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678430+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:11:47.678430+0000","last_peered":"2024-09-21T06:11:47.678430+0000","last_clean":"2024-09-21T06:11:47.678430+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:11:47.678430+0000","last_undegraded":"2024-09-21T06:11:47.678430+0000","last_fullsized":"2024-09-21T06:11:47.678430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682187+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:11:47.682187+0000","last_peered":"2024-09-21T06:11:47.682187+0000","last_clean":"2024-09-21T06:11:47.682187+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:11:47.682187+0000","last_undegraded":"2024-09-21T06:11:47.682187+0000","last_fullsized":"2024-09-21T06:11:47.682187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677181+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:11:47.677181+0000","last_peered":"2024-09-21T06:11:47.677181+0000","last_clean":"2024-09-21T06:11:47.677181+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:11:47.677181+0000","last_undegraded":"2024-09-21T06:11:47.677181+0000","last_fullsized":"2024-09-21T06:11:47.677181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684105+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:11:47.684105+0000","last_peered":"2024-09-21T06:11:47.684105+0000","last_clean":"2024-09-21T06:11:47.684105+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:11:47.684105+0000","last_undegraded":"2024-09-21T06:11:47.684105+0000","last_fullsized":"2024-09-21T06:11:47.684105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678699+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:11:47.678699+0000","last_peered":"2024-09-21T06:11:47.678699+0000","last_clean":"2024-09-21T06:11:47.678699+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:11:47.678699+0000","last_undegraded":"2024-09-21T06:11:47.678699+0000","last_fullsized":"2024-09-21T06:11:47.678699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684980+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:11:47.684980+0000","last_peered":"2024-09-21T06:11:47.684980+0000","last_clean":"2024-09-21T06:11:47.684980+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:11:47.684980+0000","last_undegraded":"2024-09-21T06:11:47.684980+0000","last_fullsized":"2024-09-21T06:11:47.684980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":192,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:54.829242+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:11:54.829242+0000","last_peered":"2024-09-21T06:11:54.829242+0000","last_clean":"2024-09-21T06:11:54.829242+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:11:54.829242+0000","last_undegraded":"2024-09-21T06:11:54.829242+0000","last_fullsized":"2024-09-21T06:11:54.829242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":121,"num_read_kb":125,"num_write":33,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817467+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:11:47.817467+0000","last_peered":"2024-09-21T06:11:47.817467+0000","last_clean":"2024-09-21T06:11:47.817467+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:11:47.817467+0000","last_undegraded":"2024-09-21T06:11:47.817467+0000","last_fullsized":"2024-09-21T06:11:47.817467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678379+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:11:47.678379+0000","last_peered":"2024-09-21T06:11:47.678379+0000","last_clean":"2024-09-21T06:11:47.678379+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:11:47.678379+0000","last_undegraded":"2024-09-21T06:11:47.678379+0000","last_fullsized":"2024-09-21T06:11:47.678379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678933+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:11:47.678933+0000","last_peered":"2024-09-21T06:11:47.678933+0000","last_clean":"2024-09-21T06:11:47.678933+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:11:47.678933+0000","last_undegraded":"2024-09-21T06:11:47.678933+0000","last_fullsized":"2024-09-21T06:11:47.678933+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766973+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:11:47.766973+0000","last_peered":"2024-09-21T06:11:47.766973+0000","last_clean":"2024-09-21T06:11:47.766973+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:11:47.766973+0000","last_undegraded":"2024-09-21T06:11:47.766973+0000","last_fullsized":"2024-09-21T06:11:47.766973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953553+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:11:47.953553+0000","last_peered":"2024-09-21T06:11:47.953553+0000","last_clean":"2024-09-21T06:11:47.953553+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:11:47.953553+0000","last_undegraded":"2024-09-21T06:11:47.953553+0000","last_fullsized":"2024-09-21T06:11:47.953553+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.771178+0000","last_change":"2024-09-21T06:11:47.771046+0000","last_active":"2024-09-21T06:11:47.771178+0000","last_peered":"2024-09-21T06:11:47.771178+0000","last_clean":"2024-09-21T06:11:47.771178+0000","last_became_active":"2024-09-21T06:11:47.768022+0000","last_became_peered":"2024-09-21T06:11:47.768022+0000","last_unstale":"2024-09-21T06:11:47.771178+0000","last_undegraded":"2024-09-21T06:11:47.771178+0000","last_fullsized":"2024-09-21T06:11:47.771178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:26.464373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887751+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:11:47.887751+0000","last_peered":"2024-09-21T06:11:47.887751+0000","last_clean":"2024-09-21T06:11:47.887751+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:11:47.887751+0000","last_undegraded":"2024-09-21T06:11:47.887751+0000","last_fullsized":"2024-09-21T06:11:47.887751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678511+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:11:47.678511+0000","last_peered":"2024-09-21T06:11:47.678511+0000","last_clean":"2024-09-21T06:11:47.678511+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:11:47.678511+0000","last_undegraded":"2024-09-21T06:11:47.678511+0000","last_fullsized":"2024-09-21T06:11:47.678511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:53.827770+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:11:53.827770+0000","last_peered":"2024-09-21T06:11:53.827770+0000","last_clean":"2024-09-21T06:11:53.827770+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:11:53.827770+0000","last_undegraded":"2024-09-21T06:11:53.827770+0000","last_fullsized":"2024-09-21T06:11:53.827770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684133+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:11:47.684133+0000","last_peered":"2024-09-21T06:11:47.684133+0000","last_clean":"2024-09-21T06:11:47.684133+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:11:47.684133+0000","last_undegraded":"2024-09-21T06:11:47.684133+0000","last_fullsized":"2024-09-21T06:11:47.684133+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953151+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:11:47.953151+0000","last_peered":"2024-09-21T06:11:47.953151+0000","last_clean":"2024-09-21T06:11:47.953151+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:11:47.953151+0000","last_undegraded":"2024-09-21T06:11:47.953151+0000","last_fullsized":"2024-09-21T06:11:47.953151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887932+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:11:47.887932+0000","last_peered":"2024-09-21T06:11:47.887932+0000","last_clean":"2024-09-21T06:11:47.887932+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:11:47.887932+0000","last_undegraded":"2024-09-21T06:11:47.887932+0000","last_fullsized":"2024-09-21T06:11:47.887932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678680+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:11:47.678680+0000","last_peered":"2024-09-21T06:11:47.678680+0000","last_clean":"2024-09-21T06:11:47.678680+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:11:47.678680+0000","last_undegraded":"2024-09-21T06:11:47.678680+0000","last_fullsized":"2024-09-21T06:11:47.678680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682459+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:11:47.682459+0000","last_peered":"2024-09-21T06:11:47.682459+0000","last_clean":"2024-09-21T06:11:47.682459+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:11:47.682459+0000","last_undegraded":"2024-09-21T06:11:47.682459+0000","last_fullsized":"2024-09-21T06:11:47.682459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684019+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:11:47.684019+0000","last_peered":"2024-09-21T06:11:47.684019+0000","last_clean":"2024-09-21T06:11:47.684019+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:11:47.684019+0000","last_undegraded":"2024-09-21T06:11:47.684019+0000","last_fullsized":"2024-09-21T06:11:47.684019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677106+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:11:47.677106+0000","last_peered":"2024-09-21T06:11:47.677106+0000","last_clean":"2024-09-21T06:11:47.677106+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:11:47.677106+0000","last_undegraded":"2024-09-21T06:11:47.677106+0000","last_fullsized":"2024-09-21T06:11:47.677106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817672+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:11:47.817672+0000","last_peered":"2024-09-21T06:11:47.817672+0000","last_clean":"2024-09-21T06:11:47.817672+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:11:47.817672+0000","last_undegraded":"2024-09-21T06:11:47.817672+0000","last_fullsized":"2024-09-21T06:11:47.817672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887902+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:11:47.887902+0000","last_peered":"2024-09-21T06:11:47.887902+0000","last_clean":"2024-09-21T06:11:47.887902+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:11:47.887902+0000","last_undegraded":"2024-09-21T06:11:47.887902+0000","last_fullsized":"2024-09-21T06:11:47.887902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684408+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:11:47.684408+0000","last_peered":"2024-09-21T06:11:47.684408+0000","last_clean":"2024-09-21T06:11:47.684408+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:11:47.684408+0000","last_undegraded":"2024-09-21T06:11:47.684408+0000","last_fullsized":"2024-09-21T06:11:47.684408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:54.829826+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:11:54.829826+0000","last_peered":"2024-09-21T06:11:54.829826+0000","last_clean":"2024-09-21T06:11:54.829826+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:11:54.829826+0000","last_undegraded":"2024-09-21T06:11:54.829826+0000","last_fullsized":"2024-09-21T06:11:54.829826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685009+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:11:47.685009+0000","last_peered":"2024-09-21T06:11:47.685009+0000","last_clean":"2024-09-21T06:11:47.685009+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:11:47.685009+0000","last_undegraded":"2024-09-21T06:11:47.685009+0000","last_fullsized":"2024-09-21T06:11:47.685009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684234+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:11:47.684234+0000","last_peered":"2024-09-21T06:11:47.684234+0000","last_clean":"2024-09-21T06:11:47.684234+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:11:47.684234+0000","last_undegraded":"2024-09-21T06:11:47.684234+0000","last_fullsized":"2024-09-21T06:11:47.684234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681873+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:11:47.681873+0000","last_peered":"2024-09-21T06:11:47.681873+0000","last_clean":"2024-09-21T06:11:47.681873+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:11:47.681873+0000","last_undegraded":"2024-09-21T06:11:47.681873+0000","last_fullsized":"2024-09-21T06:11:47.681873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683548+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:11:47.683548+0000","last_peered":"2024-09-21T06:11:47.683548+0000","last_clean":"2024-09-21T06:11:47.683548+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:11:47.683548+0000","last_undegraded":"2024-09-21T06:11:47.683548+0000","last_fullsized":"2024-09-21T06:11:47.683548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683411+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:11:47.683411+0000","last_peered":"2024-09-21T06:11:47.683411+0000","last_clean":"2024-09-21T06:11:47.683411+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:11:47.683411+0000","last_undegraded":"2024-09-21T06:11:47.683411+0000","last_fullsized":"2024-09-21T06:11:47.683411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953471+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:11:47.953471+0000","last_peered":"2024-09-21T06:11:47.953471+0000","last_clean":"2024-09-21T06:11:47.953471+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:11:47.953471+0000","last_undegraded":"2024-09-21T06:11:47.953471+0000","last_fullsized":"2024-09-21T06:11:47.953471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677549+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:11:47.677549+0000","last_peered":"2024-09-21T06:11:47.677549+0000","last_clean":"2024-09-21T06:11:47.677549+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:11:47.677549+0000","last_undegraded":"2024-09-21T06:11:47.677549+0000","last_fullsized":"2024-09-21T06:11:47.677549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682538+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:11:47.682538+0000","last_peered":"2024-09-21T06:11:47.682538+0000","last_clean":"2024-09-21T06:11:47.682538+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:11:47.682538+0000","last_undegraded":"2024-09-21T06:11:47.682538+0000","last_fullsized":"2024-09-21T06:11:47.682538+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684269+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:11:47.684269+0000","last_peered":"2024-09-21T06:11:47.684269+0000","last_clean":"2024-09-21T06:11:47.684269+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:11:47.684269+0000","last_undegraded":"2024-09-21T06:11:47.684269+0000","last_fullsized":"2024-09-21T06:11:47.684269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684555+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:11:47.684555+0000","last_peered":"2024-09-21T06:11:47.684555+0000","last_clean":"2024-09-21T06:11:47.684555+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:11:47.684555+0000","last_undegraded":"2024-09-21T06:11:47.684555+0000","last_fullsized":"2024-09-21T06:11:47.684555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678285+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:11:47.678285+0000","last_peered":"2024-09-21T06:11:47.678285+0000","last_clean":"2024-09-21T06:11:47.678285+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:11:47.678285+0000","last_undegraded":"2024-09-21T06:11:47.678285+0000","last_fullsized":"2024-09-21T06:11:47.678285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684296+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:11:47.684296+0000","last_peered":"2024-09-21T06:11:47.684296+0000","last_clean":"2024-09-21T06:11:47.684296+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:11:47.684296+0000","last_undegraded":"2024-09-21T06:11:47.684296+0000","last_fullsized":"2024-09-21T06:11:47.684296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678144+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:11:47.678144+0000","last_peered":"2024-09-21T06:11:47.678144+0000","last_clean":"2024-09-21T06:11:47.678144+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:11:47.678144+0000","last_undegraded":"2024-09-21T06:11:47.678144+0000","last_fullsized":"2024-09-21T06:11:47.678144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677478+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:11:47.677478+0000","last_peered":"2024-09-21T06:11:47.677478+0000","last_clean":"2024-09-21T06:11:47.677478+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:11:47.677478+0000","last_undegraded":"2024-09-21T06:11:47.677478+0000","last_fullsized":"2024-09-21T06:11:47.677478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682140+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:11:47.682140+0000","last_peered":"2024-09-21T06:11:47.682140+0000","last_clean":"2024-09-21T06:11:47.682140+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:11:47.682140+0000","last_undegraded":"2024-09-21T06:11:47.682140+0000","last_fullsized":"2024-09-21T06:11:47.682140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684346+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:11:47.684346+0000","last_peered":"2024-09-21T06:11:47.684346+0000","last_clean":"2024-09-21T06:11:47.684346+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:11:47.684346+0000","last_undegraded":"2024-09-21T06:11:47.684346+0000","last_fullsized":"2024-09-21T06:11:47.684346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888478+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:11:47.888478+0000","last_peered":"2024-09-21T06:11:47.888478+0000","last_clean":"2024-09-21T06:11:47.888478+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:11:47.888478+0000","last_undegraded":"2024-09-21T06:11:47.888478+0000","last_fullsized":"2024-09-21T06:11:47.888478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682831+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:11:47.682831+0000","last_peered":"2024-09-21T06:11:47.682831+0000","last_clean":"2024-09-21T06:11:47.682831+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:11:47.682831+0000","last_undegraded":"2024-09-21T06:11:47.682831+0000","last_fullsized":"2024-09-21T06:11:47.682831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677850+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:11:47.677850+0000","last_peered":"2024-09-21T06:11:47.677850+0000","last_clean":"2024-09-21T06:11:47.677850+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:11:47.677850+0000","last_undegraded":"2024-09-21T06:11:47.677850+0000","last_fullsized":"2024-09-21T06:11:47.677850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953003+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:11:47.953003+0000","last_peered":"2024-09-21T06:11:47.953003+0000","last_clean":"2024-09-21T06:11:47.953003+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:11:47.953003+0000","last_undegraded":"2024-09-21T06:11:47.953003+0000","last_fullsized":"2024-09-21T06:11:47.953003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953083+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:11:47.953083+0000","last_peered":"2024-09-21T06:11:47.953083+0000","last_clean":"2024-09-21T06:11:47.953083+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:11:47.953083+0000","last_undegraded":"2024-09-21T06:11:47.953083+0000","last_fullsized":"2024-09-21T06:11:47.953083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677375+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:11:47.677375+0000","last_peered":"2024-09-21T06:11:47.677375+0000","last_clean":"2024-09-21T06:11:47.677375+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:11:47.677375+0000","last_undegraded":"2024-09-21T06:11:47.677375+0000","last_fullsized":"2024-09-21T06:11:47.677375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767275+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:11:47.767275+0000","last_peered":"2024-09-21T06:11:47.767275+0000","last_clean":"2024-09-21T06:11:47.767275+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:11:47.767275+0000","last_undegraded":"2024-09-21T06:11:47.767275+0000","last_fullsized":"2024-09-21T06:11:47.767275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681181+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:11:47.681181+0000","last_peered":"2024-09-21T06:11:47.681181+0000","last_clean":"2024-09-21T06:11:47.681181+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:11:47.681181+0000","last_undegraded":"2024-09-21T06:11:47.681181+0000","last_fullsized":"2024-09-21T06:11:47.681181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.818039+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:11:47.818039+0000","last_peered":"2024-09-21T06:11:47.818039+0000","last_clean":"2024-09-21T06:11:47.818039+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:11:47.818039+0000","last_undegraded":"2024-09-21T06:11:47.818039+0000","last_fullsized":"2024-09-21T06:11:47.818039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678621+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:11:47.678621+0000","last_peered":"2024-09-21T06:11:47.678621+0000","last_clean":"2024-09-21T06:11:47.678621+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:11:47.678621+0000","last_undegraded":"2024-09-21T06:11:47.678621+0000","last_fullsized":"2024-09-21T06:11:47.678621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683955+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:11:47.683955+0000","last_peered":"2024-09-21T06:11:47.683955+0000","last_clean":"2024-09-21T06:11:47.683955+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:11:47.683955+0000","last_undegraded":"2024-09-21T06:11:47.683955+0000","last_fullsized":"2024-09-21T06:11:47.683955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680450+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:11:47.680450+0000","last_peered":"2024-09-21T06:11:47.680450+0000","last_clean":"2024-09-21T06:11:47.680450+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:11:47.680450+0000","last_undegraded":"2024-09-21T06:11:47.680450+0000","last_fullsized":"2024-09-21T06:11:47.680450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817627+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:11:47.817627+0000","last_peered":"2024-09-21T06:11:47.817627+0000","last_clean":"2024-09-21T06:11:47.817627+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:11:47.817627+0000","last_undegraded":"2024-09-21T06:11:47.817627+0000","last_fullsized":"2024-09-21T06:11:47.817627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685335+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:11:47.685335+0000","last_peered":"2024-09-21T06:11:47.685335+0000","last_clean":"2024-09-21T06:11:47.685335+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:11:47.685335+0000","last_undegraded":"2024-09-21T06:11:47.685335+0000","last_fullsized":"2024-09-21T06:11:47.685335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767104+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:11:47.767104+0000","last_peered":"2024-09-21T06:11:47.767104+0000","last_clean":"2024-09-21T06:11:47.767104+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:11:47.767104+0000","last_undegraded":"2024-09-21T06:11:47.767104+0000","last_fullsized":"2024-09-21T06:11:47.767104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953257+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:11:47.953257+0000","last_peered":"2024-09-21T06:11:47.953257+0000","last_clean":"2024-09-21T06:11:47.953257+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:11:47.953257+0000","last_undegraded":"2024-09-21T06:11:47.953257+0000","last_fullsized":"2024-09-21T06:11:47.953257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953250+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:11:47.953250+0000","last_peered":"2024-09-21T06:11:47.953250+0000","last_clean":"2024-09-21T06:11:47.953250+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:11:47.953250+0000","last_undegraded":"2024-09-21T06:11:47.953250+0000","last_fullsized":"2024-09-21T06:11:47.953250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682784+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:11:47.682784+0000","last_peered":"2024-09-21T06:11:47.682784+0000","last_clean":"2024-09-21T06:11:47.682784+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:11:47.682784+0000","last_undegraded":"2024-09-21T06:11:47.682784+0000","last_fullsized":"2024-09-21T06:11:47.682784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69822,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":362,"num_read_kb":253,"num_write":166,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":209466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":473624,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1064960,"data_stored":1127082,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":933888,"data_stored":477934,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266737,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":473736,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":1069276,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":909312,"data_stored":469014,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1064864,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":473664,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":921600,"data_stored":469208,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":536486,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":535136,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":470402,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":67790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:11:58.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:11:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:58 smithi017 ceph-mon[31080]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:11:58 smithi017 ceph-mon[31080]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:58 smithi081 ceph-mon[33870]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:59.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:11:58 smithi081 ceph-mon[33870]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 -- 172.21.15.17:0/4077106791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff784102a80 msgr2=0x7ff784102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 --2- 172.21.15.17:0/4077106791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff784102a80 0x7ff784102e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff774009900 tx=0x7ff77402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 -- 172.21.15.17:0/4077106791 shutdown_connections 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 --2- 172.21.15.17:0/4077106791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784108d10 0x7ff78410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 --2- 172.21.15.17:0/4077106791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7841083c0 0x7ff7841087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 --2- 172.21.15.17:0/4077106791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff784102a80 0x7ff784102e90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 -- 172.21.15.17:0/4077106791 >> 172.21.15.17:0/4077106791 conn(0x7ff784079740 msgr2=0x7ff784079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:59.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 -- 172.21.15.17:0/4077106791 shutdown_connections 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.017+0000 7ff788c40640 1 -- 172.21.15.17:0/4077106791 wait complete. 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 Processor -- start 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 -- start start 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784102a80 0x7ff78419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 0x7ff78419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff784108d10 0x7ff78419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff784113950 con 0x7ff7841083c0 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7841137d0 con 0x7ff784102a80 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff788c40640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff784113ad0 con 0x7ff784108d10 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 0x7ff78419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 0x7ff78419a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53332/0 (socket says 172.21.15.17:53332) 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 -- 172.21.15.17:0/842394312 learned_addr learned my addr 172.21.15.17:0/842394312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff782d9d640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff784108d10 0x7ff78419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:59.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff78259c640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784102a80 0x7ff78419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 -- 172.21.15.17:0/842394312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff784108d10 msgr2=0x7ff78419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff784108d10 0x7ff78419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 -- 172.21.15.17:0/842394312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784102a80 msgr2=0x7ff78419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784102a80 0x7ff78419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff781d9b640 1 -- 172.21.15.17:0/842394312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7841a02d0 con 0x7ff7841083c0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.018+0000 7ff78259c640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784102a80 0x7ff78419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.019+0000 7ff781d9b640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 0x7ff78419a900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff77800e9f0 tx=0x7ff77800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.019+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800ccc0 con 0x7ff7841083c0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.019+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7841a05c0 con 0x7ff7841083c0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.019+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7780054b0 con 0x7ff7841083c0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.019+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778010430 con 0x7ff7841083c0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.019+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7841a6d20 con 0x7ff7841083c0 2024-09-21T06:11:59.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.020+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff784103d00 con 0x7ff7841083c0 2024-09-21T06:11:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.022+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff7780046c0 con 0x7ff7841083c0 2024-09-21T06:11:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.022+0000 7ff7737fe640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff76c0b65a0 0x7ff76c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.022+0000 7ff78259c640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff76c0b65a0 0x7ff76c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.022+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff7780e7dd0 con 0x7ff7841083c0 2024-09-21T06:11:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.023+0000 7ff78259c640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff76c0b65a0 0x7ff76c0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff774000c00 tx=0x7ff774005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.025+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff778056710 con 0x7ff7841083c0 2024-09-21T06:11:59.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:58 smithi089 ceph-mon[33879]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:11:59.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:11:58 smithi089 ceph-mon[33879]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:11:59.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.211+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff784063800 con 0x7ff76c0b65a0 2024-09-21T06:11:59.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.219+0000 7ff7737fe640 1 -- 172.21.15.17:0/842394312 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340571 (secure 0 0 0) 0x7ff784063800 con 0x7ff76c0b65a0 2024-09-21T06:11:59.223 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:11:59.225 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff76c0b65a0 msgr2=0x7ff76c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff76c0b65a0 0x7ff76c0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff774000c00 tx=0x7ff774005a20 comp rx=0 tx=0).stop 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 msgr2=0x7ff78419a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 0x7ff78419a900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff77800e9f0 tx=0x7ff77800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 shutdown_connections 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff76c0b65a0 0x7ff76c0b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7841083c0 0x7ff78419a900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff784108d10 0x7ff78419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 --2- 172.21.15.17:0/842394312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff784102a80 0x7ff78419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:59.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 >> 172.21.15.17:0/842394312 conn(0x7ff784079740 msgr2=0x7ff784101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:59.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 shutdown_connections 2024-09-21T06:11:59.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:11:59.222+0000 7ff788c40640 1 -- 172.21.15.17:0/842394312 wait complete. 2024-09-21T06:12:00.071 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-21T06:11:59.152173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660424,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":443,"num_read_kb":322,"num_write":291,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373012,"kb_used_data":11216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568812,"statfs":{"total":1151940427776,"available":1151558463488,"internally_reserved":0,"allocated":11485184,"data_stored":7640426,"data_compressed":461643,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.476375"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888658+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:11:47.888658+0000","last_peered":"2024-09-21T06:11:47.888658+0000","last_clean":"2024-09-21T06:11:47.888658+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:11:47.888658+0000","last_undegraded":"2024-09-21T06:11:47.888658+0000","last_fullsized":"2024-09-21T06:11:47.888658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684377+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:11:47.684377+0000","last_peered":"2024-09-21T06:11:47.684377+0000","last_clean":"2024-09-21T06:11:47.684377+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:11:47.684377+0000","last_undegraded":"2024-09-21T06:11:47.684377+0000","last_fullsized":"2024-09-21T06:11:47.684377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683054+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:11:47.683054+0000","last_peered":"2024-09-21T06:11:47.683054+0000","last_clean":"2024-09-21T06:11:47.683054+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:11:47.683054+0000","last_undegraded":"2024-09-21T06:11:47.683054+0000","last_fullsized":"2024-09-21T06:11:47.683054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684627+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:11:47.684627+0000","last_peered":"2024-09-21T06:11:47.684627+0000","last_clean":"2024-09-21T06:11:47.684627+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:11:47.684627+0000","last_undegraded":"2024-09-21T06:11:47.684627+0000","last_fullsized":"2024-09-21T06:11:47.684627+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953505+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:11:47.953505+0000","last_peered":"2024-09-21T06:11:47.953505+0000","last_clean":"2024-09-21T06:11:47.953505+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:11:47.953505+0000","last_undegraded":"2024-09-21T06:11:47.953505+0000","last_fullsized":"2024-09-21T06:11:47.953505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766526+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:11:47.766526+0000","last_peered":"2024-09-21T06:11:47.766526+0000","last_clean":"2024-09-21T06:11:47.766526+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:11:47.766526+0000","last_undegraded":"2024-09-21T06:11:47.766526+0000","last_fullsized":"2024-09-21T06:11:47.766526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685224+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:11:47.685224+0000","last_peered":"2024-09-21T06:11:47.685224+0000","last_clean":"2024-09-21T06:11:47.685224+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:11:47.685224+0000","last_undegraded":"2024-09-21T06:11:47.685224+0000","last_fullsized":"2024-09-21T06:11:47.685224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678243+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:11:47.678243+0000","last_peered":"2024-09-21T06:11:47.678243+0000","last_clean":"2024-09-21T06:11:47.678243+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:11:47.678243+0000","last_undegraded":"2024-09-21T06:11:47.678243+0000","last_fullsized":"2024-09-21T06:11:47.678243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766810+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:11:47.766810+0000","last_peered":"2024-09-21T06:11:47.766810+0000","last_clean":"2024-09-21T06:11:47.766810+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:11:47.766810+0000","last_undegraded":"2024-09-21T06:11:47.766810+0000","last_fullsized":"2024-09-21T06:11:47.766810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685451+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:11:47.685451+0000","last_peered":"2024-09-21T06:11:47.685451+0000","last_clean":"2024-09-21T06:11:47.685451+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:11:47.685451+0000","last_undegraded":"2024-09-21T06:11:47.685451+0000","last_fullsized":"2024-09-21T06:11:47.685451+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678704+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:11:47.678704+0000","last_peered":"2024-09-21T06:11:47.678704+0000","last_clean":"2024-09-21T06:11:47.678704+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:11:47.678704+0000","last_undegraded":"2024-09-21T06:11:47.678704+0000","last_fullsized":"2024-09-21T06:11:47.678704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766802+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:11:47.766802+0000","last_peered":"2024-09-21T06:11:47.766802+0000","last_clean":"2024-09-21T06:11:47.766802+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:11:47.766802+0000","last_undegraded":"2024-09-21T06:11:47.766802+0000","last_fullsized":"2024-09-21T06:11:47.766802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680621+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:11:47.680621+0000","last_peered":"2024-09-21T06:11:47.680621+0000","last_clean":"2024-09-21T06:11:47.680621+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:11:47.680621+0000","last_undegraded":"2024-09-21T06:11:47.680621+0000","last_fullsized":"2024-09-21T06:11:47.680621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684862+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:11:47.684862+0000","last_peered":"2024-09-21T06:11:47.684862+0000","last_clean":"2024-09-21T06:11:47.684862+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:11:47.684862+0000","last_undegraded":"2024-09-21T06:11:47.684862+0000","last_fullsized":"2024-09-21T06:11:47.684862+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767178+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:11:47.767178+0000","last_peered":"2024-09-21T06:11:47.767178+0000","last_clean":"2024-09-21T06:11:47.767178+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:11:47.767178+0000","last_undegraded":"2024-09-21T06:11:47.767178+0000","last_fullsized":"2024-09-21T06:11:47.767178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684171+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:11:47.684171+0000","last_peered":"2024-09-21T06:11:47.684171+0000","last_clean":"2024-09-21T06:11:47.684171+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:11:47.684171+0000","last_undegraded":"2024-09-21T06:11:47.684171+0000","last_fullsized":"2024-09-21T06:11:47.684171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.689397+0000","last_change":"2024-09-21T06:11:47.688842+0000","last_active":"2024-09-21T06:11:47.689397+0000","last_peered":"2024-09-21T06:11:47.689397+0000","last_clean":"2024-09-21T06:11:47.689397+0000","last_became_active":"2024-09-21T06:11:47.685980+0000","last_became_peered":"2024-09-21T06:11:47.685980+0000","last_unstale":"2024-09-21T06:11:47.689397+0000","last_undegraded":"2024-09-21T06:11:47.689397+0000","last_fullsized":"2024-09-21T06:11:47.689397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:40.815179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767087+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:11:47.767087+0000","last_peered":"2024-09-21T06:11:47.767087+0000","last_clean":"2024-09-21T06:11:47.767087+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:11:47.767087+0000","last_undegraded":"2024-09-21T06:11:47.767087+0000","last_fullsized":"2024-09-21T06:11:47.767087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682020+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:11:47.682020+0000","last_peered":"2024-09-21T06:11:47.682020+0000","last_clean":"2024-09-21T06:11:47.682020+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:11:47.682020+0000","last_undegraded":"2024-09-21T06:11:47.682020+0000","last_fullsized":"2024-09-21T06:11:47.682020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684558+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:11:47.684558+0000","last_peered":"2024-09-21T06:11:47.684558+0000","last_clean":"2024-09-21T06:11:47.684558+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:11:47.684558+0000","last_undegraded":"2024-09-21T06:11:47.684558+0000","last_fullsized":"2024-09-21T06:11:47.684558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684970+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:11:47.684970+0000","last_peered":"2024-09-21T06:11:47.684970+0000","last_clean":"2024-09-21T06:11:47.684970+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:11:47.684970+0000","last_undegraded":"2024-09-21T06:11:47.684970+0000","last_fullsized":"2024-09-21T06:11:47.684970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684768+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:11:47.684768+0000","last_peered":"2024-09-21T06:11:47.684768+0000","last_clean":"2024-09-21T06:11:47.684768+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:11:47.684768+0000","last_undegraded":"2024-09-21T06:11:47.684768+0000","last_fullsized":"2024-09-21T06:11:47.684768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678024+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:11:47.678024+0000","last_peered":"2024-09-21T06:11:47.678024+0000","last_clean":"2024-09-21T06:11:47.678024+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:11:47.678024+0000","last_undegraded":"2024-09-21T06:11:47.678024+0000","last_fullsized":"2024-09-21T06:11:47.678024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767291+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:11:47.767291+0000","last_peered":"2024-09-21T06:11:47.767291+0000","last_clean":"2024-09-21T06:11:47.767291+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:11:47.767291+0000","last_undegraded":"2024-09-21T06:11:47.767291+0000","last_fullsized":"2024-09-21T06:11:47.767291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953311+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:11:47.953311+0000","last_peered":"2024-09-21T06:11:47.953311+0000","last_clean":"2024-09-21T06:11:47.953311+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:11:47.953311+0000","last_undegraded":"2024-09-21T06:11:47.953311+0000","last_fullsized":"2024-09-21T06:11:47.953311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767514+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:11:47.767514+0000","last_peered":"2024-09-21T06:11:47.767514+0000","last_clean":"2024-09-21T06:11:47.767514+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:11:47.767514+0000","last_undegraded":"2024-09-21T06:11:47.767514+0000","last_fullsized":"2024-09-21T06:11:47.767514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683285+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:11:47.683285+0000","last_peered":"2024-09-21T06:11:47.683285+0000","last_clean":"2024-09-21T06:11:47.683285+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:11:47.683285+0000","last_undegraded":"2024-09-21T06:11:47.683285+0000","last_fullsized":"2024-09-21T06:11:47.683285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684559+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:11:47.684559+0000","last_peered":"2024-09-21T06:11:47.684559+0000","last_clean":"2024-09-21T06:11:47.684559+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:11:47.684559+0000","last_undegraded":"2024-09-21T06:11:47.684559+0000","last_fullsized":"2024-09-21T06:11:47.684559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888515+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:11:47.888515+0000","last_peered":"2024-09-21T06:11:47.888515+0000","last_clean":"2024-09-21T06:11:47.888515+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:11:47.888515+0000","last_undegraded":"2024-09-21T06:11:47.888515+0000","last_fullsized":"2024-09-21T06:11:47.888515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684158+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:11:47.684158+0000","last_peered":"2024-09-21T06:11:47.684158+0000","last_clean":"2024-09-21T06:11:47.684158+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:11:47.684158+0000","last_undegraded":"2024-09-21T06:11:47.684158+0000","last_fullsized":"2024-09-21T06:11:47.684158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677581+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:11:47.677581+0000","last_peered":"2024-09-21T06:11:47.677581+0000","last_clean":"2024-09-21T06:11:47.677581+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:11:47.677581+0000","last_undegraded":"2024-09-21T06:11:47.677581+0000","last_fullsized":"2024-09-21T06:11:47.677581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685414+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:11:47.685414+0000","last_peered":"2024-09-21T06:11:47.685414+0000","last_clean":"2024-09-21T06:11:47.685414+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:11:47.685414+0000","last_undegraded":"2024-09-21T06:11:47.685414+0000","last_fullsized":"2024-09-21T06:11:47.685414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682105+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:11:47.682105+0000","last_peered":"2024-09-21T06:11:47.682105+0000","last_clean":"2024-09-21T06:11:47.682105+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:11:47.682105+0000","last_undegraded":"2024-09-21T06:11:47.682105+0000","last_fullsized":"2024-09-21T06:11:47.682105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817812+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:11:47.817812+0000","last_peered":"2024-09-21T06:11:47.817812+0000","last_clean":"2024-09-21T06:11:47.817812+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:11:47.817812+0000","last_undegraded":"2024-09-21T06:11:47.817812+0000","last_fullsized":"2024-09-21T06:11:47.817812+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888234+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:11:47.888234+0000","last_peered":"2024-09-21T06:11:47.888234+0000","last_clean":"2024-09-21T06:11:47.888234+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:11:47.888234+0000","last_undegraded":"2024-09-21T06:11:47.888234+0000","last_fullsized":"2024-09-21T06:11:47.888234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685063+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:11:47.685063+0000","last_peered":"2024-09-21T06:11:47.685063+0000","last_clean":"2024-09-21T06:11:47.685063+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:11:47.685063+0000","last_undegraded":"2024-09-21T06:11:47.685063+0000","last_fullsized":"2024-09-21T06:11:47.685063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817604+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:11:47.817604+0000","last_peered":"2024-09-21T06:11:47.817604+0000","last_clean":"2024-09-21T06:11:47.817604+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:11:47.817604+0000","last_undegraded":"2024-09-21T06:11:47.817604+0000","last_fullsized":"2024-09-21T06:11:47.817604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680887+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:11:47.680887+0000","last_peered":"2024-09-21T06:11:47.680887+0000","last_clean":"2024-09-21T06:11:47.680887+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:11:47.680887+0000","last_undegraded":"2024-09-21T06:11:47.680887+0000","last_fullsized":"2024-09-21T06:11:47.680887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677434+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:11:47.677434+0000","last_peered":"2024-09-21T06:11:47.677434+0000","last_clean":"2024-09-21T06:11:47.677434+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:11:47.677434+0000","last_undegraded":"2024-09-21T06:11:47.677434+0000","last_fullsized":"2024-09-21T06:11:47.677434+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678422+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:11:47.678422+0000","last_peered":"2024-09-21T06:11:47.678422+0000","last_clean":"2024-09-21T06:11:47.678422+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:11:47.678422+0000","last_undegraded":"2024-09-21T06:11:47.678422+0000","last_fullsized":"2024-09-21T06:11:47.678422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:56.828078+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:11:56.828078+0000","last_peered":"2024-09-21T06:11:56.828078+0000","last_clean":"2024-09-21T06:11:56.828078+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:11:56.828078+0000","last_undegraded":"2024-09-21T06:11:56.828078+0000","last_fullsized":"2024-09-21T06:11:56.828078+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677703+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:11:47.677703+0000","last_peered":"2024-09-21T06:11:47.677703+0000","last_clean":"2024-09-21T06:11:47.677703+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:11:47.677703+0000","last_undegraded":"2024-09-21T06:11:47.677703+0000","last_fullsized":"2024-09-21T06:11:47.677703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677047+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:11:47.677047+0000","last_peered":"2024-09-21T06:11:47.677047+0000","last_clean":"2024-09-21T06:11:47.677047+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:11:47.677047+0000","last_undegraded":"2024-09-21T06:11:47.677047+0000","last_fullsized":"2024-09-21T06:11:47.677047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680506+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:11:47.680506+0000","last_peered":"2024-09-21T06:11:47.680506+0000","last_clean":"2024-09-21T06:11:47.680506+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:11:47.680506+0000","last_undegraded":"2024-09-21T06:11:47.680506+0000","last_fullsized":"2024-09-21T06:11:47.680506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678653+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:11:47.678653+0000","last_peered":"2024-09-21T06:11:47.678653+0000","last_clean":"2024-09-21T06:11:47.678653+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:11:47.678653+0000","last_undegraded":"2024-09-21T06:11:47.678653+0000","last_fullsized":"2024-09-21T06:11:47.678653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684616+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:11:47.684616+0000","last_peered":"2024-09-21T06:11:47.684616+0000","last_clean":"2024-09-21T06:11:47.684616+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:11:47.684616+0000","last_undegraded":"2024-09-21T06:11:47.684616+0000","last_fullsized":"2024-09-21T06:11:47.684616+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767081+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:11:47.767081+0000","last_peered":"2024-09-21T06:11:47.767081+0000","last_clean":"2024-09-21T06:11:47.767081+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:11:47.767081+0000","last_undegraded":"2024-09-21T06:11:47.767081+0000","last_fullsized":"2024-09-21T06:11:47.767081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681028+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:11:47.681028+0000","last_peered":"2024-09-21T06:11:47.681028+0000","last_clean":"2024-09-21T06:11:47.681028+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:11:47.681028+0000","last_undegraded":"2024-09-21T06:11:47.681028+0000","last_fullsized":"2024-09-21T06:11:47.681028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681125+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:11:47.681125+0000","last_peered":"2024-09-21T06:11:47.681125+0000","last_clean":"2024-09-21T06:11:47.681125+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:11:47.681125+0000","last_undegraded":"2024-09-21T06:11:47.681125+0000","last_fullsized":"2024-09-21T06:11:47.681125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681349+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:11:47.681349+0000","last_peered":"2024-09-21T06:11:47.681349+0000","last_clean":"2024-09-21T06:11:47.681349+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:11:47.681349+0000","last_undegraded":"2024-09-21T06:11:47.681349+0000","last_fullsized":"2024-09-21T06:11:47.681349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684644+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:11:47.684644+0000","last_peered":"2024-09-21T06:11:47.684644+0000","last_clean":"2024-09-21T06:11:47.684644+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:11:47.684644+0000","last_undegraded":"2024-09-21T06:11:47.684644+0000","last_fullsized":"2024-09-21T06:11:47.684644+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677992+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:11:47.677992+0000","last_peered":"2024-09-21T06:11:47.677992+0000","last_clean":"2024-09-21T06:11:47.677992+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:11:47.677992+0000","last_undegraded":"2024-09-21T06:11:47.677992+0000","last_fullsized":"2024-09-21T06:11:47.677992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680946+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:11:47.680946+0000","last_peered":"2024-09-21T06:11:47.680946+0000","last_clean":"2024-09-21T06:11:47.680946+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:11:47.680946+0000","last_undegraded":"2024-09-21T06:11:47.680946+0000","last_fullsized":"2024-09-21T06:11:47.680946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678946+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:11:47.678946+0000","last_peered":"2024-09-21T06:11:47.678946+0000","last_clean":"2024-09-21T06:11:47.678946+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:11:47.678946+0000","last_undegraded":"2024-09-21T06:11:47.678946+0000","last_fullsized":"2024-09-21T06:11:47.678946+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953440+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:11:47.953440+0000","last_peered":"2024-09-21T06:11:47.953440+0000","last_clean":"2024-09-21T06:11:47.953440+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:11:47.953440+0000","last_undegraded":"2024-09-21T06:11:47.953440+0000","last_fullsized":"2024-09-21T06:11:47.953440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681189+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:11:47.681189+0000","last_peered":"2024-09-21T06:11:47.681189+0000","last_clean":"2024-09-21T06:11:47.681189+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:11:47.681189+0000","last_undegraded":"2024-09-21T06:11:47.681189+0000","last_fullsized":"2024-09-21T06:11:47.681189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677687+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:11:47.677687+0000","last_peered":"2024-09-21T06:11:47.677687+0000","last_clean":"2024-09-21T06:11:47.677687+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:11:47.677687+0000","last_undegraded":"2024-09-21T06:11:47.677687+0000","last_fullsized":"2024-09-21T06:11:47.677687+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678022+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:11:47.678022+0000","last_peered":"2024-09-21T06:11:47.678022+0000","last_clean":"2024-09-21T06:11:47.678022+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:11:47.678022+0000","last_undegraded":"2024-09-21T06:11:47.678022+0000","last_fullsized":"2024-09-21T06:11:47.678022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682533+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:11:47.682533+0000","last_peered":"2024-09-21T06:11:47.682533+0000","last_clean":"2024-09-21T06:11:47.682533+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:11:47.682533+0000","last_undegraded":"2024-09-21T06:11:47.682533+0000","last_fullsized":"2024-09-21T06:11:47.682533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682618+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:11:47.682618+0000","last_peered":"2024-09-21T06:11:47.682618+0000","last_clean":"2024-09-21T06:11:47.682618+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:11:47.682618+0000","last_undegraded":"2024-09-21T06:11:47.682618+0000","last_fullsized":"2024-09-21T06:11:47.682618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678203+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:11:47.678203+0000","last_peered":"2024-09-21T06:11:47.678203+0000","last_clean":"2024-09-21T06:11:47.678203+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:11:47.678203+0000","last_undegraded":"2024-09-21T06:11:47.678203+0000","last_fullsized":"2024-09-21T06:11:47.678203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678385+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:11:47.678385+0000","last_peered":"2024-09-21T06:11:47.678385+0000","last_clean":"2024-09-21T06:11:47.678385+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:11:47.678385+0000","last_undegraded":"2024-09-21T06:11:47.678385+0000","last_fullsized":"2024-09-21T06:11:47.678385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685008+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:11:47.685008+0000","last_peered":"2024-09-21T06:11:47.685008+0000","last_clean":"2024-09-21T06:11:47.685008+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:11:47.685008+0000","last_undegraded":"2024-09-21T06:11:47.685008+0000","last_fullsized":"2024-09-21T06:11:47.685008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677637+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:11:47.677637+0000","last_peered":"2024-09-21T06:11:47.677637+0000","last_clean":"2024-09-21T06:11:47.677637+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:11:47.677637+0000","last_undegraded":"2024-09-21T06:11:47.677637+0000","last_fullsized":"2024-09-21T06:11:47.677637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680652+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:11:47.680652+0000","last_peered":"2024-09-21T06:11:47.680652+0000","last_clean":"2024-09-21T06:11:47.680652+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:11:47.680652+0000","last_undegraded":"2024-09-21T06:11:47.680652+0000","last_fullsized":"2024-09-21T06:11:47.680652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:53.823468+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:11:53.823468+0000","last_peered":"2024-09-21T06:11:53.823468+0000","last_clean":"2024-09-21T06:11:53.823468+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:11:53.823468+0000","last_undegraded":"2024-09-21T06:11:53.823468+0000","last_fullsized":"2024-09-21T06:11:53.823468+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888565+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:11:47.888565+0000","last_peered":"2024-09-21T06:11:47.888565+0000","last_clean":"2024-09-21T06:11:47.888565+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:11:47.888565+0000","last_undegraded":"2024-09-21T06:11:47.888565+0000","last_fullsized":"2024-09-21T06:11:47.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680740+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:11:47.680740+0000","last_peered":"2024-09-21T06:11:47.680740+0000","last_clean":"2024-09-21T06:11:47.680740+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:11:47.680740+0000","last_undegraded":"2024-09-21T06:11:47.680740+0000","last_fullsized":"2024-09-21T06:11:47.680740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678430+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:11:47.678430+0000","last_peered":"2024-09-21T06:11:47.678430+0000","last_clean":"2024-09-21T06:11:47.678430+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:11:47.678430+0000","last_undegraded":"2024-09-21T06:11:47.678430+0000","last_fullsized":"2024-09-21T06:11:47.678430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682187+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:11:47.682187+0000","last_peered":"2024-09-21T06:11:47.682187+0000","last_clean":"2024-09-21T06:11:47.682187+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:11:47.682187+0000","last_undegraded":"2024-09-21T06:11:47.682187+0000","last_fullsized":"2024-09-21T06:11:47.682187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677181+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:11:47.677181+0000","last_peered":"2024-09-21T06:11:47.677181+0000","last_clean":"2024-09-21T06:11:47.677181+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:11:47.677181+0000","last_undegraded":"2024-09-21T06:11:47.677181+0000","last_fullsized":"2024-09-21T06:11:47.677181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684105+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:11:47.684105+0000","last_peered":"2024-09-21T06:11:47.684105+0000","last_clean":"2024-09-21T06:11:47.684105+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:11:47.684105+0000","last_undegraded":"2024-09-21T06:11:47.684105+0000","last_fullsized":"2024-09-21T06:11:47.684105+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678699+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:11:47.678699+0000","last_peered":"2024-09-21T06:11:47.678699+0000","last_clean":"2024-09-21T06:11:47.678699+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:11:47.678699+0000","last_undegraded":"2024-09-21T06:11:47.678699+0000","last_fullsized":"2024-09-21T06:11:47.678699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684980+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:11:47.684980+0000","last_peered":"2024-09-21T06:11:47.684980+0000","last_clean":"2024-09-21T06:11:47.684980+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:11:47.684980+0000","last_undegraded":"2024-09-21T06:11:47.684980+0000","last_fullsized":"2024-09-21T06:11:47.684980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":192,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:54.829242+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:11:54.829242+0000","last_peered":"2024-09-21T06:11:54.829242+0000","last_clean":"2024-09-21T06:11:54.829242+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:11:54.829242+0000","last_undegraded":"2024-09-21T06:11:54.829242+0000","last_fullsized":"2024-09-21T06:11:54.829242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":121,"num_read_kb":125,"num_write":33,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817467+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:11:47.817467+0000","last_peered":"2024-09-21T06:11:47.817467+0000","last_clean":"2024-09-21T06:11:47.817467+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:11:47.817467+0000","last_undegraded":"2024-09-21T06:11:47.817467+0000","last_fullsized":"2024-09-21T06:11:47.817467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678379+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:11:47.678379+0000","last_peered":"2024-09-21T06:11:47.678379+0000","last_clean":"2024-09-21T06:11:47.678379+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:11:47.678379+0000","last_undegraded":"2024-09-21T06:11:47.678379+0000","last_fullsized":"2024-09-21T06:11:47.678379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678933+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:11:47.678933+0000","last_peered":"2024-09-21T06:11:47.678933+0000","last_clean":"2024-09-21T06:11:47.678933+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:11:47.678933+0000","last_undegraded":"2024-09-21T06:11:47.678933+0000","last_fullsized":"2024-09-21T06:11:47.678933+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766973+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:11:47.766973+0000","last_peered":"2024-09-21T06:11:47.766973+0000","last_clean":"2024-09-21T06:11:47.766973+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:11:47.766973+0000","last_undegraded":"2024-09-21T06:11:47.766973+0000","last_fullsized":"2024-09-21T06:11:47.766973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953553+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:11:47.953553+0000","last_peered":"2024-09-21T06:11:47.953553+0000","last_clean":"2024-09-21T06:11:47.953553+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:11:47.953553+0000","last_undegraded":"2024-09-21T06:11:47.953553+0000","last_fullsized":"2024-09-21T06:11:47.953553+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.771178+0000","last_change":"2024-09-21T06:11:47.771046+0000","last_active":"2024-09-21T06:11:47.771178+0000","last_peered":"2024-09-21T06:11:47.771178+0000","last_clean":"2024-09-21T06:11:47.771178+0000","last_became_active":"2024-09-21T06:11:47.768022+0000","last_became_peered":"2024-09-21T06:11:47.768022+0000","last_unstale":"2024-09-21T06:11:47.771178+0000","last_undegraded":"2024-09-21T06:11:47.771178+0000","last_fullsized":"2024-09-21T06:11:47.771178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:26.464373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887751+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:11:47.887751+0000","last_peered":"2024-09-21T06:11:47.887751+0000","last_clean":"2024-09-21T06:11:47.887751+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:11:47.887751+0000","last_undegraded":"2024-09-21T06:11:47.887751+0000","last_fullsized":"2024-09-21T06:11:47.887751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678511+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:11:47.678511+0000","last_peered":"2024-09-21T06:11:47.678511+0000","last_clean":"2024-09-21T06:11:47.678511+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:11:47.678511+0000","last_undegraded":"2024-09-21T06:11:47.678511+0000","last_fullsized":"2024-09-21T06:11:47.678511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:53.827770+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:11:53.827770+0000","last_peered":"2024-09-21T06:11:53.827770+0000","last_clean":"2024-09-21T06:11:53.827770+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:11:53.827770+0000","last_undegraded":"2024-09-21T06:11:53.827770+0000","last_fullsized":"2024-09-21T06:11:53.827770+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684133+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:11:47.684133+0000","last_peered":"2024-09-21T06:11:47.684133+0000","last_clean":"2024-09-21T06:11:47.684133+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:11:47.684133+0000","last_undegraded":"2024-09-21T06:11:47.684133+0000","last_fullsized":"2024-09-21T06:11:47.684133+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953151+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:11:47.953151+0000","last_peered":"2024-09-21T06:11:47.953151+0000","last_clean":"2024-09-21T06:11:47.953151+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:11:47.953151+0000","last_undegraded":"2024-09-21T06:11:47.953151+0000","last_fullsized":"2024-09-21T06:11:47.953151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887932+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:11:47.887932+0000","last_peered":"2024-09-21T06:11:47.887932+0000","last_clean":"2024-09-21T06:11:47.887932+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:11:47.887932+0000","last_undegraded":"2024-09-21T06:11:47.887932+0000","last_fullsized":"2024-09-21T06:11:47.887932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678680+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:11:47.678680+0000","last_peered":"2024-09-21T06:11:47.678680+0000","last_clean":"2024-09-21T06:11:47.678680+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:11:47.678680+0000","last_undegraded":"2024-09-21T06:11:47.678680+0000","last_fullsized":"2024-09-21T06:11:47.678680+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682459+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:11:47.682459+0000","last_peered":"2024-09-21T06:11:47.682459+0000","last_clean":"2024-09-21T06:11:47.682459+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:11:47.682459+0000","last_undegraded":"2024-09-21T06:11:47.682459+0000","last_fullsized":"2024-09-21T06:11:47.682459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684019+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:11:47.684019+0000","last_peered":"2024-09-21T06:11:47.684019+0000","last_clean":"2024-09-21T06:11:47.684019+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:11:47.684019+0000","last_undegraded":"2024-09-21T06:11:47.684019+0000","last_fullsized":"2024-09-21T06:11:47.684019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677106+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:11:47.677106+0000","last_peered":"2024-09-21T06:11:47.677106+0000","last_clean":"2024-09-21T06:11:47.677106+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:11:47.677106+0000","last_undegraded":"2024-09-21T06:11:47.677106+0000","last_fullsized":"2024-09-21T06:11:47.677106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817672+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:11:47.817672+0000","last_peered":"2024-09-21T06:11:47.817672+0000","last_clean":"2024-09-21T06:11:47.817672+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:11:47.817672+0000","last_undegraded":"2024-09-21T06:11:47.817672+0000","last_fullsized":"2024-09-21T06:11:47.817672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887902+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:11:47.887902+0000","last_peered":"2024-09-21T06:11:47.887902+0000","last_clean":"2024-09-21T06:11:47.887902+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:11:47.887902+0000","last_undegraded":"2024-09-21T06:11:47.887902+0000","last_fullsized":"2024-09-21T06:11:47.887902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684408+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:11:47.684408+0000","last_peered":"2024-09-21T06:11:47.684408+0000","last_clean":"2024-09-21T06:11:47.684408+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:11:47.684408+0000","last_undegraded":"2024-09-21T06:11:47.684408+0000","last_fullsized":"2024-09-21T06:11:47.684408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:54.829826+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:11:54.829826+0000","last_peered":"2024-09-21T06:11:54.829826+0000","last_clean":"2024-09-21T06:11:54.829826+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:11:54.829826+0000","last_undegraded":"2024-09-21T06:11:54.829826+0000","last_fullsized":"2024-09-21T06:11:54.829826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685009+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:11:47.685009+0000","last_peered":"2024-09-21T06:11:47.685009+0000","last_clean":"2024-09-21T06:11:47.685009+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:11:47.685009+0000","last_undegraded":"2024-09-21T06:11:47.685009+0000","last_fullsized":"2024-09-21T06:11:47.685009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684234+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:11:47.684234+0000","last_peered":"2024-09-21T06:11:47.684234+0000","last_clean":"2024-09-21T06:11:47.684234+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:11:47.684234+0000","last_undegraded":"2024-09-21T06:11:47.684234+0000","last_fullsized":"2024-09-21T06:11:47.684234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681873+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:11:47.681873+0000","last_peered":"2024-09-21T06:11:47.681873+0000","last_clean":"2024-09-21T06:11:47.681873+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:11:47.681873+0000","last_undegraded":"2024-09-21T06:11:47.681873+0000","last_fullsized":"2024-09-21T06:11:47.681873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683548+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:11:47.683548+0000","last_peered":"2024-09-21T06:11:47.683548+0000","last_clean":"2024-09-21T06:11:47.683548+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:11:47.683548+0000","last_undegraded":"2024-09-21T06:11:47.683548+0000","last_fullsized":"2024-09-21T06:11:47.683548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683411+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:11:47.683411+0000","last_peered":"2024-09-21T06:11:47.683411+0000","last_clean":"2024-09-21T06:11:47.683411+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:11:47.683411+0000","last_undegraded":"2024-09-21T06:11:47.683411+0000","last_fullsized":"2024-09-21T06:11:47.683411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953471+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:11:47.953471+0000","last_peered":"2024-09-21T06:11:47.953471+0000","last_clean":"2024-09-21T06:11:47.953471+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:11:47.953471+0000","last_undegraded":"2024-09-21T06:11:47.953471+0000","last_fullsized":"2024-09-21T06:11:47.953471+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677549+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:11:47.677549+0000","last_peered":"2024-09-21T06:11:47.677549+0000","last_clean":"2024-09-21T06:11:47.677549+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:11:47.677549+0000","last_undegraded":"2024-09-21T06:11:47.677549+0000","last_fullsized":"2024-09-21T06:11:47.677549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682538+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:11:47.682538+0000","last_peered":"2024-09-21T06:11:47.682538+0000","last_clean":"2024-09-21T06:11:47.682538+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:11:47.682538+0000","last_undegraded":"2024-09-21T06:11:47.682538+0000","last_fullsized":"2024-09-21T06:11:47.682538+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684269+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:11:47.684269+0000","last_peered":"2024-09-21T06:11:47.684269+0000","last_clean":"2024-09-21T06:11:47.684269+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:11:47.684269+0000","last_undegraded":"2024-09-21T06:11:47.684269+0000","last_fullsized":"2024-09-21T06:11:47.684269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684555+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:11:47.684555+0000","last_peered":"2024-09-21T06:11:47.684555+0000","last_clean":"2024-09-21T06:11:47.684555+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:11:47.684555+0000","last_undegraded":"2024-09-21T06:11:47.684555+0000","last_fullsized":"2024-09-21T06:11:47.684555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678285+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:11:47.678285+0000","last_peered":"2024-09-21T06:11:47.678285+0000","last_clean":"2024-09-21T06:11:47.678285+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:11:47.678285+0000","last_undegraded":"2024-09-21T06:11:47.678285+0000","last_fullsized":"2024-09-21T06:11:47.678285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684296+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:11:47.684296+0000","last_peered":"2024-09-21T06:11:47.684296+0000","last_clean":"2024-09-21T06:11:47.684296+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:11:47.684296+0000","last_undegraded":"2024-09-21T06:11:47.684296+0000","last_fullsized":"2024-09-21T06:11:47.684296+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678144+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:11:47.678144+0000","last_peered":"2024-09-21T06:11:47.678144+0000","last_clean":"2024-09-21T06:11:47.678144+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:11:47.678144+0000","last_undegraded":"2024-09-21T06:11:47.678144+0000","last_fullsized":"2024-09-21T06:11:47.678144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677478+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:11:47.677478+0000","last_peered":"2024-09-21T06:11:47.677478+0000","last_clean":"2024-09-21T06:11:47.677478+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:11:47.677478+0000","last_undegraded":"2024-09-21T06:11:47.677478+0000","last_fullsized":"2024-09-21T06:11:47.677478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682140+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:11:47.682140+0000","last_peered":"2024-09-21T06:11:47.682140+0000","last_clean":"2024-09-21T06:11:47.682140+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:11:47.682140+0000","last_undegraded":"2024-09-21T06:11:47.682140+0000","last_fullsized":"2024-09-21T06:11:47.682140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684346+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:11:47.684346+0000","last_peered":"2024-09-21T06:11:47.684346+0000","last_clean":"2024-09-21T06:11:47.684346+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:11:47.684346+0000","last_undegraded":"2024-09-21T06:11:47.684346+0000","last_fullsized":"2024-09-21T06:11:47.684346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888478+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:11:47.888478+0000","last_peered":"2024-09-21T06:11:47.888478+0000","last_clean":"2024-09-21T06:11:47.888478+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:11:47.888478+0000","last_undegraded":"2024-09-21T06:11:47.888478+0000","last_fullsized":"2024-09-21T06:11:47.888478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682831+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:11:47.682831+0000","last_peered":"2024-09-21T06:11:47.682831+0000","last_clean":"2024-09-21T06:11:47.682831+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:11:47.682831+0000","last_undegraded":"2024-09-21T06:11:47.682831+0000","last_fullsized":"2024-09-21T06:11:47.682831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677850+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:11:47.677850+0000","last_peered":"2024-09-21T06:11:47.677850+0000","last_clean":"2024-09-21T06:11:47.677850+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:11:47.677850+0000","last_undegraded":"2024-09-21T06:11:47.677850+0000","last_fullsized":"2024-09-21T06:11:47.677850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953003+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:11:47.953003+0000","last_peered":"2024-09-21T06:11:47.953003+0000","last_clean":"2024-09-21T06:11:47.953003+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:11:47.953003+0000","last_undegraded":"2024-09-21T06:11:47.953003+0000","last_fullsized":"2024-09-21T06:11:47.953003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953083+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:11:47.953083+0000","last_peered":"2024-09-21T06:11:47.953083+0000","last_clean":"2024-09-21T06:11:47.953083+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:11:47.953083+0000","last_undegraded":"2024-09-21T06:11:47.953083+0000","last_fullsized":"2024-09-21T06:11:47.953083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677375+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:11:47.677375+0000","last_peered":"2024-09-21T06:11:47.677375+0000","last_clean":"2024-09-21T06:11:47.677375+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:11:47.677375+0000","last_undegraded":"2024-09-21T06:11:47.677375+0000","last_fullsized":"2024-09-21T06:11:47.677375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767275+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:11:47.767275+0000","last_peered":"2024-09-21T06:11:47.767275+0000","last_clean":"2024-09-21T06:11:47.767275+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:11:47.767275+0000","last_undegraded":"2024-09-21T06:11:47.767275+0000","last_fullsized":"2024-09-21T06:11:47.767275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681181+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:11:47.681181+0000","last_peered":"2024-09-21T06:11:47.681181+0000","last_clean":"2024-09-21T06:11:47.681181+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:11:47.681181+0000","last_undegraded":"2024-09-21T06:11:47.681181+0000","last_fullsized":"2024-09-21T06:11:47.681181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.818039+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:11:47.818039+0000","last_peered":"2024-09-21T06:11:47.818039+0000","last_clean":"2024-09-21T06:11:47.818039+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:11:47.818039+0000","last_undegraded":"2024-09-21T06:11:47.818039+0000","last_fullsized":"2024-09-21T06:11:47.818039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678621+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:11:47.678621+0000","last_peered":"2024-09-21T06:11:47.678621+0000","last_clean":"2024-09-21T06:11:47.678621+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:11:47.678621+0000","last_undegraded":"2024-09-21T06:11:47.678621+0000","last_fullsized":"2024-09-21T06:11:47.678621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683955+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:11:47.683955+0000","last_peered":"2024-09-21T06:11:47.683955+0000","last_clean":"2024-09-21T06:11:47.683955+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:11:47.683955+0000","last_undegraded":"2024-09-21T06:11:47.683955+0000","last_fullsized":"2024-09-21T06:11:47.683955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680450+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:11:47.680450+0000","last_peered":"2024-09-21T06:11:47.680450+0000","last_clean":"2024-09-21T06:11:47.680450+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:11:47.680450+0000","last_undegraded":"2024-09-21T06:11:47.680450+0000","last_fullsized":"2024-09-21T06:11:47.680450+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817627+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:11:47.817627+0000","last_peered":"2024-09-21T06:11:47.817627+0000","last_clean":"2024-09-21T06:11:47.817627+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:11:47.817627+0000","last_undegraded":"2024-09-21T06:11:47.817627+0000","last_fullsized":"2024-09-21T06:11:47.817627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685335+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:11:47.685335+0000","last_peered":"2024-09-21T06:11:47.685335+0000","last_clean":"2024-09-21T06:11:47.685335+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:11:47.685335+0000","last_undegraded":"2024-09-21T06:11:47.685335+0000","last_fullsized":"2024-09-21T06:11:47.685335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767104+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:11:47.767104+0000","last_peered":"2024-09-21T06:11:47.767104+0000","last_clean":"2024-09-21T06:11:47.767104+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:11:47.767104+0000","last_undegraded":"2024-09-21T06:11:47.767104+0000","last_fullsized":"2024-09-21T06:11:47.767104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953257+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:11:47.953257+0000","last_peered":"2024-09-21T06:11:47.953257+0000","last_clean":"2024-09-21T06:11:47.953257+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:11:47.953257+0000","last_undegraded":"2024-09-21T06:11:47.953257+0000","last_fullsized":"2024-09-21T06:11:47.953257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953250+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:11:47.953250+0000","last_peered":"2024-09-21T06:11:47.953250+0000","last_clean":"2024-09-21T06:11:47.953250+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:11:47.953250+0000","last_undegraded":"2024-09-21T06:11:47.953250+0000","last_fullsized":"2024-09-21T06:11:47.953250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682784+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:11:47.682784+0000","last_peered":"2024-09-21T06:11:47.682784+0000","last_clean":"2024-09-21T06:11:47.682784+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:11:47.682784+0000","last_undegraded":"2024-09-21T06:11:47.682784+0000","last_fullsized":"2024-09-21T06:11:47.682784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69822,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":367,"num_read_kb":258,"num_write":166,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":209466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":473624,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1064960,"data_stored":1127082,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":933888,"data_stored":477934,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266737,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":473736,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":1069276,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593788,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":909312,"data_stored":469014,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":1064864,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":473664,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":921600,"data_stored":469208,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":536486,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":535136,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":470402,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":67790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:12:00.076 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:12:00.076 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:12:00.076 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:12:00.076 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T06:12:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:00.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:00 smithi017 ceph-mon[31080]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:00.753 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:00 smithi017 ceph-mon[31080]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 -- 172.21.15.17:0/3250278984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb901094c0 msgr2=0x7feb901098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 --2- 172.21.15.17:0/3250278984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb901094c0 0x7feb901098d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feb84009900 tx=0x7feb8402a410 comp rx=0 tx=0).stop 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 -- 172.21.15.17:0/3250278984 shutdown_connections 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 --2- 172.21.15.17:0/3250278984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb901094c0 0x7feb901098d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 --2- 172.21.15.17:0/3250278984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90109e10 0x7feb90110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 --2- 172.21.15.17:0/3250278984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90103b80 0x7feb90103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 -- 172.21.15.17:0/3250278984 >> 172.21.15.17:0/3250278984 conn(0x7feb900ff5d0 msgr2=0x7feb90101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 -- 172.21.15.17:0/3250278984 shutdown_connections 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.842+0000 7feb956be640 1 -- 172.21.15.17:0/3250278984 wait complete. 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.843+0000 7feb956be640 1 Processor -- start 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.843+0000 7feb956be640 1 -- start start 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb956be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90103b80 0x7feb9019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb956be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb901094c0 0x7feb9019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb956be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 0x7feb901a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb956be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feb90113980 con 0x7feb90109e10 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb956be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb90113800 con 0x7feb90103b80 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb956be640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feb90113b00 con 0x7feb901094c0 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 0x7feb901a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 0x7feb901a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53352/0 (socket says 172.21.15.17:53352) 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 -- 172.21.15.17:0/3425205111 learned_addr learned my addr 172.21.15.17:0/3425205111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:00.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8e7fc640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb901094c0 0x7feb9019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8effd640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90103b80 0x7feb9019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 -- 172.21.15.17:0/3425205111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb901094c0 msgr2=0x7feb9019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb901094c0 0x7feb9019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 -- 172.21.15.17:0/3425205111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90103b80 msgr2=0x7feb9019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90103b80 0x7feb9019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 -- 172.21.15.17:0/3425205111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb901a24c0 con 0x7feb90109e10 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.844+0000 7feb8f7fe640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 0x7feb901a1e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb8800eaa0 tx=0x7feb8800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.845+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88004d20 con 0x7feb90109e10 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.845+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb88005020 con 0x7feb90109e10 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.845+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb901a27b0 con 0x7feb90109e10 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.845+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880116d0 con 0x7feb90109e10 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.845+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb901a8fd0 con 0x7feb90109e10 2024-09-21T06:12:00.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.846+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb90103f90 con 0x7feb90109e10 2024-09-21T06:12:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.847+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7feb880051d0 con 0x7feb90109e10 2024-09-21T06:12:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.848+0000 7feb77fff640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7feb780b6650 0x7feb780b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.848+0000 7feb8effd640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7feb780b6650 0x7feb780b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.848+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7feb880e78c0 con 0x7feb90109e10 2024-09-21T06:12:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.849+0000 7feb8effd640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7feb780b6650 0x7feb780b8b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feb8000abe0 tx=0x7feb8000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:00.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:00.852+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb88016030 con 0x7feb90109e10 2024-09-21T06:12:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:00 smithi081 ceph-mon[33870]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:00 smithi081 ceph-mon[33870]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:01.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.080+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb901a91a0 con 0x7feb90109e10 2024-09-21T06:12:01.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.080+0000 7feb77fff640 1 -- 172.21.15.17:0/3425205111 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7feb880adc60 con 0x7feb90109e10 2024-09-21T06:12:01.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:01.082 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7feb780b6650 msgr2=0x7feb780b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7feb780b6650 0x7feb780b8b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feb8000abe0 tx=0x7feb8000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 msgr2=0x7feb901a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 0x7feb901a1e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb8800eaa0 tx=0x7feb8800eea0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 shutdown_connections 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7feb780b6650 0x7feb780b8b60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb90109e10 0x7feb901a1e50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb901094c0 0x7feb9019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 --2- 172.21.15.17:0/3425205111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb90103b80 0x7feb9019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 >> 172.21.15.17:0/3425205111 conn(0x7feb900ff5d0 msgr2=0x7feb9010e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 shutdown_connections 2024-09-21T06:12:01.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:01.083+0000 7feb956be640 1 -- 172.21.15.17:0/3425205111 wait complete. 2024-09-21T06:12:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:00 smithi089 ceph-mon[33879]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:00 smithi089 ceph-mon[33879]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:01.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:01 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3425205111' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:12:01.875 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:12:01.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:02.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:01 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3425205111' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:12:02.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:01 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3425205111' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:12:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2097111775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 msgr2=0x7fbeec1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:02.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2097111775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec1098b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009900 tx=0x7fbedc02a410 comp rx=0 tx=0).stop 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2097111775 shutdown_connections 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2097111775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec1098b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2097111775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeec109df0 0x7fbeec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2097111775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 0x7fbeec103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2097111775 >> 172.21.15.17:0/2097111775 conn(0x7fbeec07b850 msgr2=0x7fbeec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2097111775 shutdown_connections 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.645+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2097111775 wait complete. 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 Processor -- start 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 -- start start 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 0x7fbeec19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeec109df0 0x7fbeec19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec113960 con 0x7fbeec1094a0 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec1137e0 con 0x7fbeec103b60 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbef0b3a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec113ae0 con 0x7fbeec109df0 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbee9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbee9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53370/0 (socket says 172.21.15.17:53370) 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbee9d9b640 1 -- 172.21.15.17:0/2493351053 learned_addr learned my addr 172.21.15.17:0/2493351053 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbeead9d640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeec109df0 0x7fbeec19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.646+0000 7fbeea59c640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 0x7fbeec19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee9d9b640 1 -- 172.21.15.17:0/2493351053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeec109df0 msgr2=0x7fbeec19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee9d9b640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeec109df0 0x7fbeec19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee9d9b640 1 -- 172.21.15.17:0/2493351053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 msgr2=0x7fbeec19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:02.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee9d9b640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 0x7fbeec19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee9d9b640 1 -- 172.21.15.17:0/2493351053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec1a02e0 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbeea59c640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 0x7fbeec19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee9d9b640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec19a9d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbedc004770 tx=0x7fbedc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc03f030 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbedc004440 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec1a0570 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc035070 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.647+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeec1a0a50 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.648+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec103f70 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.650+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbedc042030 con 0x7fbeec1094a0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.651+0000 7fbee37fe640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbed80b65d0 0x7fbed80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.651+0000 7fbeea59c640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbed80b65d0 0x7fbed80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.651+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fbedc108040 con 0x7fbeec1094a0 2024-09-21T06:12:02.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.652+0000 7fbeea59c640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbed80b65d0 0x7fbed80b8ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009c20 tx=0x7fbed4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:02.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.654+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbedc0ce3e0 con 0x7fbeec1094a0 2024-09-21T06:12:02.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.883+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeec02e640 con 0x7fbeec1094a0 2024-09-21T06:12:02.885 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:02 smithi017 ceph-mon[31080]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:02.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.883+0000 7fbee37fe640 1 -- 172.21.15.17:0/2493351053 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11885 (secure 0 0 0) 0x7fbedc0d27c0 con 0x7fbeec1094a0 2024-09-21T06:12:02.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:02.886 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-21T06:11:01:721627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:11:01.413226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:12:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:12:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbed80b65d0 msgr2=0x7fbed80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbed80b65d0 0x7fbed80b8ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009c20 tx=0x7fbed4005f90 comp rx=0 tx=0).stop 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 msgr2=0x7fbeec19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec19a9d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbedc004770 tx=0x7fbedc004040 comp rx=0 tx=0).stop 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 shutdown_connections 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbed80b65d0 0x7fbed80b8ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbeec1094a0 0x7fbeec19a9d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbeec109df0 0x7fbeec19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 --2- 172.21.15.17:0/2493351053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeec103b60 0x7fbeec19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 >> 172.21.15.17:0/2493351053 conn(0x7fbeec07b850 msgr2=0x7fbeec1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 shutdown_connections 2024-09-21T06:12:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:02.886+0000 7fbef0b3a640 1 -- 172.21.15.17:0/2493351053 wait complete. 2024-09-21T06:12:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:02 smithi081 ceph-mon[33870]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:02 smithi089 ceph-mon[33879]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:03.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:04.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:03 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2493351053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:04.115 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:03 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2493351053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:04.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:03 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2493351053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.485+0000 7fd68a047640 1 -- 172.21.15.17:0/944824048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684103b60 msgr2=0x7fd684103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.485+0000 7fd68a047640 1 --2- 172.21.15.17:0/944824048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684103b60 0x7fd684103f70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd674009900 tx=0x7fd67402a410 comp rx=0 tx=0).stop 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.485+0000 7fd68a047640 1 -- 172.21.15.17:0/944824048 shutdown_connections 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.485+0000 7fd68a047640 1 --2- 172.21.15.17:0/944824048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd684109df0 0x7fd684110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.486+0000 7fd68a047640 1 --2- 172.21.15.17:0/944824048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6841094a0 0x7fd6841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.486+0000 7fd68a047640 1 --2- 172.21.15.17:0/944824048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684103b60 0x7fd684103f70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.486+0000 7fd68a047640 1 -- 172.21.15.17:0/944824048 >> 172.21.15.17:0/944824048 conn(0x7fd68407b850 msgr2=0x7fd68407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.486+0000 7fd68a047640 1 -- 172.21.15.17:0/944824048 shutdown_connections 2024-09-21T06:12:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.486+0000 7fd68a047640 1 -- 172.21.15.17:0/944824048 wait complete. 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.486+0000 7fd68a047640 1 Processor -- start 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 -- start start 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd684103b60 0x7fd68419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6841094a0 0x7fd68419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 0x7fd68419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd684113960 con 0x7fd684109df0 2024-09-21T06:12:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6841137e0 con 0x7fd684103b60 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd68a047640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd684113ae0 con 0x7fd6841094a0 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd683fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 0x7fd68419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd683fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 0x7fd68419fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53384/0 (socket says 172.21.15.17:53384) 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd683fff640 1 -- 172.21.15.17:0/3019807926 learned_addr learned my addr 172.21.15.17:0/3019807926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd6837fe640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd684103b60 0x7fd68419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.487+0000 7fd67affd640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6841094a0 0x7fd68419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd683fff640 1 -- 172.21.15.17:0/3019807926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6841094a0 msgr2=0x7fd68419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd683fff640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6841094a0 0x7fd68419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd683fff640 1 -- 172.21.15.17:0/3019807926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd684103b60 msgr2=0x7fd68419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd683fff640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd684103b60 0x7fd68419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd683fff640 1 -- 172.21.15.17:0/3019807926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6841a0320 con 0x7fd684109df0 2024-09-21T06:12:04.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd67affd640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6841094a0 0x7fd68419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd683fff640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 0x7fd68419fbf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00eb10 tx=0x7fd67c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c004b20 con 0x7fd684109df0 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6841a0610 con 0x7fd684109df0 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd67c004cc0 con 0x7fd684109df0 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c010690 con 0x7fd684109df0 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.488+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6841a6d70 con 0x7fd684109df0 2024-09-21T06:12:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.489+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd684103f70 con 0x7fd684109df0 2024-09-21T06:12:04.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.491+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd67c005020 con 0x7fd684109df0 2024-09-21T06:12:04.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.491+0000 7fd6817fa640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd6700b65a0 0x7fd6700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:04.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.492+0000 7fd6837fe640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd6700b65a0 0x7fd6700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:04.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.492+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd67c0e7e50 con 0x7fd684109df0 2024-09-21T06:12:04.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.492+0000 7fd6837fe640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd6700b65a0 0x7fd6700b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd6740057c0 tx=0x7fd6740058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:04.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.496+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd67c0ae1f0 con 0x7fd684109df0 2024-09-21T06:12:04.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.724+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd68410bbc0 con 0x7fd684109df0 2024-09-21T06:12:04.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.724+0000 7fd6817fa640 1 -- 172.21.15.17:0/3019807926 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11885 (secure 0 0 0) 0x7fd67c0b25d0 con 0x7fd684109df0 2024-09-21T06:12:04.726 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:04.726 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-21T06:11:01:721627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:11:01.413226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:12:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd6700b65a0 msgr2=0x7fd6700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd6700b65a0 0x7fd6700b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd6740057c0 tx=0x7fd6740058d0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 msgr2=0x7fd68419fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 0x7fd68419fbf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00eb10 tx=0x7fd67c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 shutdown_connections 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd6700b65a0 0x7fd6700b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd684109df0 0x7fd68419fbf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6841094a0 0x7fd68419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 --2- 172.21.15.17:0/3019807926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd684103b60 0x7fd68419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 >> 172.21.15.17:0/3019807926 conn(0x7fd68407b850 msgr2=0x7fd6841075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 shutdown_connections 2024-09-21T06:12:04.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:04.727+0000 7fd68a047640 1 -- 172.21.15.17:0/3019807926 wait complete. 2024-09-21T06:12:05.011 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:04 smithi081 ceph-mon[33870]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:04 smithi089 ceph-mon[33879]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:04 smithi017 ceph-mon[31080]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:12:05.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:12:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:05.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:05 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3019807926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:06.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:05 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3019807926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:06.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:05 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3019807926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 -- 172.21.15.17:0/6744893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a5010de50 msgr2=0x7f7a50110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 --2- 172.21.15.17:0/6744893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a5010de50 0x7f7a50110340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009ca0 tx=0x7f7a4802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 -- 172.21.15.17:0/6744893 shutdown_connections 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 --2- 172.21.15.17:0/6744893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a5010de50 0x7f7a50110340 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 --2- 172.21.15.17:0/6744893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a50105340 0x7f7a5010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 --2- 172.21.15.17:0/6744893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a501049f0 0x7f7a50104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.322+0000 7f7a55189640 1 -- 172.21.15.17:0/6744893 >> 172.21.15.17:0/6744893 conn(0x7f7a500797e0 msgr2=0x7f7a50079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.323+0000 7f7a55189640 1 -- 172.21.15.17:0/6744893 shutdown_connections 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.323+0000 7f7a55189640 1 -- 172.21.15.17:0/6744893 wait complete. 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 Processor -- start 2024-09-21T06:12:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 -- start start 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 0x7f7a5019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a50105340 0x7f7a5019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5010de50 0x7f7a5019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501139d0 con 0x7f7a501049f0 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50113850 con 0x7f7a5010de50 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a55189640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50113b50 con 0x7f7a50105340 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a4ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 0x7f7a5019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a4ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 0x7f7a5019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53402/0 (socket says 172.21.15.17:53402) 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.324+0000 7f7a4ed9d640 1 -- 172.21.15.17:0/3613309399 learned_addr learned my addr 172.21.15.17:0/3613309399 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4e59c640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a50105340 0x7f7a5019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4f59e640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5010de50 0x7f7a5019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4ed9d640 1 -- 172.21.15.17:0/3613309399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a50105340 msgr2=0x7f7a5019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4ed9d640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a50105340 0x7f7a5019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4ed9d640 1 -- 172.21.15.17:0/3613309399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5010de50 msgr2=0x7f7a5019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4ed9d640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5010de50 0x7f7a5019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4ed9d640 1 -- 172.21.15.17:0/3613309399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a501a0310 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a4ed9d640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 0x7f7a5019a3a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000e9c0 tx=0x7f7a4000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000cd80 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a400035f0 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a400044c0 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a501a0600 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.325+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a501a6d60 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.327+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a50104e00 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.328+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7a40004000 con 0x7f7a501049f0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.329+0000 7f7a37fff640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7a380b65a0 0x7f7a380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.329+0000 7f7a4e59c640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7a380b65a0 0x7f7a380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.329+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f7a400e7bb0 con 0x7f7a501049f0 2024-09-21T06:12:06.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.329+0000 7f7a4e59c640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7a380b65a0 0x7f7a380b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7a5010fad0 tx=0x7f7a4400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:06.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.334+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7a400adf50 con 0x7f7a501049f0 2024-09-21T06:12:06.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.526+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a5019b4d0 con 0x7f7a501049f0 2024-09-21T06:12:06.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.528+0000 7f7a37fff640 1 -- 172.21.15.17:0/3613309399 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24775 (secure 0 0 0) 0x7f7a400b2330 con 0x7f7a501049f0 2024-09-21T06:12:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:06.531 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:11:47.669754+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7a380b65a0 msgr2=0x7f7a380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7a380b65a0 0x7f7a380b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7a5010fad0 tx=0x7f7a4400b390 comp rx=0 tx=0).stop 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 msgr2=0x7f7a5019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 0x7f7a5019a3a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000e9c0 tx=0x7f7a4000ee80 comp rx=0 tx=0).stop 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 shutdown_connections 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7a380b65a0 0x7f7a380b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5010de50 0x7f7a5019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a50105340 0x7f7a5019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 --2- 172.21.15.17:0/3613309399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a501049f0 0x7f7a5019a3a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.531+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 >> 172.21.15.17:0/3613309399 conn(0x7f7a500797e0 msgr2=0x7f7a500ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.532+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 shutdown_connections 2024-09-21T06:12:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:06.532+0000 7f7a55189640 1 -- 172.21.15.17:0/3613309399 wait complete. 2024-09-21T06:12:06.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:06 smithi017 ceph-mon[31080]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:06.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:06 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3613309399' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:06 smithi081 ceph-mon[33870]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:06 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3613309399' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:06 smithi089 ceph-mon[33879]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:06 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3613309399' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:07.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:07.463 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:07.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 -- 172.21.15.17:0/2849379655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb01094d0 msgr2=0x7efdb01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:07.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 --2- 172.21.15.17:0/2849379655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb01094d0 0x7efdb01098e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efda4009900 tx=0x7efda402a410 comp rx=0 tx=0).stop 2024-09-21T06:12:07.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 -- 172.21.15.17:0/2849379655 shutdown_connections 2024-09-21T06:12:07.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 --2- 172.21.15.17:0/2849379655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb01094d0 0x7efdb01098e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:07.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 --2- 172.21.15.17:0/2849379655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb0109e20 0x7efdb0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 --2- 172.21.15.17:0/2849379655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb0103b90 0x7efdb0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 -- 172.21.15.17:0/2849379655 >> 172.21.15.17:0/2849379655 conn(0x7efdb00ff600 msgr2=0x7efdb0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 -- 172.21.15.17:0/2849379655 shutdown_connections 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.955+0000 7efdb82cf640 1 -- 172.21.15.17:0/2849379655 wait complete. 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 Processor -- start 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 -- start start 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb0103b90 0x7efdb019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb01094d0 0x7efdb019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 0x7efdb019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0113990 con 0x7efdb0109e20 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0113810 con 0x7efdb01094d0 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.956+0000 7efdb82cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0113b10 con 0x7efdb0103b90 2024-09-21T06:12:07.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 0x7efdb019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 0x7efdb019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53428/0 (socket says 172.21.15.17:53428) 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 -- 172.21.15.17:0/866336066 learned_addr learned my addr 172.21.15.17:0/866336066 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb606b640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb0103b90 0x7efdb019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb586a640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb01094d0 0x7efdb019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 -- 172.21.15.17:0/866336066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb0103b90 msgr2=0x7efdb019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb0103b90 0x7efdb019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 -- 172.21.15.17:0/866336066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb01094d0 msgr2=0x7efdb019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb01094d0 0x7efdb019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 -- 172.21.15.17:0/866336066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb01a0390 con 0x7efdb0109e20 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb586a640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb01094d0 0x7efdb019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb686c640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 0x7efdb019fc60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efda000cad0 tx=0x7efda000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda000ae20 con 0x7efdb0109e20 2024-09-21T06:12:07.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efda0005020 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb01a0680 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.957+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda000f6b0 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.958+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb01a6de0 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.958+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb0103fa0 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.960+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efda00051d0 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.961+0000 7efdaf7fe640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd980b65a0 0x7efd980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.961+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7efda00e7c00 con 0x7efdb0109e20 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.961+0000 7efdb606b640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd980b65a0 0x7efd980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.962+0000 7efdb606b640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd980b65a0 0x7efd980b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efda800bbe0 tx=0x7efda800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:07.964+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efda0014030 con 0x7efdb0109e20 2024-09-21T06:12:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.193+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdb019b550 con 0x7efdb0109e20 2024-09-21T06:12:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.194+0000 7efdaf7fe640 1 -- 172.21.15.17:0/866336066 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11885 (secure 0 0 0) 0x7efdb019b550 con 0x7efdb0109e20 2024-09-21T06:12:08.196 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:08.196 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-21T06:11:01:721627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:11:01.413226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:12:08.196 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:12:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd980b65a0 msgr2=0x7efd980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd980b65a0 0x7efd980b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efda800bbe0 tx=0x7efda800b390 comp rx=0 tx=0).stop 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 msgr2=0x7efdb019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 0x7efdb019fc60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efda000cad0 tx=0x7efda000cf90 comp rx=0 tx=0).stop 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 shutdown_connections 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efd980b65a0 0x7efd980b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdb0109e20 0x7efdb019fc60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb01094d0 0x7efdb019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 --2- 172.21.15.17:0/866336066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdb0103b90 0x7efdb019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 >> 172.21.15.17:0/866336066 conn(0x7efdb00ff600 msgr2=0x7efdb0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 shutdown_connections 2024-09-21T06:12:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:08.197+0000 7efdb82cf640 1 -- 172.21.15.17:0/866336066 wait complete. 2024-09-21T06:12:08.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:08 smithi017 ceph-mon[31080]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:08.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:08 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/866336066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:08 smithi081 ceph-mon[33870]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:08 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/866336066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:09.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:10:17.202602+0000', 'modified': '2024-09-21T06:11:01.413226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24656, 'mds_1': 24649, 'mds_2': 24631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/1978692137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1978692137}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1978692137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/3289455904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3289455904}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3289455904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.89:6835/1688371803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1688371803}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1688371803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.89:6837/857098251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 857098251}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 857098251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.89:6839/326704663', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6838', 'nonce': 326704663}, {'type': 'v1', 'addr': '172.21.15.89:6839', 'nonce': 326704663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6839/84773565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 84773565}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 84773565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24656, 'qdb_cluster': [24631, 24649, 24656]} 2024-09-21T06:12:09.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:12:09.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:12:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:08 smithi089 ceph-mon[33879]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:08 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/866336066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:09.322 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 -- 172.21.15.17:0/2412239556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c1083a0 msgr2=0x7fef3c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 --2- 172.21.15.17:0/2412239556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c1083a0 0x7fef3c1087b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fef30009900 tx=0x7fef3002a410 comp rx=0 tx=0).stop 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 -- 172.21.15.17:0/2412239556 shutdown_connections 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 --2- 172.21.15.17:0/2412239556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c1083a0 0x7fef3c1087b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 --2- 172.21.15.17:0/2412239556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef3c108cf0 0x7fef3c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 --2- 172.21.15.17:0/2412239556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3c102a60 0x7fef3c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 -- 172.21.15.17:0/2412239556 >> 172.21.15.17:0/2412239556 conn(0x7fef3c079730 msgr2=0x7fef3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 -- 172.21.15.17:0/2412239556 shutdown_connections 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.824+0000 7fef4231c640 1 -- 172.21.15.17:0/2412239556 wait complete. 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.825+0000 7fef4231c640 1 Processor -- start 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.825+0000 7fef4231c640 1 -- start start 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.825+0000 7fef4231c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3c102a60 0x7fef3c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.825+0000 7fef4231c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef3c1083a0 0x7fef3c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.825+0000 7fef4231c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 0x7fef3c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.825+0000 7fef4231c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c112810 con 0x7fef3c108cf0 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef4231c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c112690 con 0x7fef3c102a60 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef4231c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c112990 con 0x7fef3c1083a0 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 0x7fef3c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 0x7fef3c1000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49594/0 (socket says 172.21.15.17:49594) 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 -- 172.21.15.17:0/884276337 learned_addr learned my addr 172.21.15.17:0/884276337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef3c1083a0 0x7fef3c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef3bfff640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3c102a60 0x7fef3c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 -- 172.21.15.17:0/884276337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef3c1083a0 msgr2=0x7fef3c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef3c1083a0 0x7fef3c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 -- 172.21.15.17:0/884276337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3c102a60 msgr2=0x7fef3c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3c102a60 0x7fef3c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 -- 172.21.15.17:0/884276337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c1a86d0 con 0x7fef3c108cf0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef408b9640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 0x7fef3c1000f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fef3400eb10 tx=0x7fef3400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef397fa640 1 -- 172.21.15.17:0/884276337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34004b20 con 0x7fef3c108cf0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef397fa640 1 -- 172.21.15.17:0/884276337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef34004cc0 con 0x7fef3c108cf0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.826+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c1a89c0 con 0x7fef3c108cf0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.827+0000 7fef397fa640 1 -- 172.21.15.17:0/884276337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34010690 con 0x7fef3c108cf0 2024-09-21T06:12:09.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.827+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c1a8f20 con 0x7fef3c108cf0 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.829+0000 7fef48890740 1 Processor -- start 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.829+0000 7fef397fa640 1 -- 172.21.15.17:0/884276337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fef34005020 con 0x7fef3c108cf0 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.829+0000 7fef48890740 1 -- start start 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef48890740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef48890740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0e0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef48890740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef48890740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56320d057c10 con 0x56320cd39f60 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef48890740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56320d047040 con 0x56320cd19280 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef48890740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56320d04ae50 con 0x56320cd110a0 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0dff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49606/0 (socket says 172.21.15.17:49606) 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2592181108 learned_addr learned my addr 172.21.15.17:0/2592181108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3bfff640 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2592181108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 msgr2=0x56320d0e0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0e0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2592181108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 msgr2=0x56320d0e0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2592181108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56320cda5540 con 0x56320cd39f60 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef397fa640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef240b6620 0x7fef240b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0dff00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef30000c00 tx=0x7fef30005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59470949284aadec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.830+0000 7fef3bfff640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef240b6620 0x7fef240b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef227fc640 1 -- 172.21.15.17:0/2592181108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30035070 con 0x56320cd39f60 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef397fa640 1 -- 172.21.15.17:0/884276337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fef340e7cb0 con 0x7fef3c108cf0 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef227fc640 1 -- 172.21.15.17:0/2592181108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef300044c0 con 0x56320cd39f60 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef227fc640 1 -- 172.21.15.17:0/2592181108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30003b90 con 0x56320cd39f60 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef48890740 1 -- 172.21.15.17:0/2592181108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 msgr2=0x56320d0dff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef3bfff640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef240b6620 0x7fef240b8b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56320d0deb80 tx=0x7fef2c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.831+0000 7fef48890740 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0dff00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef30000c00 tx=0x7fef30005fd0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 -- 172.21.15.17:0/2592181108 shutdown_connections 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 --2- 172.21.15.17:0/2592181108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0dff00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 -- 172.21.15.17:0/2592181108 >> 172.21.15.17:0/2592181108 conn(0x56320cd2e350 msgr2=0x56320d0dddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 -- 172.21.15.17:0/2592181108 shutdown_connections 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 -- 172.21.15.17:0/2592181108 wait complete. 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 -- start start 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.832+0000 7fef48890740 1 Processor -- start 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0ec070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56320cea85f0 con 0x56320cd39f60 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56320cfe2010 con 0x56320cd19280 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56320d0ee680 con 0x56320cd110a0 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef48890740 10 client.0 _ll_register_callbacks cb 0x56320d041340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef3bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0f79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49618/0 (socket says 172.21.15.17:49618) 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 -- 172.21.15.17:0/3741270858 learned_addr learned my addr 172.21.15.17:0/3741270858 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 -- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 msgr2=0x56320d0ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0ebb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 -- 172.21.15.17:0/3741270858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 msgr2=0x56320d0ec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0ec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 -- 172.21.15.17:0/3741270858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56320d00fa00 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef408b9640 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0f79a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef340a9f20 tx=0x7fef340aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b625ec7e0efd9e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.833+0000 7fef1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef1b7fe640 1 -- 172.21.15.17:0/3741270858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340ad0c0 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef1b7fe640 1 -- 172.21.15.17:0/3741270858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fef340acbb0 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56320d059b60 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef1b7fe640 1 -- 172.21.15.17:0/3741270858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fef340ad460 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 10 client.15225 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56320d0fa6d0 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef1b7fe640 1 -- 172.21.15.17:0/3741270858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56320d059b60 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef1b7fe640 1 -- 172.21.15.17:0/3741270858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fef340ac620 con 0x56320cd39f60 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 10 client.15225 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 10 client.15225 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 20 client.15225 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:09.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320ccf88e0 0x56320d0fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 4 client.15225 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.834+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 --> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56320d055610 con 0x56320ccf88e0 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.835+0000 7fef3bfff640 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320ccf88e0 0x56320d0fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.835+0000 7fef3bfff640 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320ccf88e0 0x56320d0fe130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=237f8a8986c30ff5 server_cookie=9271b20c02fbfd3a in_seq=0 out_seq=0 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.835+0000 7fef1b7fe640 10 client.15225 ms_handle_connect on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.836+0000 7fef1b7fe640 1 -- 172.21.15.17:0/3741270858 <== mds.2 v2:172.21.15.89:6836/857098251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56320d055610 con 0x56320ccf88e0 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.836+0000 7fef1b7fe640 10 client.15225 handle_command_reply: tid=0 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.836+0000 7fef48890740 1 client.15225 shutdown 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 msgr2=0x56320d0f79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0f79a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef340a9f20 tx=0x7fef340aa070 comp rx=0 tx=0).stop 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 shutdown_connections 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320ccf88e0 0x56320d0fe130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd39f60 0x56320d0f79a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef1b7fe640 0 client.15225 ms_handle_reset on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 --2- 172.21.15.17:0/3741270858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320cd110a0 0x56320d0ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 >> 172.21.15.17:0/3741270858 conn(0x56320cd2e350 msgr2=0x56320d0e30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 shutdown_connections 2024-09-21T06:12:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 1 -- 172.21.15.17:0/3741270858 wait complete. 2024-09-21T06:12:09.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.837+0000 7fef48890740 20 client.15225 trim_cache size 0 max 16384 2024-09-21T06:12:09.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 Processor -- start 2024-09-21T06:12:09.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 -- start start 2024-09-21T06:12:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d0f7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 0x56320d0e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56320d0fc470 con 0x56320cd110a0 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56320d0fcb40 con 0x56320cd19280 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef48890740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56320d0fd210 con 0x56320ccf88e0 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 0x56320d0e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d0f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 0x56320d0e6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49632/0 (socket says 172.21.15.17:49632) 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2218642310 learned_addr learned my addr 172.21.15.17:0/2218642310 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef408b9640 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2218642310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 msgr2=0x56320d0f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d0f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2218642310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 msgr2=0x56320d0e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef3b7fe640 1 -- 172.21.15.17:0/2218642310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56320d0e2790 con 0x56320cd110a0 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.856+0000 7fef408b9640 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.857+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 0x56320d0e6a70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fef300057c0 tx=0x7fef30003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ec4d0499b8eb6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.857+0000 7fef21ffb640 1 -- 172.21.15.17:0/2218642310 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3004d020 con 0x56320cd110a0 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.857+0000 7fef21ffb640 1 -- 172.21.15.17:0/2218642310 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef3003b460 con 0x56320cd110a0 2024-09-21T06:12:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.857+0000 7fef21ffb640 1 -- 172.21.15.17:0/2218642310 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30035040 con 0x56320cd110a0 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 -- 172.21.15.17:0/2218642310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 msgr2=0x56320d0e6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 0x56320d0e6a70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fef300057c0 tx=0x7fef30003780 comp rx=0 tx=0).stop 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 -- 172.21.15.17:0/2218642310 shutdown_connections 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd110a0 0x56320d0e6a70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd19280 0x56320d0e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 --2- 172.21.15.17:0/2218642310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d0f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 -- 172.21.15.17:0/2218642310 >> 172.21.15.17:0/2218642310 conn(0x56320cd2e350 msgr2=0x56320d0ebb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 -- 172.21.15.17:0/2218642310 shutdown_connections 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 -- 172.21.15.17:0/2218642310 wait complete. 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.858+0000 7fef48890740 1 -- start start 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 Processor -- start 2024-09-21T06:12:09.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d1069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd110a0 0x56320d0ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 0x56320d100430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56320d0fdfb0 con 0x56320cd19280 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56320d0fd8e0 con 0x56320cd110a0 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56320d0fe680 con 0x56320ccf88e0 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef48890740 10 client.0 _ll_register_callbacks cb 0x7fef340a9fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 0x56320d100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 0x56320d100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49634/0 (socket says 172.21.15.17:49634) 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 -- 172.21.15.17:0/2819527878 learned_addr learned my addr 172.21.15.17:0/2819527878 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd110a0 0x56320d0ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef3bfff640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d1069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 -- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 msgr2=0x56320d1069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d1069a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 -- 172.21.15.17:0/2819527878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd110a0 msgr2=0x56320d0ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd110a0 0x56320d0ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef408b9640 1 -- 172.21.15.17:0/2819527878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56320d1009a0 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.859+0000 7fef3b7fe640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd110a0 0x56320d0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef408b9640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 0x56320d100430 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fef340049d0 tx=0x7fef340b2300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df454e43012de86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef1b7fe640 1 -- 172.21.15.17:0/2819527878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340ad0c0 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef1b7fe640 1 -- 172.21.15.17:0/2819527878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fef340c3b00 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef3003b460 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef1b7fe640 1 -- 172.21.15.17:0/2819527878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fef340ad720 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef48890740 10 client.15231 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56320d106350 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef1b7fe640 1 -- 172.21.15.17:0/2819527878 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef3003b460 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef1b7fe640 1 -- 172.21.15.17:0/2819527878 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fef340b68b0 con 0x56320cd19280 2024-09-21T06:12:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef48890740 10 client.15231 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef48890740 10 client.15231 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.860+0000 7fef48890740 20 client.15231 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef48890740 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320cd39f60 0x56320d16ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef48890740 4 client.15231 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 --> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] -- command(tid 0: {"prefix": "status"}) -- 0x56320d052a40 con 0x56320cd39f60 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef3bfff640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320cd39f60 0x56320d16ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef3bfff640 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320cd39f60 0x56320d16ccb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44a2fa273d1f9146 server_cookie=dbe42fcd54723e2 in_seq=0 out_seq=0 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef1b7fe640 10 client.15231 ms_handle_connect on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef1b7fe640 1 -- 172.21.15.17:0/2819527878 <== mds.2 v2:172.21.15.89:6836/857098251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56320d052a40 con 0x56320cd39f60 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.861+0000 7fef1b7fe640 10 client.15231 handle_command_reply: tid=0 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 client.15231 shutdown 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 msgr2=0x56320d100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 0x56320d100430 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fef340049d0 tx=0x7fef340b2300 comp rx=0 tx=0).stop 2024-09-21T06:12:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 shutdown_connections 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x56320cd39f60 0x56320d16ccb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56320cd19280 0x56320d100430 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56320cd110a0 0x56320d0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 --2- 172.21.15.17:0/2819527878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56320ccf88e0 0x56320d1069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 >> 172.21.15.17:0/2819527878 conn(0x56320cd2e350 msgr2=0x56320d0e5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef1b7fe640 0 client.15231 ms_handle_reset on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 shutdown_connections 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 1 -- 172.21.15.17:0/2819527878 wait complete. 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef48890740 20 client.15231 trim_cache size 0 max 16384 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:09.868 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24631, 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 71.143824778999999, 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 25, 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 137.43365953 2024-09-21T06:12:09.869 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef240b6620 msgr2=0x7fef240b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.862+0000 7fef4231c640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef240b6620 0x7fef240b8b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x56320d0deb80 tx=0x7fef2c00b410 comp rx=0 tx=0).stop 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 msgr2=0x7fef3c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 0x7fef3c1000f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fef3400eb10 tx=0x7fef3400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 shutdown_connections 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fef240b6620 0x7fef240b8b30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef3c108cf0 0x7fef3c1000f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef3c1083a0 0x7fef3c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 --2- 172.21.15.17:0/884276337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3c102a60 0x7fef3c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 >> 172.21.15.17:0/884276337 conn(0x7fef3c079730 msgr2=0x7fef3c06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 shutdown_connections 2024-09-21T06:12:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:09.863+0000 7fef4231c640 1 -- 172.21.15.17:0/884276337 wait complete. 2024-09-21T06:12:10.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:12:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:10 smithi081 ceph-mon[33870]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:11.025 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:10 smithi089 ceph-mon[33879]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:10 smithi017 ceph-mon[31080]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 -- 172.21.15.17:0/2615478011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90102ae0 msgr2=0x7fac90102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 --2- 172.21.15.17:0/2615478011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90102ae0 0x7fac90102ef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac80009900 tx=0x7fac8002a410 comp rx=0 tx=0).stop 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 -- 172.21.15.17:0/2615478011 shutdown_connections 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 --2- 172.21.15.17:0/2615478011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac90108d20 0x7fac9010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 --2- 172.21.15.17:0/2615478011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 0x7fac901087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 --2- 172.21.15.17:0/2615478011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90102ae0 0x7fac90102ef0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 -- 172.21.15.17:0/2615478011 >> 172.21.15.17:0/2615478011 conn(0x7fac90079790 msgr2=0x7fac90079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 -- 172.21.15.17:0/2615478011 shutdown_connections 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 -- 172.21.15.17:0/2615478011 wait complete. 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.518+0000 7fac95f90640 1 Processor -- start 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 -- start start 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac90102ae0 0x7fac9019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 0x7fac9019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 0x7fac9019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac90112890 con 0x7fac90108d20 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac90112710 con 0x7fac90102ae0 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac95f90640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac90112a10 con 0x7fac901083d0 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 0x7fac9019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 0x7fac9019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49664/0 (socket says 172.21.15.17:49664) 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 -- 172.21.15.17:0/1373587316 learned_addr learned my addr 172.21.15.17:0/1373587316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac90102ae0 0x7fac9019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac87fff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 0x7fac9019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 -- 172.21.15.17:0/1373587316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 msgr2=0x7fac9019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 0x7fac9019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 -- 172.21.15.17:0/1373587316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac90102ae0 msgr2=0x7fac9019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac90102ae0 0x7fac9019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 -- 172.21.15.17:0/1373587316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac901a0380 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac87fff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 0x7fac9019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.519+0000 7fac8ffff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 0x7fac9019fd10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac8800eaa0 tx=0x7fac8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.520+0000 7fac8d7fa640 1 -- 172.21.15.17:0/1373587316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8800cdb0 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.520+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac901a0670 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.520+0000 7fac8d7fa640 1 -- 172.21.15.17:0/1373587316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac88005020 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.520+0000 7fac8d7fa640 1 -- 172.21.15.17:0/1373587316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac880116d0 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.520+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac901a6e90 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.522+0000 7fac9c504740 1 Processor -- start 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.522+0000 7fac8d7fa640 1 -- 172.21.15.17:0/1373587316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fac880051d0 con 0x7fac90108d20 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.522+0000 7fac9c504740 1 -- start start 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac9c504740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c47f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac9c504740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158790a0 0x55ad15c48440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac9c504740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad15881280 0x55ad15c48980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac9c504740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ad15bbfc10 con 0x55ad158a1f60 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac9c504740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad15baf040 con 0x55ad15881280 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac9c504740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ad15bb2e50 con 0x55ad158790a0 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c47f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c47f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49678/0 (socket says 172.21.15.17:49678) 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 -- 172.21.15.17:0/446825078 learned_addr learned my addr 172.21.15.17:0/446825078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158790a0 0x55ad15c48440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad15881280 0x55ad15c48980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 -- 172.21.15.17:0/446825078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158790a0 msgr2=0x55ad15c48440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158790a0 0x55ad15c48440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 -- 172.21.15.17:0/446825078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad15881280 msgr2=0x55ad15c48980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac8d7fa640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac7c0b6650 0x7fac7c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad15881280 0x55ad15c48980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.523+0000 7fac87fff640 1 -- 172.21.15.17:0/446825078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad1590d540 con 0x55ad158a1f60 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.524+0000 7fac8ffff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac7c0b6650 0x7fac7c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.524+0000 7fac87fff640 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c47f00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fac780124e0 tx=0x7fac780085e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597d89581b935f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.524+0000 7fac8d7fa640 1 -- 172.21.15.17:0/1373587316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fac880e7940 con 0x7fac90108d20 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.524+0000 7fac85ffb640 1 -- 172.21.15.17:0/446825078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78018030 con 0x55ad158a1f60 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.524+0000 7fac85ffb640 1 -- 172.21.15.17:0/446825078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac780054b0 con 0x55ad158a1f60 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.524+0000 7fac85ffb640 1 -- 172.21.15.17:0/446825078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78010640 con 0x55ad158a1f60 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 -- 172.21.15.17:0/446825078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 msgr2=0x55ad15c47f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac8ffff640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac7c0b6650 0x7fac7c0b8b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fac880ad570 tx=0x7fac88071bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c47f00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fac780124e0 tx=0x7fac780085e0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 -- 172.21.15.17:0/446825078 shutdown_connections 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad15881280 0x55ad15c48980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158790a0 0x55ad15c48440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 --2- 172.21.15.17:0/446825078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c47f00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 -- 172.21.15.17:0/446825078 >> 172.21.15.17:0/446825078 conn(0x55ad15896350 msgr2=0x55ad15c45df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 -- 172.21.15.17:0/446825078 shutdown_connections 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 -- 172.21.15.17:0/446825078 wait complete. 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 -- start start 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.525+0000 7fac9c504740 1 Processor -- start 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c53760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 0x55ad15c53d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158a1f60 0x55ad15c5f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ad15a105f0 con 0x55ad15881280 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad15b4a010 con 0x55ad158790a0 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c566e0 con 0x55ad158a1f60 2024-09-21T06:12:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac9c504740 10 client.0 _ll_register_callbacks cb 0x55ad15ba9340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 0x55ad15c53d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 0x55ad15c53d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49694/0 (socket says 172.21.15.17:49694) 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 -- 172.21.15.17:0/438390892 learned_addr learned my addr 172.21.15.17:0/438390892 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac87fff640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac87fff640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158a1f60 0x55ad15c5f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 -- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158a1f60 msgr2=0x55ad15c5f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158a1f60 0x55ad15c5f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 -- 172.21.15.17:0/438390892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 msgr2=0x55ad15c53760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c53760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 -- 172.21.15.17:0/438390892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad15b77a00 con 0x55ad15881280 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 0x55ad15c53d40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fac8002a930 tx=0x7fac80031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc08662ba6b8dac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.526+0000 7fac6effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac6effd640 1 -- 172.21.15.17:0/438390892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80035040 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac6effd640 1 -- 172.21.15.17:0/438390892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fac80004250 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac780054b0 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac6effd640 1 -- 172.21.15.17:0/438390892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac8004e050 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 10 client.15243 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad15c625a0 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac6effd640 1 -- 172.21.15.17:0/438390892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac780054b0 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac6effd640 1 -- 172.21.15.17:0/438390892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fac8003c4d0 con 0x55ad15881280 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 10 client.15243 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 10 client.15243 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 20 client.15243 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad158608e0 0x55ad15c66060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 4 client.15243 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.527+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 --> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad15bc1b60 con 0x55ad158608e0 2024-09-21T06:12:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.528+0000 7fac87fff640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad158608e0 0x55ad15c66060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.528+0000 7fac87fff640 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad158608e0 0x55ad15c66060 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee3167a3a2546639 server_cookie=dba84e1c1ea29b8b in_seq=0 out_seq=0 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.528+0000 7fac6effd640 10 client.15243 ms_handle_connect on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac6effd640 1 -- 172.21.15.17:0/438390892 <== mds.1 v2:172.21.15.89:6838/326704663 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad15bc1b60 con 0x55ad158608e0 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac6effd640 10 client.15243 handle_command_reply: tid=0 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 client.15243 shutdown 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 msgr2=0x55ad15c53d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 0x55ad15c53d40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fac8002a930 tx=0x7fac80031630 comp rx=0 tx=0).stop 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 shutdown_connections 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad158608e0 0x55ad15c66060 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad15881280 0x55ad15c53d40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad158a1f60 0x55ad15c5f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac6effd640 0 client.15243 ms_handle_reset on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 --2- 172.21.15.17:0/438390892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c53760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 >> 172.21.15.17:0/438390892 conn(0x55ad15896350 msgr2=0x55ad15c4b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 shutdown_connections 2024-09-21T06:12:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.529+0000 7fac9c504740 1 -- 172.21.15.17:0/438390892 wait complete. 2024-09-21T06:12:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.530+0000 7fac9c504740 20 client.15243 trim_cache size 0 max 16384 2024-09-21T06:12:11.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 Processor -- start 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 -- start start 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c40ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c5f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c5fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c643a0 con 0x55ad158a1f60 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c64a70 con 0x55ad158790a0 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac9c504740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c65140 con 0x55ad15881280 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c5fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c5fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49698/0 (socket says 172.21.15.17:49698) 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac87fff640 1 -- 172.21.15.17:0/1424632243 learned_addr learned my addr 172.21.15.17:0/1424632243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac87fff640 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c40ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.548+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c5f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac87fff640 1 -- 172.21.15.17:0/1424632243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 msgr2=0x55ad15c5f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac87fff640 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c5f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac87fff640 1 -- 172.21.15.17:0/1424632243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 msgr2=0x55ad15c40ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac87fff640 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c40ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac87fff640 1 -- 172.21.15.17:0/1424632243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad15c54450 con 0x55ad158a1f60 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac87fff640 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c5fe80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fac780047a0 tx=0x7fac78012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc0da79dd8bf77d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac857fa640 1 -- 172.21.15.17:0/1424632243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78018040 con 0x55ad158a1f60 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac857fa640 1 -- 172.21.15.17:0/1424632243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac78019040 con 0x55ad158a1f60 2024-09-21T06:12:11.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.549+0000 7fac857fa640 1 -- 172.21.15.17:0/1424632243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7801d5e0 con 0x55ad158a1f60 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 -- 172.21.15.17:0/1424632243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 msgr2=0x55ad15c5fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c5fe80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fac780047a0 tx=0x7fac78012f60 comp rx=0 tx=0).stop 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 -- 172.21.15.17:0/1424632243 shutdown_connections 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158a1f60 0x55ad15c5fe80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c5f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 --2- 172.21.15.17:0/1424632243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158790a0 0x55ad15c40ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 -- 172.21.15.17:0/1424632243 >> 172.21.15.17:0/1424632243 conn(0x55ad15896350 msgr2=0x55ad15c4e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 -- 172.21.15.17:0/1424632243 shutdown_connections 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 -- 172.21.15.17:0/1424632243 wait complete. 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.550+0000 7fac9c504740 1 -- start start 2024-09-21T06:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 Processor -- start 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 0x55ad15c6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c6ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158a1f60 0x55ad15c68c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c65ee0 con 0x55ad158790a0 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c65810 con 0x55ad158a1f60 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ad15c665b0 con 0x55ad15881280 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac9c504740 10 client.0 _ll_register_callbacks cb 0x7fac80031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 0x55ad15c6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 0x55ad15c6e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49712/0 (socket says 172.21.15.17:49712) 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 -- 172.21.15.17:0/3633994638 learned_addr learned my addr 172.21.15.17:0/3633994638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c6ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 -- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 msgr2=0x55ad15c6ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c6ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 -- 172.21.15.17:0/3633994638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158a1f60 msgr2=0x55ad15c68c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158a1f60 0x55ad15c68c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.551+0000 7fac87fff640 1 -- 172.21.15.17:0/3633994638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad15c69370 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac87fff640 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 0x55ad15c6e660 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fac78008470 tx=0x7fac780085b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d489e3c87f6edbf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac6effd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac6effd640 1 -- 172.21.15.17:0/3633994638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78018040 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac6effd640 1 -- 172.21.15.17:0/3633994638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fac78010b90 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac78019040 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac6effd640 1 -- 172.21.15.17:0/3633994638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac78049050 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac9c504740 10 client.15249 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad15cd1fd0 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac6effd640 1 -- 172.21.15.17:0/3633994638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac78019040 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac6effd640 1 -- 172.21.15.17:0/3633994638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fac78034070 con 0x55ad158790a0 2024-09-21T06:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac9c504740 10 client.15249 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.552+0000 7fac9c504740 10 client.15249 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac9c504740 20 client.15249 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac9c504740 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad15835c90 0x55ad15cd51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac9c504740 4 client.15249 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 --> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] -- command(tid 0: {"prefix": "status"}) -- 0x55ad15bbd610 con 0x55ad15835c90 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad15835c90 0x55ad15cd51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac8f7fe640 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad15835c90 0x55ad15cd51d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dbe09d9cff985869 server_cookie=d614aa37751706a0 in_seq=0 out_seq=0 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac6effd640 10 client.15249 ms_handle_connect on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac6effd640 1 -- 172.21.15.17:0/3633994638 <== mds.1 v2:172.21.15.89:6838/326704663 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ad15bbd610 con 0x55ad15835c90 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac6effd640 10 client.15249 handle_command_reply: tid=0 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.553+0000 7fac9c504740 1 client.15249 shutdown 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 msgr2=0x55ad15c6e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 0x55ad15c6e660 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fac78008470 tx=0x7fac780085b0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 shutdown_connections 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55ad15835c90 0x55ad15cd51d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad158a1f60 0x55ad15c68c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ad15881280 0x55ad15c6ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 --2- 172.21.15.17:0/3633994638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad158790a0 0x55ad15c6e660 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac6effd640 0 client.15249 ms_handle_reset on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 >> 172.21.15.17:0/3633994638 conn(0x55ad15896350 msgr2=0x55ad15c4e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 shutdown_connections 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 1 -- 172.21.15.17:0/3633994638 wait complete. 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac9c504740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T06:12:11.560 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24649, 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 73.844454963999993, 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 25, 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 133.817207881 2024-09-21T06:12:11.561 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.554+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac7c0b6650 msgr2=0x7fac7c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac7c0b6650 0x7fac7c0b8b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fac880ad570 tx=0x7fac88071bc0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 msgr2=0x7fac9019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 0x7fac9019fd10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac8800eaa0 tx=0x7fac8800ef60 comp rx=0 tx=0).stop 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 shutdown_connections 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac7c0b6650 0x7fac7c0b8b60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac90108d20 0x7fac9019fd10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac901083d0 0x7fac9019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 --2- 172.21.15.17:0/1373587316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac90102ae0 0x7fac9019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:11.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 >> 172.21.15.17:0/1373587316 conn(0x7fac90079790 msgr2=0x7fac90101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:11.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 shutdown_connections 2024-09-21T06:12:11.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:11.555+0000 7fac95f90640 1 -- 172.21.15.17:0/1373587316 wait complete. 2024-09-21T06:12:12.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:12:12.758 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:13.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:12 smithi081 ceph-mon[33870]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:12:13.012 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:12 smithi017 ceph-mon[31080]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:12:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:12 smithi089 ceph-mon[33879]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 -- 172.21.15.17:0/3706686778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac681083a0 msgr2=0x7fac681087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 --2- 172.21.15.17:0/3706686778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac681083a0 0x7fac681087b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fac58009900 tx=0x7fac5802a410 comp rx=0 tx=0).stop 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 -- 172.21.15.17:0/3706686778 shutdown_connections 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 --2- 172.21.15.17:0/3706686778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac681083a0 0x7fac681087b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 --2- 172.21.15.17:0/3706686778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac68108cf0 0x7fac6810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 --2- 172.21.15.17:0/3706686778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac68102a60 0x7fac68102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 -- 172.21.15.17:0/3706686778 >> 172.21.15.17:0/3706686778 conn(0x7fac68079730 msgr2=0x7fac68079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 -- 172.21.15.17:0/3706686778 shutdown_connections 2024-09-21T06:12:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.236+0000 7fac6fac9640 1 -- 172.21.15.17:0/3706686778 wait complete. 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 Processor -- start 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 -- start start 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac68102a60 0x7fac6819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac681083a0 0x7fac6819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 0x7fac681a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac68112810 con 0x7fac68108cf0 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac68112690 con 0x7fac68102a60 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6fac9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fac68112990 con 0x7fac681083a0 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.237+0000 7fac6e066640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 0x7fac681a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 0x7fac681a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49732/0 (socket says 172.21.15.17:49732) 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 -- 172.21.15.17:0/4161616991 learned_addr learned my addr 172.21.15.17:0/4161616991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6d865640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac68102a60 0x7fac6819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6d064640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac681083a0 0x7fac6819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 -- 172.21.15.17:0/4161616991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac681083a0 msgr2=0x7fac6819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac681083a0 0x7fac6819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 -- 172.21.15.17:0/4161616991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac68102a60 msgr2=0x7fac6819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac68102a60 0x7fac6819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 -- 172.21.15.17:0/4161616991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac681a24c0 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6d064640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac681083a0 0x7fac6819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6e066640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 0x7fac681a1d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fac6000eaa0 tx=0x7fac6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac5effd640 1 -- 172.21.15.17:0/4161616991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6000cdb0 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac681a27b0 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac5effd640 1 -- 172.21.15.17:0/4161616991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac60005020 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac5effd640 1 -- 172.21.15.17:0/4161616991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600116d0 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.238+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac681a8f10 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.241+0000 7fac5effd640 1 -- 172.21.15.17:0/4161616991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fac60004a40 con 0x7fac68108cf0 2024-09-21T06:12:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.241+0000 7fac7603d740 1 Processor -- start 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.241+0000 7fac7603d740 1 -- start start 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac7603d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b930f60 0x55fc6bcd6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac7603d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcd7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac7603d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 0x55fc6bcd7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac7603d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bc4ec10 con 0x55fc6b910280 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac7603d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bc3e040 con 0x55fc6b930f60 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac7603d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bc41e50 con 0x55fc6b9080a0 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 0x55fc6bcd7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 0x55fc6bcd7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49740/0 (socket says 172.21.15.17:49740) 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 -- 172.21.15.17:0/3773565958 learned_addr learned my addr 172.21.15.17:0/3773565958 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d865640 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcd7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b930f60 0x55fc6bcd6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac5effd640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac540b65a0 0x7fac540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 -- 172.21.15.17:0/3773565958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 msgr2=0x55fc6bcd7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcd7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 -- 172.21.15.17:0/3773565958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b930f60 msgr2=0x55fc6bcd6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b930f60 0x55fc6bcd6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6e066640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac540b65a0 0x7fac540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac6d064640 1 -- 172.21.15.17:0/3773565958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6b99c540 con 0x55fc6b910280 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.242+0000 7fac5effd640 1 -- 172.21.15.17:0/4161616991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fac600e7a00 con 0x7fac68108cf0 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.243+0000 7fac6d064640 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 0x55fc6bcd7980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac58032f30 tx=0x7fac58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d2bd672fda85bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.243+0000 7fac53fff640 1 -- 172.21.15.17:0/3773565958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58035040 con 0x55fc6b910280 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.243+0000 7fac53fff640 1 -- 172.21.15.17:0/3773565958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac580044c0 con 0x55fc6b910280 2024-09-21T06:12:13.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.243+0000 7fac53fff640 1 -- 172.21.15.17:0/3773565958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58003ce0 con 0x55fc6b910280 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 -- 172.21.15.17:0/3773565958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 msgr2=0x55fc6bcd7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 0x55fc6bcd7980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac58032f30 tx=0x7fac58000bc0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac6e066640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac540b65a0 0x7fac540b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fac600ad3a0 tx=0x7fac600a3040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 -- 172.21.15.17:0/3773565958 shutdown_connections 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b910280 0x55fc6bcd7980 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcd7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 --2- 172.21.15.17:0/3773565958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b930f60 0x55fc6bcd6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 -- 172.21.15.17:0/3773565958 >> 172.21.15.17:0/3773565958 conn(0x55fc6b925350 msgr2=0x55fc6bcd4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 -- 172.21.15.17:0/3773565958 shutdown_connections 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 -- 172.21.15.17:0/3773565958 wait complete. 2024-09-21T06:12:13.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 -- start start 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.244+0000 7fac7603d740 1 Processor -- start 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bce2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bce2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 0x55fc6bcee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fc6ba9f5f0 con 0x55fc6b930f60 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bbd9010 con 0x55fc6b910280 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bce5680 con 0x55fc6b9080a0 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac7603d740 10 client.0 _ll_register_callbacks cb 0x55fc6bc38340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d064640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 0x55fc6bcee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d064640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 0x55fc6bcee9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49750/0 (socket says 172.21.15.17:49750) 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d064640 1 -- 172.21.15.17:0/2544165527 learned_addr learned my addr 172.21.15.17:0/2544165527 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d865640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bce2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d064640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bce2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d064640 1 -- 172.21.15.17:0/2544165527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 msgr2=0x55fc6bce2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.245+0000 7fac6d064640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bce2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac6d064640 1 -- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 msgr2=0x55fc6bce2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac6d064640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bce2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac6d064640 1 -- 172.21.15.17:0/2544165527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6bc06a00 con 0x55fc6b930f60 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac6d064640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 0x55fc6bcee9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55fc6bce5080 tx=0x7fac580038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf5c8363a80d61f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac517fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac517fa640 1 -- 172.21.15.17:0/2544165527 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58052060 con 0x55fc6b930f60 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc6bc50b60 con 0x55fc6b930f60 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac517fa640 1 -- 172.21.15.17:0/2544165527 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fac58005250 con 0x55fc6b930f60 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac517fa640 1 -- 172.21.15.17:0/2544165527 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac58059050 con 0x55fc6b930f60 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac7603d740 10 client.15261 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fc6bcf1640 con 0x55fc6b930f60 2024-09-21T06:12:13.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.246+0000 7fac517fa640 1 -- 172.21.15.17:0/2544165527 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fc6bc50b60 con 0x55fc6b930f60 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac517fa640 1 -- 172.21.15.17:0/2544165527 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fac5803a040 con 0x55fc6b930f60 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac7603d740 10 client.15261 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac7603d740 10 client.15261 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac7603d740 20 client.15261 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac7603d740 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b8ef8e0 0x55fc6bcf2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac7603d740 4 client.15261 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc6bc4c610 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac6d865640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b8ef8e0 0x55fc6bcf2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac6d865640 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b8ef8e0 0x55fc6bcf2990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23cd4dd6682da9e1 server_cookie=48e28203fa02f284 in_seq=0 out_seq=0 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.247+0000 7fac517fa640 10 client.15261 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac517fa640 1 -- 172.21.15.17:0/2544165527 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc6bc4c610 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac517fa640 10 client.15261 handle_command_reply: tid=0 2024-09-21T06:12:13.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 client.15261 shutdown 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 msgr2=0x55fc6bcee9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 0x55fc6bcee9a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55fc6bce5080 tx=0x7fac580038c0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 shutdown_connections 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b8ef8e0 0x55fc6bcf2990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b930f60 0x55fc6bcee9a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac517fa640 0 client.15261 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bce2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 --2- 172.21.15.17:0/2544165527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bce2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.248+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 >> 172.21.15.17:0/2544165527 conn(0x55fc6b925350 msgr2=0x55fc6bcda090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.249+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 shutdown_connections 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.249+0000 7fac7603d740 1 -- 172.21.15.17:0/2544165527 wait complete. 2024-09-21T06:12:13.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.249+0000 7fac7603d740 20 client.15261 trim_cache size 0 max 16384 2024-09-21T06:12:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 Processor -- start 2024-09-21T06:12:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 -- start start 2024-09-21T06:12:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcdcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 0x55fc6bce4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcf2ee0 con 0x55fc6b9080a0 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcf35b0 con 0x55fc6b910280 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac7603d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcf3c80 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac6d865640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 0x55fc6bce4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac6d865640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 0x55fc6bce4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49762/0 (socket says 172.21.15.17:49762) 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac6d865640 1 -- 172.21.15.17:0/3175325182 learned_addr learned my addr 172.21.15.17:0/3175325182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac6d064640 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcdcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.267+0000 7fac6d064640 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d865640 1 -- 172.21.15.17:0/3175325182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b8ef8e0 msgr2=0x55fc6bcdcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d865640 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcdcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d865640 1 -- 172.21.15.17:0/3175325182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 msgr2=0x55fc6bcee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d865640 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d865640 1 -- 172.21.15.17:0/3175325182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6bce3af0 con 0x55fc6b9080a0 2024-09-21T06:12:13.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d064640 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcdcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac6d865640 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 0x55fc6bce4460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fac64000c00 tx=0x7fac640119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f110caafc6967049 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac537fe640 1 -- 172.21.15.17:0/3175325182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac640042f0 con 0x55fc6b9080a0 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac537fe640 1 -- 172.21.15.17:0/3175325182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac64004490 con 0x55fc6b9080a0 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.268+0000 7fac537fe640 1 -- 172.21.15.17:0/3175325182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64010980 con 0x55fc6b9080a0 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 -- 172.21.15.17:0/3175325182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 msgr2=0x55fc6bce4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 0x55fc6bce4460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fac64000c00 tx=0x7fac640119d0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 -- 172.21.15.17:0/3175325182 shutdown_connections 2024-09-21T06:12:13.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b9080a0 0x55fc6bce4460 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 --2- 172.21.15.17:0/3175325182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcdcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 -- 172.21.15.17:0/3175325182 >> 172.21.15.17:0/3175325182 conn(0x55fc6b925350 msgr2=0x55fc6bce3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 -- 172.21.15.17:0/3175325182 shutdown_connections 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.269+0000 7fac7603d740 1 -- 172.21.15.17:0/3175325182 wait complete. 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 -- start start 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 Processor -- start 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcfd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcf6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcf7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcf4a20 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcf4350 con 0x55fc6b910280 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fc6bcf50f0 con 0x55fc6b9080a0 2024-09-21T06:12:13.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.270+0000 7fac7603d740 10 client.0 _ll_register_callbacks cb 0x7fac58032c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcfd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcfd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49776/0 (socket says 172.21.15.17:49776) 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 -- 172.21.15.17:0/3619542009 learned_addr learned my addr 172.21.15.17:0/3619542009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcf7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d865640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcf6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 -- 172.21.15.17:0/3619542009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 msgr2=0x55fc6bcf6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcf6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 -- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 msgr2=0x55fc6bcf7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcf7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 -- 172.21.15.17:0/3619542009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6bcfc3e0 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d865640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcf6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac6d064640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcfd7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac580057c0 tx=0x7fac580038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d721cf3e7f559f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac517fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:13.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac517fa640 1 -- 172.21.15.17:0/3619542009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58052070 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac517fa640 1 -- 172.21.15.17:0/3619542009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fac580319c0 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.271+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac64004490 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac517fa640 1 -- 172.21.15.17:0/3619542009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac5806d050 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 10 client.15267 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:13.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fc6bd60130 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac517fa640 1 -- 172.21.15.17:0/3619542009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac64004490 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac517fa640 1 -- 172.21.15.17:0/3619542009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fac5803a040 con 0x55fc6b8ef8e0 2024-09-21T06:12:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 10 client.15267 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 20 client.15267 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b930f60 0x55fc6bd63930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 4 client.15267 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.272+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "status"}) -- 0x55fc6bc49a40 con 0x55fc6b930f60 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac6d865640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b930f60 0x55fc6bd63930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac6d865640 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b930f60 0x55fc6bd63930 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd52c965b7008af0 server_cookie=20b8b6dbfaf7d2cf in_seq=0 out_seq=0 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac517fa640 10 client.15267 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac517fa640 1 -- 172.21.15.17:0/3619542009 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7fac64015160 con 0x55fc6b930f60 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac517fa640 10 client.15267 handle_command_reply: tid=0 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac7603d740 1 client.15267 shutdown 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 msgr2=0x55fc6bcfd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.273+0000 7fac7603d740 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcfd7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac580057c0 tx=0x7fac580038c0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 shutdown_connections 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc6b930f60 0x55fc6bd63930 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc6b910280 0x55fc6bcf7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc6b9080a0 0x55fc6bcf6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 --2- 172.21.15.17:0/3619542009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc6b8ef8e0 0x55fc6bcfd7a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac517fa640 0 client.15267 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 >> 172.21.15.17:0/3619542009 conn(0x55fc6b925350 msgr2=0x55fc6bcd4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 shutdown_connections 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 1 -- 172.21.15.17:0/3619542009 wait complete. 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac7603d740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:13.279 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24656, 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 115.72796150000001, 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 25, 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 126.49405341400001 2024-09-21T06:12:13.280 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac540b65a0 msgr2=0x7fac540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac6fac9640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac540b65a0 0x7fac540b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fac600ad3a0 tx=0x7fac600a3040 comp rx=0 tx=0).stop 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 msgr2=0x7fac681a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.274+0000 7fac6fac9640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 0x7fac681a1d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fac6000eaa0 tx=0x7fac6000ef60 comp rx=0 tx=0).stop 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 shutdown_connections 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fac540b65a0 0x7fac540b8ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac68108cf0 0x7fac681a1d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac681083a0 0x7fac6819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 --2- 172.21.15.17:0/4161616991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac68102a60 0x7fac6819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 >> 172.21.15.17:0/4161616991 conn(0x7fac68079730 msgr2=0x7fac6806b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 shutdown_connections 2024-09-21T06:12:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:13.275+0000 7fac6fac9640 1 -- 172.21.15.17:0/4161616991 wait complete. 2024-09-21T06:12:14.135 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T06:12:14.135 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:12:14.146 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T06:12:14.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T06:12:14.408 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:14.796 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:14 smithi017 ceph-mon[31080]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:12:14.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 -- 172.21.15.17:0/2394645943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 msgr2=0x7f1ad4104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:14.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 --2- 172.21.15.17:0/2394645943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4104bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009900 tx=0x7f1ac802a480 comp rx=0 tx=0).stop 2024-09-21T06:12:14.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 -- 172.21.15.17:0/2394645943 shutdown_connections 2024-09-21T06:12:14.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 --2- 172.21.15.17:0/2394645943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4104bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:14.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 --2- 172.21.15.17:0/2394645943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4105180 0x7f1ad410bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 --2- 172.21.15.17:0/2394645943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4103750 0x7f1ad4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 -- 172.21.15.17:0/2394645943 >> 172.21.15.17:0/2394645943 conn(0x7f1ad40ff0c0 msgr2=0x7f1ad4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 -- 172.21.15.17:0/2394645943 shutdown_connections 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.887+0000 7f1ad9783640 1 -- 172.21.15.17:0/2394645943 wait complete. 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 Processor -- start 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 -- start start 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4103750 0x7f1ad4076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4105180 0x7f1ad4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad410f250 con 0x7f1ad41047e0 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad410f0d0 con 0x7f1ad4103750 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.888+0000 7f1ad9783640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad410f3d0 con 0x7f1ad4105180 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:14.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49796/0 (socket says 172.21.15.17:49796) 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 -- 172.21.15.17:0/459258748 learned_addr learned my addr 172.21.15.17:0/459258748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad2ffd640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4103750 0x7f1ad4076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad37fe640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4105180 0x7f1ad4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 -- 172.21.15.17:0/459258748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4105180 msgr2=0x7f1ad4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4105180 0x7f1ad4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 -- 172.21.15.17:0/459258748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4103750 msgr2=0x7f1ad4076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4103750 0x7f1ad4076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 -- 172.21.15.17:0/459258748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad4076350 con 0x7f1ad41047e0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad27fc640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4075710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009230 tx=0x7f1ac80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac803f030 con 0x7f1ad41047e0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad41a3fa0 con 0x7f1ad41047e0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ac8003c90 con 0x7f1ad41047e0 2024-09-21T06:12:14.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8035070 con 0x7f1ad41047e0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.889+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad41a4340 con 0x7f1ad41047e0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.890+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad410a930 con 0x7f1ad41047e0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.892+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1ac8042030 con 0x7f1ad41047e0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.893+0000 7f1abbfff640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1abc0b65a0 0x7f1abc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.893+0000 7f1ad2ffd640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1abc0b65a0 0x7f1abc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.893+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f1ac8108280 con 0x7f1ad41047e0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.893+0000 7f1ad2ffd640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1abc0b65a0 0x7f1abc0b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40058c0 tx=0x7f1ac400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:14.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:14.897+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ac80ce620 con 0x7f1ad41047e0 2024-09-21T06:12:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:14 smithi081 ceph-mon[33870]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:12:15.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.102+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1ad4063800 con 0x7f1abc0b65a0 2024-09-21T06:12:15.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.103+0000 7f1abbfff640 1 -- 172.21.15.17:0/459258748 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1ad4063800 con 0x7f1abc0b65a0 2024-09-21T06:12:15.105 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-09-21T06:12:15.105 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-09-21T06:12:15.105 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-09-21T06:12:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1abc0b65a0 msgr2=0x7f1abc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1abc0b65a0 0x7f1abc0b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40058c0 tx=0x7f1ac400a250 comp rx=0 tx=0).stop 2024-09-21T06:12:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 msgr2=0x7f1ad4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4075710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009230 tx=0x7f1ac80042f0 comp rx=0 tx=0).stop 2024-09-21T06:12:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 shutdown_connections 2024-09-21T06:12:15.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1abc0b65a0 0x7f1abc0b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad41047e0 0x7f1ad4075710 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad4105180 0x7f1ad4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.106+0000 7f1ad9783640 1 --2- 172.21.15.17:0/459258748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad4103750 0x7f1ad4076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.107+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 >> 172.21.15.17:0/459258748 conn(0x7f1ad40ff0c0 msgr2=0x7f1ad4107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.107+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 shutdown_connections 2024-09-21T06:12:15.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:15.107+0000 7f1ad9783640 1 -- 172.21.15.17:0/459258748 wait complete. 2024-09-21T06:12:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:14 smithi089 ceph-mon[33879]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:12:15.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T06:12:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 -- 172.21.15.17:0/3061998872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c109470 msgr2=0x7fdb2c10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/3061998872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c109470 0x7fdb2c10b980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009ca0 tx=0x7fdb2402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 -- 172.21.15.17:0/3061998872 shutdown_connections 2024-09-21T06:12:16.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/3061998872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c109470 0x7fdb2c10b980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/3061998872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 0x7fdb2c108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/3061998872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c06b980 0x7fdb2c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 -- 172.21.15.17:0/3061998872 >> 172.21.15.17:0/3061998872 conn(0x7fdb2c0fdfb0 msgr2=0x7fdb2c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:16.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 -- 172.21.15.17:0/3061998872 shutdown_connections 2024-09-21T06:12:16.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.651+0000 7fdb31fb6640 1 -- 172.21.15.17:0/3061998872 wait complete. 2024-09-21T06:12:16.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.652+0000 7fdb31fb6640 1 Processor -- start 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.652+0000 7fdb31fb6640 1 -- start start 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.652+0000 7fdb31fb6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 0x7fdb2c19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.652+0000 7fdb31fb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 0x7fdb2c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.652+0000 7fdb31fb6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c109470 0x7fdb2c19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.652+0000 7fdb31fb6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10f290 con 0x7fdb2c06b980 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb31fb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10f110 con 0x7fdb2c1068d0 2024-09-21T06:12:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb31fb6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10f410 con 0x7fdb2c109470 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 0x7fdb2c19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 0x7fdb2c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 0x7fdb2c19c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49812/0 (socket says 172.21.15.17:49812) 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 -- 172.21.15.17:0/367486949 learned_addr learned my addr 172.21.15.17:0/367486949 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2bfff640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c109470 0x7fdb2c19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 -- 172.21.15.17:0/367486949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c109470 msgr2=0x7fdb2c19d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:16.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c109470 0x7fdb2c19d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 -- 172.21.15.17:0/367486949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 msgr2=0x7fdb2c19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 0x7fdb2c19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 -- 172.21.15.17:0/367486949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c19dab0 con 0x7fdb2c06b980 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2bfff640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c109470 0x7fdb2c19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2affd640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 0x7fdb2c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb2b7fe640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 0x7fdb2c19c080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00e9f0 tx=0x7fdb1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c00cd80 con 0x7fdb2c06b980 2024-09-21T06:12:16.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c19dda0 con 0x7fdb2c06b980 2024-09-21T06:12:16.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb1c0054b0 con 0x7fdb2c06b980 2024-09-21T06:12:16.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.653+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c010430 con 0x7fdb2c06b980 2024-09-21T06:12:16.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.654+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c1a44a0 con 0x7fdb2c06b980 2024-09-21T06:12:16.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.655+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c1a4670 con 0x7fdb2c06b980 2024-09-21T06:12:16.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.657+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdb1c0046c0 con 0x7fdb2c06b980 2024-09-21T06:12:16.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.657+0000 7fdb28ff9640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdb140b65a0 0x7fdb140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:16.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.657+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fdb1c0e7e00 con 0x7fdb2c06b980 2024-09-21T06:12:16.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.657+0000 7fdb2affd640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdb140b65a0 0x7fdb140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:16.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.658+0000 7fdb2affd640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdb140b65a0 0x7fdb140b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb20005d00 tx=0x7fdb2000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:16.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.661+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb1c0ae1a0 con 0x7fdb2c06b980 2024-09-21T06:12:16.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.881+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdb2c10b310 con 0x7fdb140b65a0 2024-09-21T06:12:16.883 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:16 smithi017 ceph-mon[31080]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:16.883 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:16 smithi017 ceph-mon[31080]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:16.883 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:16 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.893+0000 7fdb28ff9640 1 -- 172.21.15.17:0/367486949 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fdb2c10b310 con 0x7fdb140b65a0 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (2m) 61s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 9e67ea141299 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi081 running (2m) 62s ago 2m 96.1M - 19.3.0-5120-g18432218 ddce307e1f32 680df7297782 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi089 running (2m) 62s ago 2m 85.2M - 19.3.0-5120-g18432218 ddce307e1f32 41bf22f8a639 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (2m) 61s ago 2m 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 4e44f0cdd5d8 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi081 running (2m) 62s ago 2m 83.0M - 19.3.0-5120-g18432218 ddce307e1f32 97a6e2837c71 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi089 running (2m) 62s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 c689eb1a1d81 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (2m) 61s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 12434fbd55d0 2024-09-21T06:12:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi081 running (2m) 62s ago 2m 84.0M - 19.3.0-5120-g18432218 ddce307e1f32 f5ebbcbbbbec 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi089 running (2m) 62s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 7ce077b0c2eb 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (2m) 61s ago 2m 82.6M - 19.3.0-5120-g18432218 ddce307e1f32 da7564de0be7 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi081 running (2m) 62s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 d6924a8e2637 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi089 running (2m) 62s ago 2m 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 f4960c5001de 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (10m) 61s ago 10m 590M - 19.3.0-5120-g18432218 ddce307e1f32 f112c35d4efb 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi081 *:8443,8765 running (8m) 62s ago 8m 526M - 19.3.0-5120-g18432218 ddce307e1f32 ec8a87428cd0 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi089 *:8443,8765 running (8m) 62s ago 8m 526M - 19.3.0-5120-g18432218 ddce307e1f32 b145c045349a 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (10m) 61s ago 10m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 82321d5f106e 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi081 running (8m) 62s ago 8m 113M 2048M 19.3.0-5120-g18432218 ddce307e1f32 12b0bdb4e821 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi089 running (8m) 62s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 1ccfa4ff6ac2 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 61s ago 7m 112M 4273M 19.3.0-5120-g18432218 ddce307e1f32 b541b6a5905d 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi081 running (7m) 62s ago 7m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dc3a5ad952ef 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi089 running (6m) 62s ago 6m 116M 4271M 19.3.0-5120-g18432218 ddce307e1f32 b287bca3fef2 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (6m) 61s ago 6m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 051b6271b488 2024-09-21T06:12:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi081 running (6m) 62s ago 6m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2b445c0d3112 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi089 running (5m) 62s ago 5m 112M 4271M 19.3.0-5120-g18432218 ddce307e1f32 7009066fd8c4 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (5m) 61s ago 5m 119M 4273M 19.3.0-5120-g18432218 ddce307e1f32 b2f897a88a13 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi081 running (4m) 62s ago 4m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d0dc9dee8cd6 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi089 running (4m) 62s ago 4m 111M 4271M 19.3.0-5120-g18432218 ddce307e1f32 448f3d942e6a 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 61s ago 3m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 718ba0251aae 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi081 running (3m) 62s ago 3m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 5099d99d369f 2024-09-21T06:12:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi089 running (3m) 62s ago 3m 120M 4271M 19.3.0-5120-g18432218 ddce307e1f32 d377361e8c20 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdb140b65a0 msgr2=0x7fdb140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdb140b65a0 0x7fdb140b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb20005d00 tx=0x7fdb2000b410 comp rx=0 tx=0).stop 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 msgr2=0x7fdb2c19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 0x7fdb2c19c080 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00e9f0 tx=0x7fdb1c00edf0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 shutdown_connections 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdb140b65a0 0x7fdb140b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb2c109470 0x7fdb2c19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb2c1068d0 0x7fdb2c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 --2- 172.21.15.17:0/367486949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c06b980 0x7fdb2c19c080 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 >> 172.21.15.17:0/367486949 conn(0x7fdb2c0fdfb0 msgr2=0x7fdb2c1003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 shutdown_connections 2024-09-21T06:12:16.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:16.896+0000 7fdb31fb6640 1 -- 172.21.15.17:0/367486949 wait complete. 2024-09-21T06:12:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:16 smithi081 ceph-mon[33870]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:16 smithi081 ceph-mon[33870]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:17.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:16 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:17.103 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:16 smithi089 ceph-mon[33879]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:17.103 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:16 smithi089 ceph-mon[33879]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:17.103 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:16 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:18.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T06:12:18.641 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:19.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:18 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.087 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:19.087 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:19.087 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T06:12:19.087 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:18 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:18 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 -- 172.21.15.17:0/4050334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff08406c600 msgr2=0x7ff084106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 --2- 172.21.15.17:0/4050334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff08406c600 0x7ff084106420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff074009900 tx=0x7ff07402a410 comp rx=0 tx=0).stop 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 -- 172.21.15.17:0/4050334325 shutdown_connections 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 --2- 172.21.15.17:0/4050334325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0841094a0 0x7ff08410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 --2- 172.21.15.17:0/4050334325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff084106960 0x7ff084108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 --2- 172.21.15.17:0/4050334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff08406c600 0x7ff084106420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 -- 172.21.15.17:0/4050334325 >> 172.21.15.17:0/4050334325 conn(0x7ff0840fdfe0 msgr2=0x7ff084100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 -- 172.21.15.17:0/4050334325 shutdown_connections 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.181+0000 7ff089e72640 1 -- 172.21.15.17:0/4050334325 wait complete. 2024-09-21T06:12:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.182+0000 7ff089e72640 1 Processor -- start 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.182+0000 7ff089e72640 1 -- start start 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff089e72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406c600 0x7ff084199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff089e72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff084106960 0x7ff08419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff089e72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 0x7ff08419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff089e72640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410f230 con 0x7ff0841094a0 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff089e72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410f0b0 con 0x7ff084106960 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff089e72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410f3b0 con 0x7ff08406c600 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 0x7ff08419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff0837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406c600 0x7ff084199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 0x7ff08419b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36974/0 (socket says 172.21.15.17:36974) 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 -- 172.21.15.17:0/2850932468 learned_addr learned my addr 172.21.15.17:0/2850932468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff082ffd640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff084106960 0x7ff08419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 -- 172.21.15.17:0/2850932468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406c600 msgr2=0x7ff084199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406c600 0x7ff084199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 -- 172.21.15.17:0/2850932468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff084106960 msgr2=0x7ff08419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff084106960 0x7ff08419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.183+0000 7ff083fff640 1 -- 172.21.15.17:0/2850932468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08419b910 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.184+0000 7ff083fff640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 0x7ff08419b0f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00eaa0 tx=0x7ff07c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.184+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00cdb0 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.184+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff07c005020 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.184+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08419bc00 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.184+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0116d0 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.184+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0841a2300 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.185+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0840ffb00 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.187+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff07c0051d0 con 0x7ff0841094a0 2024-09-21T06:12:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.188+0000 7ff080ff9640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff06c0b6590 0x7ff06c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.188+0000 7ff0837fe640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff06c0b6590 0x7ff06c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.188+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff07c0e7ba0 con 0x7ff0841094a0 2024-09-21T06:12:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.189+0000 7ff0837fe640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff06c0b6590 0x7ff06c0b8aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0740057c0 tx=0x7ff074000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.191+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff07c016030 con 0x7ff0841094a0 2024-09-21T06:12:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.388+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff084063800 con 0x7ff06c0b6590 2024-09-21T06:12:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.394+0000 7ff080ff9640 1 -- 172.21.15.17:0/2850932468 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff084063800 con 0x7ff06c0b6590 2024-09-21T06:12:19.395 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T06:12:19.395 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 1s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi081=b;smithi081=e;smithi081=h;smithi081=k;smithi089=c;smithi089=f;smithi089=i;smithi089=l;count:12 2024-09-21T06:12:19.396 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 1s ago 8m smithi017=x;smithi081=y;smithi089=z;count:3 2024-09-21T06:12:19.396 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 1s ago 9m smithi017:172.21.15.17=a;smithi081:172.21.15.81=b;smithi089:172.21.15.89=c;count:3 2024-09-21T06:12:19.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 1s ago - 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff06c0b6590 msgr2=0x7ff06c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff06c0b6590 0x7ff06c0b8aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff0740057c0 tx=0x7ff074000bc0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 msgr2=0x7ff08419b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 0x7ff08419b0f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00eaa0 tx=0x7ff07c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 shutdown_connections 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff06c0b6590 0x7ff06c0b8aa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841094a0 0x7ff08419b0f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff084106960 0x7ff08419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 --2- 172.21.15.17:0/2850932468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406c600 0x7ff084199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 >> 172.21.15.17:0/2850932468 conn(0x7ff0840fdfe0 msgr2=0x7ff084104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 shutdown_connections 2024-09-21T06:12:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:19.396+0000 7ff089e72640 1 -- 172.21.15.17:0/2850932468 wait complete. 2024-09-21T06:12:20.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:20.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:20.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:20.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:20.025 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:20.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T06:12:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:12:20.314 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 -- 172.21.15.17:0/4021237431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6800102640 msgr2=0x7f6800102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 --2- 172.21.15.17:0/4021237431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6800102640 0x7f6800102ab0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009900 tx=0x7f67f002a480 comp rx=0 tx=0).stop 2024-09-21T06:12:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 -- 172.21.15.17:0/4021237431 shutdown_connections 2024-09-21T06:12:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 --2- 172.21.15.17:0/4021237431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6800104070 0x7f680010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 --2- 172.21.15.17:0/4021237431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001036d0 0x7f6800103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 --2- 172.21.15.17:0/4021237431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6800102640 0x7f6800102ab0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 -- 172.21.15.17:0/4021237431 >> 172.21.15.17:0/4021237431 conn(0x7f68000fdfb0 msgr2=0x7f6800100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 -- 172.21.15.17:0/4021237431 shutdown_connections 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.846+0000 7f6804b26640 1 -- 172.21.15.17:0/4021237431 wait complete. 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 Processor -- start 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 -- start start 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800102640 0x7f6800198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 0x7f6800199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6800104070 0x7f6800199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f680010e130 con 0x7f68001036d0 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f680010dfb0 con 0x7f6800102640 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.847+0000 7f6804b26640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f680010e2b0 con 0x7f6800104070 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 0x7f6800199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 0x7f6800199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37004/0 (socket says 172.21.15.17:37004) 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 -- 172.21.15.17:0/1349994380 learned_addr learned my addr 172.21.15.17:0/1349994380 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67fe59c640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800102640 0x7f6800198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67fed9d640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6800104070 0x7f6800199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 -- 172.21.15.17:0/1349994380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6800104070 msgr2=0x7f6800199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6800104070 0x7f6800199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 -- 172.21.15.17:0/1349994380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800102640 msgr2=0x7f6800198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800102640 0x7f6800198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 -- 172.21.15.17:0/1349994380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680019a7d0 con 0x7f68001036d0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67fe59c640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800102640 0x7f6800198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f5d9b640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 0x7f6800199480 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009fd0 tx=0x7f67e800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e801e070 con 0x7f68001036d0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67e800cd80 con 0x7f68001036d0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e80197c0 con 0x7f68001036d0 2024-09-21T06:12:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.848+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680019aac0 con 0x7f68001036d0 2024-09-21T06:12:20.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.849+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680006b030 con 0x7f68001036d0 2024-09-21T06:12:20.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.850+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680019ad20 con 0x7f68001036d0 2024-09-21T06:12:20.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.852+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f67e8021070 con 0x7f68001036d0 2024-09-21T06:12:20.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.853+0000 7f67f7fff640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67ec0b6510 0x7f67ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:20.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.853+0000 7f67fe59c640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67ec0b6510 0x7f67ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:20.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.853+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f67e80e9490 con 0x7f68001036d0 2024-09-21T06:12:20.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.854+0000 7f67fe59c640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67ec0b6510 0x7f67ec0b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f67f0000c00 tx=0x7f67f0031420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:20.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:20.856+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67e80b3d70 con 0x7f68001036d0 2024-09-21T06:12:21.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:20 smithi081 ceph-mon[33870]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:21.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:20 smithi081 ceph-mon[33870]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:21.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.050+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f68001093a0 con 0x7f67ec0b6510 2024-09-21T06:12:21.052 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:20 smithi017 ceph-mon[31080]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:21.052 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:20 smithi017 ceph-mon[31080]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.052+0000 7f67f7fff640 1 -- 172.21.15.17:0/1349994380 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f68001093a0 con 0x7f67ec0b6510 2024-09-21T06:12:21.054 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-09-21T06:12:21.054 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-09-21T06:12:21.054 INFO:teuthology.orchestra.run.smithi017.stdout:smithi081 172.21.15.81 2024-09-21T06:12:21.054 INFO:teuthology.orchestra.run.smithi017.stdout:smithi089 172.21.15.89 2024-09-21T06:12:21.054 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2024-09-21T06:12:21.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67ec0b6510 msgr2=0x7f67ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:21.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67ec0b6510 0x7f67ec0b8a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f67f0000c00 tx=0x7f67f0031420 comp rx=0 tx=0).stop 2024-09-21T06:12:21.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 msgr2=0x7f6800199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 0x7f6800199480 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009fd0 tx=0x7f67e800edd0 comp rx=0 tx=0).stop 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 shutdown_connections 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f67ec0b6510 0x7f67ec0b8a20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68001036d0 0x7f6800199480 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6800104070 0x7f6800199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 --2- 172.21.15.17:0/1349994380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800102640 0x7f6800198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 >> 172.21.15.17:0/1349994380 conn(0x7f68000fdfb0 msgr2=0x7f68001069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 shutdown_connections 2024-09-21T06:12:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:21.055+0000 7f6804b26640 1 -- 172.21.15.17:0/1349994380 wait complete. 2024-09-21T06:12:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:20 smithi089 ceph-mon[33879]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:20 smithi089 ceph-mon[33879]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:21.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T06:12:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:22.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 -- 172.21.15.17:0/253033219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c1068d0 msgr2=0x7f3e8c108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:22.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 --2- 172.21.15.17:0/253033219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c1068d0 0x7f3e8c108d30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009900 tx=0x7f3e8802a410 comp rx=0 tx=0).stop 2024-09-21T06:12:22.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 -- 172.21.15.17:0/253033219 shutdown_connections 2024-09-21T06:12:22.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 --2- 172.21.15.17:0/253033219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c1068d0 0x7f3e8c108d30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 --2- 172.21.15.17:0/253033219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e8c109470 0x7f3e8c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 --2- 172.21.15.17:0/253033219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e8c06b980 0x7f3e8c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 -- 172.21.15.17:0/253033219 >> 172.21.15.17:0/253033219 conn(0x7f3e8c0fdfb0 msgr2=0x7f3e8c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 -- 172.21.15.17:0/253033219 shutdown_connections 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.615+0000 7f3e933af640 1 -- 172.21.15.17:0/253033219 wait complete. 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 Processor -- start 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 -- start start 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e8c06b980 0x7f3e8c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e8c1068d0 0x7f3e8c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 0x7f3e8c19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c10f230 con 0x7f3e8c109470 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c10f0b0 con 0x7f3e8c06b980 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e933af640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c10f3b0 con 0x7f3e8c1068d0 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e9194c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 0x7f3e8c19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e9194c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 0x7f3e8c19b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37022/0 (socket says 172.21.15.17:37022) 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e9194c640 1 -- 172.21.15.17:0/837662287 learned_addr learned my addr 172.21.15.17:0/837662287 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.616+0000 7f3e9094a640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e8c1068d0 0x7f3e8c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9114b640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e8c06b980 0x7f3e8c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9194c640 1 -- 172.21.15.17:0/837662287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e8c1068d0 msgr2=0x7f3e8c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9194c640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e8c1068d0 0x7f3e8c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9194c640 1 -- 172.21.15.17:0/837662287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e8c06b980 msgr2=0x7f3e8c199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9194c640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e8c06b980 0x7f3e8c199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9194c640 1 -- 172.21.15.17:0/837662287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c19b8e0 con 0x7f3e8c109470 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e9194c640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 0x7f3e8c19b0c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009fd0 tx=0x7f3e8400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:22.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84017070 con 0x7f3e8c109470 2024-09-21T06:12:22.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e84003e00 con 0x7f3e8c109470 2024-09-21T06:12:22.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c19bbd0 con 0x7f3e8c109470 2024-09-21T06:12:22.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84010460 con 0x7f3e8c109470 2024-09-21T06:12:22.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.617+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c1a22d0 con 0x7f3e8c109470 2024-09-21T06:12:22.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.618+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c106d20 con 0x7f3e8c109470 2024-09-21T06:12:22.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.620+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3e84003970 con 0x7f3e8c109470 2024-09-21T06:12:22.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.621+0000 7f3e7e7fc640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e780b6510 0x7f3e780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:22.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.621+0000 7f3e9114b640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e780b6510 0x7f3e780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:22.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.622+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f3e840e7740 con 0x7f3e8c109470 2024-09-21T06:12:22.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.622+0000 7f3e9114b640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e780b6510 0x7f3e780b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009bd0 tx=0x7f3e80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:22.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.625+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e840b2020 con 0x7f3e8c109470 2024-09-21T06:12:22.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.823+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3e8c063800 con 0x7f3e780b6510 2024-09-21T06:12:22.824 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:22 smithi017 ceph-mon[31080]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:22.825 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:22 smithi017 ceph-mon[31080]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:22.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.824+0000 7f3e7e7fc640 1 -- 172.21.15.17:0/837662287 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f3e8c063800 con 0x7f3e780b6510 2024-09-21T06:12:22.826 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T06:12:22.826 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T06:12:22.826 INFO:teuthology.orchestra.run.smithi017.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T06:12:22.826 INFO:teuthology.orchestra.run.smithi017.stdout:smithi089 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040126400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:12:22.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e780b6510 msgr2=0x7f3e780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e780b6510 0x7f3e780b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009bd0 tx=0x7f3e80005f90 comp rx=0 tx=0).stop 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 msgr2=0x7f3e8c19b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 0x7f3e8c19b0c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009fd0 tx=0x7f3e8400b260 comp rx=0 tx=0).stop 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 shutdown_connections 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3e780b6510 0x7f3e780b8a20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e8c109470 0x7f3e8c19b0c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e8c1068d0 0x7f3e8c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 --2- 172.21.15.17:0/837662287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e8c06b980 0x7f3e8c199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 >> 172.21.15.17:0/837662287 conn(0x7f3e8c0fdfb0 msgr2=0x7f3e8c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 shutdown_connections 2024-09-21T06:12:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:22.827+0000 7f3e933af640 1 -- 172.21.15.17:0/837662287 wait complete. 2024-09-21T06:12:23.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:22 smithi081 ceph-mon[33870]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:23.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:22 smithi081 ceph-mon[33870]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:22 smithi089 ceph-mon[33879]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:22 smithi089 ceph-mon[33879]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:23.515 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:12:23.527 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T06:12:23.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T06:12:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:24.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:23 smithi089 ceph-mon[33879]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:24.134 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:23 smithi017 ceph-mon[31080]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:24.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:23 smithi081 ceph-mon[33870]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 -- 172.21.15.17:0/1960419229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e20102670 msgr2=0x7f1e20102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1960419229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e20102670 0x7f1e20102ae0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009900 tx=0x7f1e1002a480 comp rx=0 tx=0).stop 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 -- 172.21.15.17:0/1960419229 shutdown_connections 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1960419229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e201040a0 0x7f1e2010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1960419229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e20103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1960419229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e20102670 0x7f1e20102ae0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.370+0000 7f1e24d53640 1 -- 172.21.15.17:0/1960419229 >> 172.21.15.17:0/1960419229 conn(0x7f1e200fdfe0 msgr2=0x7f1e20100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.371+0000 7f1e24d53640 1 -- 172.21.15.17:0/1960419229 shutdown_connections 2024-09-21T06:12:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.371+0000 7f1e24d53640 1 -- 172.21.15.17:0/1960419229 wait complete. 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.371+0000 7f1e24d53640 1 Processor -- start 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 -- start start 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 0x7f1e20199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e2019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e201040a0 0x7f1e2019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010e160 con 0x7f1e201040a0 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010dfe0 con 0x7f1e20103700 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e24d53640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2010e2e0 con 0x7f1e20102670 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 0x7f1e20199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e201040a0 0x7f1e2019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e15d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e2019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 0x7f1e20199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:56644/0 (socket says 172.21.15.17:56644) 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 -- 172.21.15.17:0/1834434402 learned_addr learned my addr 172.21.15.17:0/1834434402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e15d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e2019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:57166/0 (socket says 172.21.15.17:57166) 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e201040a0 0x7f1e2019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37040/0 (socket says 172.21.15.17:37040) 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 -- 172.21.15.17:0/1834434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 msgr2=0x7f1e2019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e2019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 -- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e201040a0 msgr2=0x7f1e2019b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.372+0000 7f1e1e59c640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e201040a0 0x7f1e2019b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e1e59c640 1 -- 172.21.15.17:0/1834434402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2019b960 con 0x7f1e20102670 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e15d9b640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e2019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e1e59c640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 0x7f1e20199f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009230 tx=0x7f1e100042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1003f030 con 0x7f1e20102670 2024-09-21T06:12:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2019bbf0 con 0x7f1e20102670 2024-09-21T06:12:24.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e10003c90 con 0x7f1e20102670 2024-09-21T06:12:24.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e10035070 con 0x7f1e20102670 2024-09-21T06:12:24.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.373+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e201a2180 con 0x7f1e20102670 2024-09-21T06:12:24.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.374+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e201a23e0 con 0x7f1e20102670 2024-09-21T06:12:24.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.376+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1e10042030 con 0x7f1e20102670 2024-09-21T06:12:24.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.377+0000 7f1e17fff640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1e0c0b6510 0x7f1e0c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:24.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.377+0000 7f1e15d9b640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1e0c0b6510 0x7f1e0c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:24.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.377+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f1e10108070 con 0x7f1e20102670 2024-09-21T06:12:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.377+0000 7f1e15d9b640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1e0c0b6510 0x7f1e0c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800bfd0 tx=0x7f1e0800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.380+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e100d28f0 con 0x7f1e20102670 2024-09-21T06:12:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.608+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1e201a25b0 con 0x7f1e20102670 2024-09-21T06:12:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.608+0000 7f1e17fff640 1 -- 172.21.15.17:0/1834434402 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3070 (secure 0 0 0) 0x7f1e100efe20 con 0x7f1e20102670 2024-09-21T06:12:24.610 INFO:teuthology.orchestra.run.smithi017.stdout:e25 2024-09-21T06:12:24.610 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-21T06:11:01:721627+0000 2024-09-21T06:12:24.610 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 25 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-21T06:10:17.202602+0000 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-21T06:11:01.413226+0000 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-21T06:12:24.611 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 3 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24656,1=24649,2=24631} 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-21T06:12:24.612 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3,4] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 24656 members: 24631,24649,24656 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{0:24656} state up:active seq 4 addr [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{0:24625} state up:standby-replay seq 1 addr [v2:172.21.15.89:6834/1688371803,v1:172.21.15.89:6835/1688371803] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{1:24649} state up:active seq 16 addr [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{1:24623} state up:standby-replay seq 1 addr [v2:172.21.15.81:6836/3289455904,v1:172.21.15.81:6837/3289455904] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{2:24631} state up:active seq 18 addr [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{2:24602} state up:standby-replay seq 1 addr [v2:172.21.15.81:6834/1978692137,v1:172.21.15.81:6835/1978692137] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:24.613 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:14688} state up:standby seq 1 addr [v2:172.21.15.17:6834/426359055,v1:172.21.15.17:6835/426359055] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{-1:14700} state up:standby seq 1 addr [v2:172.21.15.17:6836/154694548,v1:172.21.15.17:6837/154694548] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{-1:14754} state up:standby seq 1 addr [v2:172.21.15.17:6838/4125758530,v1:172.21.15.17:6839/4125758530] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{-1:14766} state up:standby seq 1 addr [v2:172.21.15.17:6840/3494298881,v1:172.21.15.17:6841/3494298881] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{-1:24569} state up:standby seq 1 addr [v2:172.21.15.81:6832/4192055797,v1:172.21.15.81:6833/4192055797] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.614 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{-1:24592} state up:standby seq 1 addr [v2:172.21.15.89:6832/838110195,v1:172.21.15.89:6833/838110195] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1e0c0b6510 msgr2=0x7f1e0c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1e0c0b6510 0x7f1e0c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800bfd0 tx=0x7f1e0800b390 comp rx=0 tx=0).stop 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 msgr2=0x7f1e20199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 0x7f1e20199f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009230 tx=0x7f1e100042f0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 shutdown_connections 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1e0c0b6510 0x7f1e0c0b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e201040a0 0x7f1e2019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e20103700 0x7f1e2019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 --2- 172.21.15.17:0/1834434402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e20102670 0x7f1e20199f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 >> 172.21.15.17:0/1834434402 conn(0x7f1e200fdfe0 msgr2=0x7f1e200ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 shutdown_connections 2024-09-21T06:12:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:24.611+0000 7f1e24d53640 1 -- 172.21.15.17:0/1834434402 wait complete. 2024-09-21T06:12:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:24 smithi017 ceph-mon[31080]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:24 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1834434402' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:12:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:24 smithi089 ceph-mon[33879]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:24 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1834434402' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:12:25.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:24 smithi081 ceph-mon[33870]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:25.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:24 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1834434402' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:12:25.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T06:12:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.148+0000 7f7c942fc640 1 -- 172.21.15.17:0/1443195257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 msgr2=0x7f7c8c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1443195257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c102ab0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009900 tx=0x7f7c8802a480 comp rx=0 tx=0).stop 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 -- 172.21.15.17:0/1443195257 shutdown_connections 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1443195257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c104070 0x7f7c8c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1443195257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1443195257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c102ab0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 -- 172.21.15.17:0/1443195257 >> 172.21.15.17:0/1443195257 conn(0x7f7c8c0fdfb0 msgr2=0x7f7c8c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:26.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 -- 172.21.15.17:0/1443195257 shutdown_connections 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 -- 172.21.15.17:0/1443195257 wait complete. 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 Processor -- start 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.149+0000 7f7c942fc640 1 -- start start 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c942fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c942fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c942fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c104070 0x7f7c8c1a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c942fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c10e110 con 0x7f7c8c102640 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c942fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c10df90 con 0x7f7c8c1036d0 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c942fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c10e290 con 0x7f7c8c104070 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:57176/0 (socket says 172.21.15.17:57176) 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 -- 172.21.15.17:0/1239858871 learned_addr learned my addr 172.21.15.17:0/1239858871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c92098640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:26.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c92899640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c104070 0x7f7c8c1a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 -- 172.21.15.17:0/1239858871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c104070 msgr2=0x7f7c8c1a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c104070 0x7f7c8c1a11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 -- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 msgr2=0x7f7c8c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c91897640 1 -- 172.21.15.17:0/1239858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c1a19d0 con 0x7f7c8c1036d0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.150+0000 7f7c92098640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.151+0000 7f7c91897640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c19ec80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00d950 tx=0x7f7c7c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.151+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c017070 con 0x7f7c8c1036d0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.151+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c7c009c30 con 0x7f7c8c1036d0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.151+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c1a1cc0 con 0x7f7c8c1036d0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.151+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00f620 con 0x7f7c8c1036d0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.151+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c1a21b0 con 0x7f7c8c1036d0 2024-09-21T06:12:26.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.152+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c109820 con 0x7f7c8c1036d0 2024-09-21T06:12:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.154+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7c7c010460 con 0x7f7c8c1036d0 2024-09-21T06:12:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.155+0000 7f7c837fe640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c780b6510 0x7f7c780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.155+0000 7f7c92098640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c780b6510 0x7f7c780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.155+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f7c7c0e7260 con 0x7f7c8c1036d0 2024-09-21T06:12:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.155+0000 7f7c92098640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c780b6510 0x7f7c780b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c880057c0 tx=0x7f7c88000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:26.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.158+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c7c009de0 con 0x7f7c8c1036d0 2024-09-21T06:12:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.350+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f7c8c02e840 con 0x7f7c8c1036d0 2024-09-21T06:12:26.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.352+0000 7f7c837fe640 1 -- 172.21.15.17:0/1239858871 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5632 (secure 0 0 0) 0x7f7c7c0b1ae0 con 0x7f7c8c1036d0 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 84 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:fsid dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-21T06:01:54.962201+0000 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-21T06:11:47.669754+0000 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 27 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-21T06:12:26.354 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release squid 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/4212452176,v1:172.21.15.17:6803/4212452176] [v2:172.21.15.17:6804/4212452176,v1:172.21.15.17:6805/4212452176] exists,up da504fcf-fc17-4c8b-a419-69189bf1b15d 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/3959009249,v1:172.21.15.81:6801/3959009249] [v2:172.21.15.81:6802/3959009249,v1:172.21.15.81:6803/3959009249] exists,up df0069ef-5308-4521-958f-4c40caa8055c 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/4023376220,v1:172.21.15.89:6801/4023376220] [v2:172.21.15.89:6802/4023376220,v1:172.21.15.89:6803/4023376220] exists,up 51f5eff4-8860-44d4-a452-8c34286ceca4 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 26 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/1314832581,v1:172.21.15.17:6811/1314832581] [v2:172.21.15.17:6812/1314832581,v1:172.21.15.17:6813/1314832581] exists,up e7b1c53e-ef58-4c7b-8af8-4f3b6401336b 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 32 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/4268623175,v1:172.21.15.81:6809/4268623175] [v2:172.21.15.81:6810/4268623175,v1:172.21.15.81:6811/4268623175] exists,up 1daaade6-5a17-4875-9622-9e9a5760a3cb 2024-09-21T06:12:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 37 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/1915302245,v1:172.21.15.89:6809/1915302245] [v2:172.21.15.89:6810/1915302245,v1:172.21.15.89:6811/1915302245] exists,up ea0cf7ef-eab3-43dc-80e8-c2112eb30951 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/1345802272,v1:172.21.15.17:6819/1345802272] [v2:172.21.15.17:6820/1345802272,v1:172.21.15.17:6821/1345802272] exists,up a163a2eb-95c9-4fee-919f-3b378b3ffa2d 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 48 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/900845162,v1:172.21.15.81:6817/900845162] [v2:172.21.15.81:6818/900845162,v1:172.21.15.81:6819/900845162] exists,up 3ac915b5-3e8a-4938-bbd4-3566c15b6294 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 53 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/4122778161,v1:172.21.15.89:6817/4122778161] [v2:172.21.15.89:6818/4122778161,v1:172.21.15.89:6819/4122778161] exists,up f0758ec6-f4cd-41ac-a4d7-90cb888f86a9 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 59 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/1763624071,v1:172.21.15.17:6827/1763624071] [v2:172.21.15.17:6828/1763624071,v1:172.21.15.17:6829/1763624071] exists,up dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 63 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6824/4282741036,v1:172.21.15.81:6825/4282741036] [v2:172.21.15.81:6826/4282741036,v1:172.21.15.81:6827/4282741036] exists,up ef256d78-3f6d-4e30-989e-11eb7aba5c58 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 68 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6824/1527798982,v1:172.21.15.89:6825/1527798982] [v2:172.21.15.89:6826/1527798982,v1:172.21.15.89:6827/1527798982] exists,up 8307455c-8674-4fb4-b0f4-2ab076db2a4a 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.a [2,11] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.f [8,11] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.1d [2,4] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.13 [4,9] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.14 [4,6] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.1b [5,9] 2024-09-21T06:12:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.24 [4,9] 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.e [5,8] 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.f [9,8] 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.12 [9,10] 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.1b [9,8] 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2587374974 expires 2024-09-22T06:02:45.023002+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3130109001 expires 2024-09-22T06:02:45.023002+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/3524627554 expires 2024-09-22T06:02:45.023002+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/2990540179 expires 2024-09-22T06:02:18.519832+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1617037506 expires 2024-09-22T06:02:18.519832+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/2990540179 expires 2024-09-22T06:02:18.519832+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/4105480071 expires 2024-09-22T06:02:45.023002+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/3524627554 expires 2024-09-22T06:02:45.023002+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1076932999 expires 2024-09-22T06:02:18.519832+0000 2024-09-21T06:12:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1328055657 expires 2024-09-22T06:02:18.519832+0000 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c780b6510 msgr2=0x7f7c780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c780b6510 0x7f7c780b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c880057c0 tx=0x7f7c88000bc0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 msgr2=0x7f7c8c19ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c19ec80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00d950 tx=0x7f7c7c00de10 comp rx=0 tx=0).stop 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 shutdown_connections 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c780b6510 0x7f7c780b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c104070 0x7f7c8c1a11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c1036d0 0x7f7c8c19ec80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 --2- 172.21.15.17:0/1239858871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c8c102640 0x7f7c8c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.354+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 >> 172.21.15.17:0/1239858871 conn(0x7f7c8c0fdfb0 msgr2=0x7f7c8c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.355+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 shutdown_connections 2024-09-21T06:12:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:26.355+0000 7f7c942fc640 1 -- 172.21.15.17:0/1239858871 wait complete. 2024-09-21T06:12:27.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:26 smithi017 ceph-mon[31080]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:27.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:26 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1239858871' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:12:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:26 smithi089 ceph-mon[33879]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:26 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1239858871' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:12:27.132 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T06:12:27.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:26 smithi081 ceph-mon[33870]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:26 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1239858871' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:12:27.414 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:27.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 -- 172.21.15.17:0/2189487047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f81083a0 msgr2=0x7f08f81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:27.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 --2- 172.21.15.17:0/2189487047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f81083a0 0x7f08f81087b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009900 tx=0x7f08e802a410 comp rx=0 tx=0).stop 2024-09-21T06:12:27.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 -- 172.21.15.17:0/2189487047 shutdown_connections 2024-09-21T06:12:27.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 --2- 172.21.15.17:0/2189487047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f81083a0 0x7f08f81087b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 --2- 172.21.15.17:0/2189487047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8108cf0 0x7f08f810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 --2- 172.21.15.17:0/2189487047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8102a60 0x7f08f8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 -- 172.21.15.17:0/2189487047 >> 172.21.15.17:0/2189487047 conn(0x7f08f8079730 msgr2=0x7f08f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 -- 172.21.15.17:0/2189487047 shutdown_connections 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 -- 172.21.15.17:0/2189487047 wait complete. 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.909+0000 7f08ffda2640 1 Processor -- start 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 -- start start 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 0x7f08f810ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f81083a0 0x7f08f81104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8108cf0 0x7f08f8110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8113930 con 0x7f08f8102a60 2024-09-21T06:12:27.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08f81137b0 con 0x7f08f81083a0 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08ffda2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8113ab0 con 0x7f08f8108cf0 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 0x7f08f810ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 0x7f08f810ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37090/0 (socket says 172.21.15.17:37090) 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 -- 172.21.15.17:0/3825992509 learned_addr learned my addr 172.21.15.17:0/3825992509 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fd33d640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f81083a0 0x7f08f81104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fe33f640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8108cf0 0x7f08f8110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 -- 172.21.15.17:0/3825992509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8108cf0 msgr2=0x7f08f8110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8108cf0 0x7f08f8110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 -- 172.21.15.17:0/3825992509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f81083a0 msgr2=0x7f08f81104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f81083a0 0x7f08f81104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fdb3e640 1 -- 172.21.15.17:0/3825992509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f81a8680 con 0x7f08f8102a60 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.910+0000 7f08fe33f640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8108cf0 0x7f08f8110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.911+0000 7f08fdb3e640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 0x7f08f810ffb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f08f400d770 tx=0x7f08f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:27.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.911+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4017070 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.911+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f81a8970 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.911+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08f40054b0 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.911+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4004c60 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.911+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f81a8e80 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.912+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f8102e70 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.914+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f08f4004e00 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.915+0000 7f08eeffd640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f08e40b6510 0x7f08e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.915+0000 7f08fd33d640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f08e40b6510 0x7f08e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.915+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f08f40e7560 con 0x7f08f8102a60 2024-09-21T06:12:27.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.916+0000 7f08fd33d640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f08e40b6510 0x7f08e40b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006010 tx=0x7f08e8032ba0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:27.919+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08f40ada60 con 0x7f08f8102a60 2024-09-21T06:12:28.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.145+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08f802e640 con 0x7f08f8102a60 2024-09-21T06:12:28.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.146+0000 7f08eeffd640 1 -- 172.21.15.17:0/3825992509 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11885 (secure 0 0 0) 0x7f08f40b1e40 con 0x7f08f8102a60 2024-09-21T06:12:28.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:28.147 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-21T06:11:01:721627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:11:01.413226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:12:28.148 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:12:28.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f08e40b6510 msgr2=0x7f08e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:28.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f08e40b6510 0x7f08e40b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006010 tx=0x7f08e8032ba0 comp rx=0 tx=0).stop 2024-09-21T06:12:28.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 msgr2=0x7f08f810ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:28.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 0x7f08f810ffb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f08f400d770 tx=0x7f08f400dc30 comp rx=0 tx=0).stop 2024-09-21T06:12:28.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 shutdown_connections 2024-09-21T06:12:28.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f08e40b6510 0x7f08e40b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:28.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08f8108cf0 0x7f08f8110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:28.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f81083a0 0x7f08f81104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:28.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 --2- 172.21.15.17:0/3825992509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08f8102a60 0x7f08f810ffb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:28.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 >> 172.21.15.17:0/3825992509 conn(0x7f08f8079730 msgr2=0x7f08f81044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:28.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 shutdown_connections 2024-09-21T06:12:28.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:28.148+0000 7f08ffda2640 1 -- 172.21.15.17:0/3825992509 wait complete. 2024-09-21T06:12:28.888 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:28.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:28 smithi017 ceph-mon[31080]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:28.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:28 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3825992509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:29.059 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:28 smithi081 ceph-mon[33870]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:29.060 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:28 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3825992509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:28 smithi089 ceph-mon[33879]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:28 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3825992509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 -- 172.21.15.17:0/881859327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 msgr2=0x7f261c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 --2- 172.21.15.17:0/881859327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c103f70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f260c009ca0 tx=0x7f260c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 -- 172.21.15.17:0/881859327 shutdown_connections 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 --2- 172.21.15.17:0/881859327 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 0x7f261c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 --2- 172.21.15.17:0/881859327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261c1094a0 0x7f261c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 --2- 172.21.15.17:0/881859327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c103f70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 -- 172.21.15.17:0/881859327 >> 172.21.15.17:0/881859327 conn(0x7f261c07b850 msgr2=0x7f261c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 -- 172.21.15.17:0/881859327 shutdown_connections 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 -- 172.21.15.17:0/881859327 wait complete. 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.658+0000 7f2621e2b640 1 Processor -- start 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 -- start start 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261c1094a0 0x7f261c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 0x7f261c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f261c113a10 con 0x7f261c103b60 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f261c113890 con 0x7f261c1094a0 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f2621e2b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f261c113b90 con 0x7f261c109df0 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60282/0 (socket says 172.21.15.17:60282) 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 -- 172.21.15.17:0/708789121 learned_addr learned my addr 172.21.15.17:0/708789121 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261bfff640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 0x7f261c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261affd640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261c1094a0 0x7f261c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 -- 172.21.15.17:0/708789121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 msgr2=0x7f261c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 0x7f261c19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 -- 172.21.15.17:0/708789121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261c1094a0 msgr2=0x7f261c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261c1094a0 0x7f261c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261b7fe640 1 -- 172.21.15.17:0/708789121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261c1a03d0 con 0x7f261c103b60 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.659+0000 7f261bfff640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 0x7f261c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.660+0000 7f261b7fe640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c19a460 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f260c006010 tx=0x7f260c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.660+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c004040 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.660+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f260c004670 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.660+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261c1a0660 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.660+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c030da0 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.660+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261c1a6e20 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.661+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261c103f70 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.663+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f260c0305c0 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.663+0000 7f2618ff9640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26040b6510 0x7f26040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.663+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f260c108e40 con 0x7f261c103b60 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.663+0000 7f261affd640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26040b6510 0x7f26040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.664+0000 7f261affd640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26040b6510 0x7f26040b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f261c106540 tx=0x7f261000a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.667+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f260c004820 con 0x7f261c103b60 2024-09-21T06:12:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.893+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f261c19b590 con 0x7f261c103b60 2024-09-21T06:12:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.894+0000 7f2618ff9640 1 -- 172.21.15.17:0/708789121 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11885 (secure 0 0 0) 0x7f260c0cf340 con 0x7f261c103b60 2024-09-21T06:12:29.896 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:29.896 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-21T06:11:01:721627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:11:01.413226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:12:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-21T06:12:29.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26040b6510 msgr2=0x7f26040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:29.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26040b6510 0x7f26040b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f261c106540 tx=0x7f261000a4c0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 msgr2=0x7f261c19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c19a460 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f260c006010 tx=0x7f260c032bc0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 shutdown_connections 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26040b6510 0x7f26040b8a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f261c109df0 0x7f261c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261c1094a0 0x7f261c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 --2- 172.21.15.17:0/708789121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f261c103b60 0x7f261c19a460 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.896+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 >> 172.21.15.17:0/708789121 conn(0x7f261c07b850 msgr2=0x7f261c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.897+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 shutdown_connections 2024-09-21T06:12:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:29.897+0000 7f2621e2b640 1 -- 172.21.15.17:0/708789121 wait complete. 2024-09-21T06:12:30.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:12:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:30 smithi017 ceph-mon[31080]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:30 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/708789121' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:30 smithi089 ceph-mon[33879]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:30 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/708789121' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:31.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:30 smithi081 ceph-mon[33870]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:12:31.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/708789121' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 -- 172.21.15.17:0/4003131824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 msgr2=0x7f1f0c10e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 --2- 172.21.15.17:0/4003131824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c10e9d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009900 tx=0x7f1f0002a410 comp rx=0 tx=0).stop 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 -- 172.21.15.17:0/4003131824 shutdown_connections 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 --2- 172.21.15.17:0/4003131824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0c114800 0x7f1f0c11b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 --2- 172.21.15.17:0/4003131824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0c113eb0 0x7f1f0c1142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 --2- 172.21.15.17:0/4003131824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c10e9d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 -- 172.21.15.17:0/4003131824 >> 172.21.15.17:0/4003131824 conn(0x7f1f0c10a3c0 msgr2=0x7f1f0c10c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 -- 172.21.15.17:0/4003131824 shutdown_connections 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.359+0000 7f1f13e62640 1 -- 172.21.15.17:0/4003131824 wait complete. 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 Processor -- start 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 -- start start 2024-09-21T06:12:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c1a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0c113eb0 0x7f1f0c1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0c114800 0x7f1f0c1aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c11e380 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c11e200 con 0x7f1f0c113eb0 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f13e62640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c11e500 con 0x7f1f0c114800 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c1a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c1a4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60304/0 (socket says 172.21.15.17:60304) 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 -- 172.21.15.17:0/2853213808 learned_addr learned my addr 172.21.15.17:0/2853213808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f113fd640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0c113eb0 0x7f1f0c1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f123ff640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0c114800 0x7f1f0c1aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 -- 172.21.15.17:0/2853213808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0c114800 msgr2=0x7f1f0c1aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0c114800 0x7f1f0c1aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 -- 172.21.15.17:0/2853213808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0c113eb0 msgr2=0x7f1f0c1a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0c113eb0 0x7f1f0c1a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.360+0000 7f1f11bfe640 1 -- 172.21.15.17:0/2853213808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c1aad60 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.361+0000 7f1f11bfe640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c1a4df0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009230 tx=0x7f1f00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.361+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0003f030 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.361+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f00003a80 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.361+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00035070 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.361+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c1aaff0 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.361+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c1b17b0 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.362+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c10e9d0 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.364+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1f00042030 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.365+0000 7f1efeffd640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1ef80b6590 0x7f1ef80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.365+0000 7f1f113fd640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1ef80b6590 0x7f1ef80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.365+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f1f00108190 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.366+0000 7f1f113fd640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1ef80b6590 0x7f1ef80b8aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c10dbd0 tx=0x7f1f0800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.368+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f000ce690 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.559+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f0c02e640 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.562+0000 7f1efeffd640 1 -- 172.21.15.17:0/2853213808 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24775 (secure 0 0 0) 0x7f1f000d2a70 con 0x7f1f0c10e5c0 2024-09-21T06:12:31.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:31.565 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:11:47.669754+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1ef80b6590 msgr2=0x7f1ef80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1ef80b6590 0x7f1ef80b8aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c10dbd0 tx=0x7f1f0800b390 comp rx=0 tx=0).stop 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 msgr2=0x7f1f0c1a4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c1a4df0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009230 tx=0x7f1f00004270 comp rx=0 tx=0).stop 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 shutdown_connections 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f1ef80b6590 0x7f1ef80b8aa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0c114800 0x7f1f0c1aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0c113eb0 0x7f1f0c1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 --2- 172.21.15.17:0/2853213808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c10e5c0 0x7f1f0c1a4df0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:31.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 >> 172.21.15.17:0/2853213808 conn(0x7f1f0c10a3c0 msgr2=0x7f1f0c1135d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:31.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 shutdown_connections 2024-09-21T06:12:31.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:31.565+0000 7f1f13e62640 1 -- 172.21.15.17:0/2853213808 wait complete. 2024-09-21T06:12:31.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:31 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2853213808' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:32.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:31 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2853213808' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:32.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:31 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2853213808' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:32.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:10:17.202602+0000', 'modified': '2024-09-21T06:11:01.413226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24656, 'mds_1': 24649, 'mds_2': 24631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/1978692137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1978692137}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1978692137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/3289455904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3289455904}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3289455904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.89:6835/1688371803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1688371803}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1688371803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.89:6837/857098251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 857098251}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 857098251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.89:6839/326704663', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6838', 'nonce': 326704663}, {'type': 'v1', 'addr': '172.21.15.89:6839', 'nonce': 326704663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6839/84773565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 84773565}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 84773565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24656, 'qdb_cluster': [24631, 24649, 24656]} 2024-09-21T06:12:32.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:12:32.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:12:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:32.927 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:32 smithi017 ceph-mon[31080]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 -- 172.21.15.17:0/1895266806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee381094a0 msgr2=0x7fee381098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 --2- 172.21.15.17:0/1895266806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee381094a0 0x7fee381098b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee20009900 tx=0x7fee2002a410 comp rx=0 tx=0).stop 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 -- 172.21.15.17:0/1895266806 shutdown_connections 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 --2- 172.21.15.17:0/1895266806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee381094a0 0x7fee381098b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 --2- 172.21.15.17:0/1895266806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee38109df0 0x7fee38110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 --2- 172.21.15.17:0/1895266806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee38103b60 0x7fee38103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 -- 172.21.15.17:0/1895266806 >> 172.21.15.17:0/1895266806 conn(0x7fee3807b850 msgr2=0x7fee3807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 -- 172.21.15.17:0/1895266806 shutdown_connections 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.018+0000 7fee3da46640 1 -- 172.21.15.17:0/1895266806 wait complete. 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 Processor -- start 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 -- start start 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 0x7fee3819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee381094a0 0x7fee3819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee38109df0 0x7fee3819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee38113960 con 0x7fee38103b60 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee381137e0 con 0x7fee38109df0 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee3da46640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fee38113ae0 con 0x7fee381094a0 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee36ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 0x7fee3819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee36ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 0x7fee3819a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60318/0 (socket says 172.21.15.17:60318) 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee36ffd640 1 -- 172.21.15.17:0/31583104 learned_addr learned my addr 172.21.15.17:0/31583104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.019+0000 7fee377fe640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee38109df0 0x7fee3819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee367fc640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee381094a0 0x7fee3819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee36ffd640 1 -- 172.21.15.17:0/31583104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee381094a0 msgr2=0x7fee3819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee36ffd640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee381094a0 0x7fee3819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee36ffd640 1 -- 172.21.15.17:0/31583104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee38109df0 msgr2=0x7fee3819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee36ffd640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee38109df0 0x7fee3819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee36ffd640 1 -- 172.21.15.17:0/31583104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee381a0300 con 0x7fee38103b60 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee367fc640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee381094a0 0x7fee3819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee36ffd640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 0x7fee3819a450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee2800eab0 tx=0x7fee2800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee3ca44640 1 -- 172.21.15.17:0/31583104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2800ce40 con 0x7fee38103b60 2024-09-21T06:12:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee381a05f0 con 0x7fee38103b60 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee3ca44640 1 -- 172.21.15.17:0/31583104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee28011900 con 0x7fee38103b60 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee3ca44640 1 -- 172.21.15.17:0/31583104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28010990 con 0x7fee38103b60 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.020+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee381a6e10 con 0x7fee38103b60 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 Processor -- start 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 -- start start 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee3ca44640 1 -- 172.21.15.17:0/31583104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fee28011470 con 0x7fee38103b60 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb07f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb08440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb08980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5562fea7fc10 con 0x5562fe741280 2024-09-21T06:12:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562fea6f040 con 0x5562fe7390a0 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee43fba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5562fea72e50 con 0x5562fe761f60 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee367fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb08980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee367fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb08980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60326/0 (socket says 172.21.15.17:60326) 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee367fc640 1 -- 172.21.15.17:0/3064724056 learned_addr learned my addr 172.21.15.17:0/3064724056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee377fe640 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb07f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.023+0000 7fee36ffd640 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb08440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee367fc640 1 -- 172.21.15.17:0/3064724056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 msgr2=0x5562feb07f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee367fc640 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb07f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee367fc640 1 -- 172.21.15.17:0/3064724056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 msgr2=0x5562feb08440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee367fc640 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb08440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee367fc640 1 -- 172.21.15.17:0/3064724056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562fe7cd540 con 0x5562fe741280 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee36ffd640 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb08440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee3ca44640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fee240b6540 0x7fee240b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee367fc640 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb08980 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee20006010 tx=0x7fee20032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3f8bfa5b016b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee377fe640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fee240b6540 0x7fee240b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee3ca44640 1 -- 172.21.15.17:0/31583104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fee280e7c80 con 0x7fee38103b60 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee2dffb640 1 -- 172.21.15.17:0/3064724056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2003f070 con 0x5562fe741280 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee2dffb640 1 -- 172.21.15.17:0/3064724056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee200044c0 con 0x5562fe741280 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.024+0000 7fee2dffb640 1 -- 172.21.15.17:0/3064724056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20035070 con 0x5562fe741280 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 -- 172.21.15.17:0/3064724056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 msgr2=0x5562feb08980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb08980 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee20006010 tx=0x7fee20032c40 comp rx=0 tx=0).stop 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee377fe640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fee240b6540 0x7fee240b8a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee3000ac90 tx=0x7fee3000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 -- 172.21.15.17:0/3064724056 shutdown_connections 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb08980 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb08440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 --2- 172.21.15.17:0/3064724056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb07f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 -- 172.21.15.17:0/3064724056 >> 172.21.15.17:0/3064724056 conn(0x5562fe756350 msgr2=0x5562feb05df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 -- 172.21.15.17:0/3064724056 shutdown_connections 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.025+0000 7fee43fba740 1 -- 172.21.15.17:0/3064724056 wait complete. 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 -- start start 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 Processor -- start 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe7390a0 0x5562feb17ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe741280 0x5562feb18180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb23d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5562fe8d05f0 con 0x5562fe761f60 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562fea0a010 con 0x5562fe741280 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5562feb1a9e0 con 0x5562fe7390a0 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee43fba740 10 client.0 _ll_register_callbacks cb 0x5562fea69340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.026+0000 7fee377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb23d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe7390a0 0x5562feb17ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb23d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60334/0 (socket says 172.21.15.17:60334) 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 -- 172.21.15.17:0/942034996 learned_addr learned my addr 172.21.15.17:0/942034996 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee367fc640 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe741280 0x5562feb18180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 -- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe7390a0 msgr2=0x5562feb17ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe7390a0 0x5562feb17ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 -- 172.21.15.17:0/942034996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe741280 msgr2=0x5562feb18180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe741280 0x5562feb18180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 -- 172.21.15.17:0/942034996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562fea37a00 con 0x5562fe761f60 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee377fe640 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb23d10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fee3001cbe0 tx=0x7fee30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e56ad02bf96fd0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee16ffd640 1 -- 172.21.15.17:0/942034996 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3000ada0 con 0x5562fe761f60 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee16ffd640 1 -- 172.21.15.17:0/942034996 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fee30016030 con 0x5562fe761f60 2024-09-21T06:12:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562fea81b60 con 0x5562fe761f60 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee16ffd640 1 -- 172.21.15.17:0/942034996 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee30032050 con 0x5562fe761f60 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee43fba740 10 client.15339 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.027+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5562feb268b0 con 0x5562fe761f60 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee16ffd640 1 -- 172.21.15.17:0/942034996 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5562fea81b60 con 0x5562fe761f60 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee16ffd640 1 -- 172.21.15.17:0/942034996 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fee30005220 con 0x5562fe761f60 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee43fba740 10 client.15339 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee43fba740 10 client.15339 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee43fba740 20 client.15339 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee43fba740 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe7208e0 0x5562feb2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee43fba740 4 client.15339 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 --> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562fea7d610 con 0x5562fe7208e0 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.028+0000 7fee36ffd640 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe7208e0 0x5562feb2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.029+0000 7fee36ffd640 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe7208e0 0x5562feb2a3a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bfe224de303f55d5 server_cookie=b8e205ad1a3ff5d7 in_seq=0 out_seq=0 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.029+0000 7fee16ffd640 10 client.15339 ms_handle_connect on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.029+0000 7fee16ffd640 1 -- 172.21.15.17:0/942034996 <== mds.2 v2:172.21.15.89:6836/857098251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562fea7d610 con 0x5562fe7208e0 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.029+0000 7fee16ffd640 10 client.15339 handle_command_reply: tid=0 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 client.15339 shutdown 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 msgr2=0x5562feb23d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb23d10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fee3001cbe0 tx=0x7fee30004730 comp rx=0 tx=0).stop 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 shutdown_connections 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe7208e0 0x5562feb2a3a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb23d10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe741280 0x5562feb18180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee16ffd640 0 client.15339 ms_handle_reset on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 --2- 172.21.15.17:0/942034996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe7390a0 0x5562feb17ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 >> 172.21.15.17:0/942034996 conn(0x5562fe756350 msgr2=0x5562feb043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 shutdown_connections 2024-09-21T06:12:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 1 -- 172.21.15.17:0/942034996 wait complete. 2024-09-21T06:12:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.030+0000 7fee43fba740 20 client.15339 trim_cache size 0 max 16384 2024-09-21T06:12:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.048+0000 7fee43fba740 1 Processor -- start 2024-09-21T06:12:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.048+0000 7fee43fba740 1 -- start start 2024-09-21T06:12:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.048+0000 7fee43fba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb04a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.048+0000 7fee43fba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.048+0000 7fee43fba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb23c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee43fba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5562feb286e0 con 0x5562fe741280 2024-09-21T06:12:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee43fba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562feb28db0 con 0x5562fe7390a0 2024-09-21T06:12:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee43fba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5562feb29480 con 0x5562fe761f60 2024-09-21T06:12:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb00ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60348/0 (socket says 172.21.15.17:60348) 2024-09-21T06:12:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 -- 172.21.15.17:0/2872252956 learned_addr learned my addr 172.21.15.17:0/2872252956 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee36ffd640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb04a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee377fe640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb23c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 -- 172.21.15.17:0/2872252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 msgr2=0x5562feb23c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb23c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 -- 172.21.15.17:0/2872252956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 msgr2=0x5562feb04a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb04a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 -- 172.21.15.17:0/2872252956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562feb066e0 con 0x5562fe741280 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee36ffd640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb04a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee377fe640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb23c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee367fc640 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb00ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee20033000 tx=0x7fee2002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b870a0a0f2d695f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee2d7fa640 1 -- 172.21.15.17:0/2872252956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20035050 con 0x5562fe741280 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee2d7fa640 1 -- 172.21.15.17:0/2872252956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee200054d0 con 0x5562fe741280 2024-09-21T06:12:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.049+0000 7fee2d7fa640 1 -- 172.21.15.17:0/2872252956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2003f040 con 0x5562fe741280 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 -- 172.21.15.17:0/2872252956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 msgr2=0x5562feb00ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb00ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee20033000 tx=0x7fee2002a410 comp rx=0 tx=0).stop 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 -- 172.21.15.17:0/2872252956 shutdown_connections 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe741280 0x5562feb00ad0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe761f60 0x5562feb23c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 --2- 172.21.15.17:0/2872252956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb04a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 -- 172.21.15.17:0/2872252956 >> 172.21.15.17:0/2872252956 conn(0x5562fe756350 msgr2=0x5562feb16420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 -- 172.21.15.17:0/2872252956 shutdown_connections 2024-09-21T06:12:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.050+0000 7fee43fba740 1 -- 172.21.15.17:0/2872252956 wait complete. 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 -- start start 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 Processor -- start 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb2c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe741280 0x5562feb2cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb2d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5562feb2a220 con 0x5562fe761f60 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562feb29b50 con 0x5562fe7390a0 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5562feb2a8f0 con 0x5562fe741280 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee43fba740 10 client.0 _ll_register_callbacks cb 0x7fee3000a640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb2d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb2d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60354/0 (socket says 172.21.15.17:60354) 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.051+0000 7fee377fe640 1 -- 172.21.15.17:0/4149707326 learned_addr learned my addr 172.21.15.17:0/4149707326 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee36ffd640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb2c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee367fc640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe741280 0x5562feb2cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee377fe640 1 -- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe741280 msgr2=0x5562feb2cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee377fe640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe741280 0x5562feb2cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee377fe640 1 -- 172.21.15.17:0/4149707326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 msgr2=0x5562feb2c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee377fe640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb2c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee377fe640 1 -- 172.21.15.17:0/4149707326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562feb320b0 con 0x5562fe761f60 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee377fe640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb2d220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fee3000a330 tx=0x7fee3000afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4696d35598a2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee16ffd640 1 -- 172.21.15.17:0/4149707326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3000f7f0 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee16ffd640 1 -- 172.21.15.17:0/4149707326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fee3000f990 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee200054d0 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee16ffd640 1 -- 172.21.15.17:0/4149707326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee30046050 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee43fba740 10 client.15345 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.052+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5562feb95b70 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee16ffd640 1 -- 172.21.15.17:0/4149707326 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee200054d0 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee16ffd640 1 -- 172.21.15.17:0/4149707326 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fee30027420 con 0x5562fe761f60 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee43fba740 10 client.15345 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee43fba740 10 client.15345 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee43fba740 20 client.15345 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee43fba740 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe6f5c90 0x5562feb994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee43fba740 4 client.15345 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 --> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] -- command(tid 0: {"prefix": "status"}) -- 0x5562fea7aa40 con 0x5562fe6f5c90 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.053+0000 7fee36ffd640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe6f5c90 0x5562feb994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee36ffd640 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe6f5c90 0x5562feb994c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed8c598d7c691134 server_cookie=d0a3901582060d37 in_seq=0 out_seq=0 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee16ffd640 10 client.15345 ms_handle_connect on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee16ffd640 1 -- 172.21.15.17:0/4149707326 <== mds.2 v2:172.21.15.89:6836/857098251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5562fea7aa40 con 0x5562fe6f5c90 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee16ffd640 10 client.15345 handle_command_reply: tid=0 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 client.15345 shutdown 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 msgr2=0x5562feb2d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb2d220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fee3000a330 tx=0x7fee3000afd0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 shutdown_connections 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x5562fe6f5c90 0x5562feb994c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562fe761f60 0x5562feb2d220 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5562fe741280 0x5562feb2cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee16ffd640 0 client.15345 ms_handle_reset on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 --2- 172.21.15.17:0/4149707326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562fe7390a0 0x5562feb2c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 >> 172.21.15.17:0/4149707326 conn(0x5562fe756350 msgr2=0x5562feb19050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 shutdown_connections 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 1 -- 172.21.15.17:0/4149707326 wait complete. 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.054+0000 7fee43fba740 20 client.15345 trim_cache size 0 max 16384 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24631, 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:33.065 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 94.337179449999994, 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 25, 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 160.627014629 2024-09-21T06:12:33.066 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fee240b6540 msgr2=0x7fee240b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fee240b6540 0x7fee240b8a50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee3000ac90 tx=0x7fee3000a250 comp rx=0 tx=0).stop 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 msgr2=0x7fee3819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 0x7fee3819a450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee2800eab0 tx=0x7fee2800ef70 comp rx=0 tx=0).stop 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 shutdown_connections 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fee240b6540 0x7fee240b8a50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee38109df0 0x7fee3819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee381094a0 0x7fee3819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 --2- 172.21.15.17:0/31583104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee38103b60 0x7fee3819a450 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 >> 172.21.15.17:0/31583104 conn(0x7fee3807b850 msgr2=0x7fee38105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:33.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 shutdown_connections 2024-09-21T06:12:33.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:33.055+0000 7fee3da46640 1 -- 172.21.15.17:0/31583104 wait complete. 2024-09-21T06:12:33.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:32 smithi089 ceph-mon[33879]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:33.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:32 smithi081 ceph-mon[33870]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:12:33.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:12:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:34.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 -- 172.21.15.17:0/952589693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe690102a60 msgr2=0x7fe690102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 --2- 172.21.15.17:0/952589693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe690102a60 0x7fe690102e70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009900 tx=0x7fe68c02a410 comp rx=0 tx=0).stop 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 -- 172.21.15.17:0/952589693 shutdown_connections 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 --2- 172.21.15.17:0/952589693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe690108cf0 0x7fe69010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 --2- 172.21.15.17:0/952589693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6901083a0 0x7fe6901087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 --2- 172.21.15.17:0/952589693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe690102a60 0x7fe690102e70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 -- 172.21.15.17:0/952589693 >> 172.21.15.17:0/952589693 conn(0x7fe690079730 msgr2=0x7fe690079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 -- 172.21.15.17:0/952589693 shutdown_connections 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 -- 172.21.15.17:0/952589693 wait complete. 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 Processor -- start 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.594+0000 7fe69870c640 1 -- start start 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe69870c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe690102a60 0x7fe69019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe69870c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 0x7fe69019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe69870c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe690108cf0 0x7fe69019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe69870c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe690112810 con 0x7fe6901083a0 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe69870c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe690112690 con 0x7fe690102a60 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe69870c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe690112990 con 0x7fe690108cf0 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 0x7fe69019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 0x7fe69019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60374/0 (socket says 172.21.15.17:60374) 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe6964a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe690102a60 0x7fe69019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 -- 172.21.15.17:0/832626969 learned_addr learned my addr 172.21.15.17:0/832626969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe696ca9640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe690108cf0 0x7fe69019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 -- 172.21.15.17:0/832626969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe690108cf0 msgr2=0x7fe69019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe690108cf0 0x7fe69019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 -- 172.21.15.17:0/832626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe690102a60 msgr2=0x7fe69019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe690102a60 0x7fe69019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.595+0000 7fe695ca7640 1 -- 172.21.15.17:0/832626969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a0340 con 0x7fe6901083a0 2024-09-21T06:12:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.596+0000 7fe695ca7640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 0x7fe69019a970 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe68000d740 tx=0x7fe68000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.596+0000 7fe6877fe640 1 -- 172.21.15.17:0/832626969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680017070 con 0x7fe6901083a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.596+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a0630 con 0x7fe6901083a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.596+0000 7fe6877fe640 1 -- 172.21.15.17:0/832626969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe68000de50 con 0x7fe6901083a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.596+0000 7fe6877fe640 1 -- 172.21.15.17:0/832626969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680004c60 con 0x7fe6901083a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.596+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a6d90 con 0x7fe6901083a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.598+0000 7fe69ec80740 1 Processor -- start 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 -- start start 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe6877fe640 1 -- 172.21.15.17:0/832626969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe680004e00 con 0x7fe6901083a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a37df60 0x55562a723f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a724440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a724980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55562a69bc10 con 0x55562a3550a0 2024-09-21T06:12:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55562a68b040 con 0x55562a37df60 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe69ec80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55562a68ee50 con 0x55562a35d280 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe6964a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a724440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe6964a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a724440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60386/0 (socket says 172.21.15.17:60386) 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe6964a8640 1 -- 172.21.15.17:0/1510407915 learned_addr learned my addr 172.21.15.17:0/1510407915 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe695ca7640 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a724980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.599+0000 7fe696ca9640 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a37df60 0x55562a723f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6964a8640 1 -- 172.21.15.17:0/1510407915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 msgr2=0x55562a724980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a724980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6964a8640 1 -- 172.21.15.17:0/1510407915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a37df60 msgr2=0x55562a723f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a37df60 0x55562a723f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6964a8640 1 -- 172.21.15.17:0/1510407915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55562a3e9540 con 0x55562a3550a0 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe696ca9640 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a37df60 0x55562a723f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6877fe640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe67c0b6510 0x7fe67c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a724440 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe68c02a930 tx=0x7fe68c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53e058600c4e804 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe696ca9640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe67c0b6510 0x7fe67c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe6877fe640 1 -- 172.21.15.17:0/832626969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe6800e6fa0 con 0x7fe6901083a0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe684ff9640 1 -- 172.21.15.17:0/1510407915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c035030 con 0x55562a3550a0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe684ff9640 1 -- 172.21.15.17:0/1510407915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe68c040070 con 0x55562a3550a0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.600+0000 7fe684ff9640 1 -- 172.21.15.17:0/1510407915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c003970 con 0x55562a3550a0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 -- 172.21.15.17:0/1510407915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 msgr2=0x55562a724440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe696ca9640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe67c0b6510 0x7fe67c0b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe688005fd0 tx=0x7fe6880096a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a724440 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe68c02a930 tx=0x7fe68c031ba0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 -- 172.21.15.17:0/1510407915 shutdown_connections 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a724440 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a724980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1510407915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a37df60 0x55562a723f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 -- 172.21.15.17:0/1510407915 >> 172.21.15.17:0/1510407915 conn(0x55562a372350 msgr2=0x55562a721df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 -- 172.21.15.17:0/1510407915 shutdown_connections 2024-09-21T06:12:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.601+0000 7fe69ec80740 1 -- 172.21.15.17:0/1510407915 wait complete. 2024-09-21T06:12:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 -- start start 2024-09-21T06:12:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 Processor -- start 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a72fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 0x55562a72ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a37df60 0x55562a73b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55562a4ec5f0 con 0x55562a35d280 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55562a626010 con 0x55562a3550a0 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55562a732680 con 0x55562a37df60 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe69ec80740 10 client.0 _ll_register_callbacks cb 0x55562a685340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 0x55562a72ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 0x55562a72ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60396/0 (socket says 172.21.15.17:60396) 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 -- 172.21.15.17:0/1033963455 learned_addr learned my addr 172.21.15.17:0/1033963455 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe696ca9640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a37df60 0x55562a73b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a72fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 -- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a37df60 msgr2=0x55562a73b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a37df60 0x55562a73b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 -- 172.21.15.17:0/1033963455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 msgr2=0x55562a72fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.602+0000 7fe695ca7640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a72fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe695ca7640 1 -- 172.21.15.17:0/1033963455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55562a653a00 con 0x55562a35d280 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe696ca9640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a37df60 0x55562a73b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a72fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe695ca7640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 0x55562a72ff40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe680005d00 tx=0x7fe680009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2364ac09bf233ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe679ffb640 1 -- 172.21.15.17:0/1033963455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680020030 con 0x55562a35d280 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe68c040070 con 0x55562a35d280 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe679ffb640 1 -- 172.21.15.17:0/1033963455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe680094110 con 0x55562a35d280 2024-09-21T06:12:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe679ffb640 1 -- 172.21.15.17:0/1033963455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6800e92d0 con 0x55562a35d280 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe69ec80740 10 client.15357 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55562a73e5d0 con 0x55562a35d280 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.603+0000 7fe679ffb640 1 -- 172.21.15.17:0/1033963455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe68c040070 con 0x55562a35d280 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe679ffb640 1 -- 172.21.15.17:0/1033963455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe6800e4bd0 con 0x55562a35d280 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe69ec80740 10 client.15357 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe69ec80740 10 client.15357 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe69ec80740 20 client.15357 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a33c8e0 0x55562a7420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe69ec80740 4 client.15357 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 --> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55562a69db60 con 0x55562a33c8e0 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a33c8e0 0x55562a7420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe6964a8640 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a33c8e0 0x55562a7420a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=713c65a223790339 server_cookie=dce72592230e46ee in_seq=0 out_seq=0 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.604+0000 7fe679ffb640 10 client.15357 ms_handle_connect on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe679ffb640 1 -- 172.21.15.17:0/1033963455 <== mds.1 v2:172.21.15.89:6838/326704663 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55562a69db60 con 0x55562a33c8e0 2024-09-21T06:12:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe679ffb640 10 client.15357 handle_command_reply: tid=0 2024-09-21T06:12:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 client.15357 shutdown 2024-09-21T06:12:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 msgr2=0x55562a72ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 0x55562a72ff40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe680005d00 tx=0x7fe680009e60 comp rx=0 tx=0).stop 2024-09-21T06:12:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 shutdown_connections 2024-09-21T06:12:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a33c8e0 0x55562a7420a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a35d280 0x55562a72ff40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a37df60 0x55562a73b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe679ffb640 0 client.15357 ms_handle_reset on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 --2- 172.21.15.17:0/1033963455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a72fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.605+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 >> 172.21.15.17:0/1033963455 conn(0x55562a372350 msgr2=0x55562a727090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.606+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 shutdown_connections 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.606+0000 7fe69ec80740 1 -- 172.21.15.17:0/1033963455 wait complete. 2024-09-21T06:12:34.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.606+0000 7fe69ec80740 20 client.15357 trim_cache size 0 max 16384 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.624+0000 7fe69ec80740 1 Processor -- start 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.624+0000 7fe69ec80740 1 -- start start 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a33c8e0 0x55562a730110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a73b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a35d280 0x55562a73be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe69ec80740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55562a7403e0 con 0x55562a3550a0 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe69ec80740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55562a740ab0 con 0x55562a35d280 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe69ec80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55562a741180 con 0x55562a33c8e0 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a73b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a73b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60408/0 (socket says 172.21.15.17:60408) 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 -- 172.21.15.17:0/2141280681 learned_addr learned my addr 172.21.15.17:0/2141280681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe696ca9640 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a35d280 0x55562a73be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe6964a8640 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a33c8e0 0x55562a730110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 -- 172.21.15.17:0/2141280681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a33c8e0 msgr2=0x55562a730110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a33c8e0 0x55562a730110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 -- 172.21.15.17:0/2141280681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a35d280 msgr2=0x55562a73be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a35d280 0x55562a73be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 -- 172.21.15.17:0/2141280681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55562a71c080 con 0x55562a3550a0 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe696ca9640 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a35d280 0x55562a73be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.625+0000 7fe695ca7640 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a73b910 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe6800a9420 tx=0x7fe680098360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5a895e2678868f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.626+0000 7fe67bfff640 1 -- 172.21.15.17:0/2141280681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680020050 con 0x55562a3550a0 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.626+0000 7fe67bfff640 1 -- 172.21.15.17:0/2141280681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6800b0070 con 0x55562a3550a0 2024-09-21T06:12:34.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.626+0000 7fe67bfff640 1 -- 172.21.15.17:0/2141280681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6800b67c0 con 0x55562a3550a0 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.626+0000 7fe69ec80740 1 -- 172.21.15.17:0/2141280681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 msgr2=0x55562a73b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.626+0000 7fe69ec80740 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a73b910 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe6800a9420 tx=0x7fe680098360 comp rx=0 tx=0).stop 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 -- 172.21.15.17:0/2141280681 shutdown_connections 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a3550a0 0x55562a73b910 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a35d280 0x55562a73be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 --2- 172.21.15.17:0/2141280681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a33c8e0 0x55562a730110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 -- 172.21.15.17:0/2141280681 >> 172.21.15.17:0/2141280681 conn(0x55562a372350 msgr2=0x55562a72fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 -- 172.21.15.17:0/2141280681 shutdown_connections 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 -- 172.21.15.17:0/2141280681 wait complete. 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 -- start start 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 Processor -- start 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.627+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 0x55562a74a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a74a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a74ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55562a741f20 con 0x55562a33c8e0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55562a741850 con 0x55562a3550a0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55562a7425f0 con 0x55562a35d280 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 0x55562a74a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 10 client.0 _ll_register_callbacks cb 0x7fe6800046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 0x55562a74a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60418/0 (socket says 172.21.15.17:60418) 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 -- 172.21.15.17:0/3457854977 learned_addr learned my addr 172.21.15.17:0/3457854977 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe695ca7640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a74a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe696ca9640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a74ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 -- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 msgr2=0x55562a74ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a74ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 -- 172.21.15.17:0/3457854977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 msgr2=0x55562a74a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a74a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 -- 172.21.15.17:0/3457854977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55562a7432a0 con 0x55562a33c8e0 2024-09-21T06:12:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe6964a8640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 0x55562a74a300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55562a722b80 tx=0x7fe68c031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e63c41dd6337217 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe679ffb640 1 -- 172.21.15.17:0/3457854977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c035040 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6800b0070 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.628+0000 7fe679ffb640 1 -- 172.21.15.17:0/3457854977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe68c004030 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe679ffb640 1 -- 172.21.15.17:0/3457854977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe68c05e050 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 10 client.15363 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55562a7b1bb0 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe679ffb640 1 -- 172.21.15.17:0/3457854977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6800b0070 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe679ffb640 1 -- 172.21.15.17:0/3457854977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe68c04c070 con 0x55562a33c8e0 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 10 client.15363 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 10 client.15363 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:12:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 20 client.15363 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a37df60 0x55562a7b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 4 client.15363 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 --> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] -- command(tid 0: {"prefix": "status"}) -- 0x55562a699610 con 0x55562a37df60 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.629+0000 7fe695ca7640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a37df60 0x55562a7b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe695ca7640 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a37df60 0x55562a7b5080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9db41bde40555720 server_cookie=63678060329de9f5 in_seq=0 out_seq=0 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe679ffb640 10 client.15363 ms_handle_connect on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe679ffb640 1 -- 172.21.15.17:0/3457854977 <== mds.1 v2:172.21.15.89:6838/326704663 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55562a699610 con 0x55562a37df60 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe679ffb640 10 client.15363 handle_command_reply: tid=0 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 client.15363 shutdown 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 msgr2=0x55562a74a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 0x55562a74a300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55562a722b80 tx=0x7fe68c031b20 comp rx=0 tx=0).stop 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 shutdown_connections 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x55562a37df60 0x55562a7b5080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55562a35d280 0x55562a74ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55562a3550a0 0x55562a74a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe679ffb640 0 client.15363 ms_handle_reset on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 --2- 172.21.15.17:0/3457854977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55562a33c8e0 0x55562a74a300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 >> 172.21.15.17:0/3457854977 conn(0x55562a372350 msgr2=0x55562a721600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 shutdown_connections 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.630+0000 7fe69ec80740 1 -- 172.21.15.17:0/3457854977 wait complete. 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69ec80740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T06:12:34.643 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24649, 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 96.922104279999999, 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 25, 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 156.89484199899999 2024-09-21T06:12:34.644 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe67c0b6510 msgr2=0x7fe67c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe67c0b6510 0x7fe67c0b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe688005fd0 tx=0x7fe6880096a0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 msgr2=0x7fe69019a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 0x7fe69019a970 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe68000d740 tx=0x7fe68000dc00 comp rx=0 tx=0).stop 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 shutdown_connections 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe67c0b6510 0x7fe67c0b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6901083a0 0x7fe69019a970 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe690108cf0 0x7fe69019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 --2- 172.21.15.17:0/832626969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe690102a60 0x7fe69019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 >> 172.21.15.17:0/832626969 conn(0x7fe690079730 msgr2=0x7fe690101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 shutdown_connections 2024-09-21T06:12:34.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:34.631+0000 7fe69870c640 1 -- 172.21.15.17:0/832626969 wait complete. 2024-09-21T06:12:35.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:34 smithi017 ceph-mon[31080]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:12:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:34 smithi089 ceph-mon[33879]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:12:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:34 smithi081 ceph-mon[33870]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:12:35.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:12:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 -- 172.21.15.17:0/3858325647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 msgr2=0x7f5a30110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 --2- 172.21.15.17:0/3858325647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a30110670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009ca0 tx=0x7f5a2802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 -- 172.21.15.17:0/3858325647 shutdown_connections 2024-09-21T06:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 --2- 172.21.15.17:0/3858325647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a30110670 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 --2- 172.21.15.17:0/3858325647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 0x7f5a30109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 --2- 172.21.15.17:0/3858325647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103bb0 0x7f5a30103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 -- 172.21.15.17:0/3858325647 >> 172.21.15.17:0/3858325647 conn(0x7f5a300ff600 msgr2=0x7f5a30101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 -- 172.21.15.17:0/3858325647 shutdown_connections 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.195+0000 7f5a38665640 1 -- 172.21.15.17:0/3858325647 wait complete. 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 Processor -- start 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 -- start start 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103bb0 0x7f5a3019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 0x7f5a3019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a3019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30113a00 con 0x7f5a30109e40 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30113880 con 0x7f5a30103bb0 2024-09-21T06:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a38665640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30113b80 con 0x7f5a301094f0 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a3019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a3019fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60436/0 (socket says 172.21.15.17:60436) 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 -- 172.21.15.17:0/2316580416 learned_addr learned my addr 172.21.15.17:0/2316580416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a35c00640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 0x7f5a3019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36401640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103bb0 0x7f5a3019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 -- 172.21.15.17:0/2316580416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 msgr2=0x7f5a3019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 0x7f5a3019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 -- 172.21.15.17:0/2316580416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103bb0 msgr2=0x7f5a3019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103bb0 0x7f5a3019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a36c02640 1 -- 172.21.15.17:0/2316580416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a301a0300 con 0x7f5a30109e40 2024-09-21T06:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.196+0000 7f5a35c00640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 0x7f5a3019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.197+0000 7f5a36c02640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a3019fbd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005cc0 tx=0x7f5a28003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.197+0000 7f5a277fe640 1 -- 172.21.15.17:0/2316580416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28032c10 con 0x7f5a30109e40 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.197+0000 7f5a277fe640 1 -- 172.21.15.17:0/2316580416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a28032db0 con 0x7f5a30109e40 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.197+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a301a0590 con 0x7f5a30109e40 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.197+0000 7f5a277fe640 1 -- 172.21.15.17:0/2316580416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28030a60 con 0x7f5a30109e40 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.197+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a6d50 con 0x7f5a30109e40 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.199+0000 7f5a3ebd9740 1 Processor -- start 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a277fe640 1 -- 172.21.15.17:0/2316580416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5a28030c20 con 0x7f5a30109e40 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 -- start start 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f7bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314f7c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 0x562314f7c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562314ef3c10 con 0x562314bb5280 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562314ee3040 con 0x562314bd5f60 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562314ee6e50 con 0x562314bad0a0 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a35c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 0x562314f7c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a35c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 0x562314f7c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60440/0 (socket says 172.21.15.17:60440) 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.200+0000 7f5a35c00640 1 -- 172.21.15.17:0/3146973670 learned_addr learned my addr 172.21.15.17:0/3146973670 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f7bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a36401640 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314f7c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 -- 172.21.15.17:0/3146973670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 msgr2=0x562314f7c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314f7c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 -- 172.21.15.17:0/3146973670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 msgr2=0x562314f7bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f7bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 -- 172.21.15.17:0/3146973670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562314c41540 con 0x562314bb5280 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a277fe640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f5a1c0b6590 0x7f5a1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a35c00640 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 0x562314f7c980 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009fd0 tx=0x7f5a20009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ea1d0f448baa09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a36401640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f5a1c0b6590 0x7f5a1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a277fe640 1 -- 172.21.15.17:0/2316580416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f5a28108820 con 0x7f5a30109e40 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a24ff9640 1 -- 172.21.15.17:0/3146973670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20010710 con 0x562314bb5280 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a24ff9640 1 -- 172.21.15.17:0/3146973670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a20010d40 con 0x562314bb5280 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.201+0000 7f5a24ff9640 1 -- 172.21.15.17:0/3146973670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2001dc80 con 0x562314bb5280 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3146973670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 msgr2=0x562314f7c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 0x562314f7c980 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009fd0 tx=0x7f5a20009770 comp rx=0 tx=0).stop 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a36401640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f5a1c0b6590 0x7f5a1c0b8aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x562314f7ab80 tx=0x7f5a2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3146973670 shutdown_connections 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bb5280 0x562314f7c980 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314f7c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3146973670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f7bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3146973670 >> 172.21.15.17:0/3146973670 conn(0x562314bca350 msgr2=0x562314f79df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3146973670 shutdown_connections 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.202+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3146973670 wait complete. 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 -- start start 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 Processor -- start 2024-09-21T06:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f87980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f87ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f93a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562314d445f0 con 0x562314bad0a0 2024-09-21T06:12:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562314e7e010 con 0x562314bd5f60 2024-09-21T06:12:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562314f8a6e0 con 0x562314bb5280 2024-09-21T06:12:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a3ebd9740 10 client.0 _ll_register_callbacks cb 0x562314edd340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a36401640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f87980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a36401640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f87980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60448/0 (socket says 172.21.15.17:60448) 2024-09-21T06:12:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a36401640 1 -- 172.21.15.17:0/2970457179 learned_addr learned my addr 172.21.15.17:0/2970457179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a35c00640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f87ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a36c02640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f93a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a36401640 1 -- 172.21.15.17:0/2970457179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 msgr2=0x562314f87ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.203+0000 7f5a36401640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f87ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a36401640 1 -- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 msgr2=0x562314f93a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a36401640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f93a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a36401640 1 -- 172.21.15.17:0/2970457179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562314eaba00 con 0x562314bad0a0 2024-09-21T06:12:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a36c02640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f93a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a36401640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f87980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009560 tx=0x7f5a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff19ce00f1e3e718 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a19ffb640 1 -- 172.21.15.17:0/2970457179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c004020 con 0x562314bad0a0 2024-09-21T06:12:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a19ffb640 1 -- 172.21.15.17:0/2970457179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f5a2c0041c0 con 0x562314bad0a0 2024-09-21T06:12:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a20010d40 con 0x562314bad0a0 2024-09-21T06:12:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a19ffb640 1 -- 172.21.15.17:0/2970457179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a2c031050 con 0x562314bad0a0 2024-09-21T06:12:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a3ebd9740 10 client.15375 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562314f96670 con 0x562314bad0a0 2024-09-21T06:12:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.204+0000 7f5a19ffb640 1 -- 172.21.15.17:0/2970457179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a20010d40 con 0x562314bad0a0 2024-09-21T06:12:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a19ffb640 1 -- 172.21.15.17:0/2970457179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5a2c003780 con 0x562314bad0a0 2024-09-21T06:12:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a3ebd9740 10 client.15375 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a3ebd9740 10 client.15375 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:12:36.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a3ebd9740 20 client.15375 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b948e0 0x562314f9a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a3ebd9740 4 client.15375 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562314ef5b60 con 0x562314b948e0 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.205+0000 7f5a35c00640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b948e0 0x562314f9a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.206+0000 7f5a19ffb640 10 client.15375 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.206+0000 7f5a35c00640 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b948e0 0x562314f9a130 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b41c94eeb442e7 server_cookie=b284eb2c1ec64306 in_seq=0 out_seq=0 2024-09-21T06:12:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.206+0000 7f5a19ffb640 1 -- 172.21.15.17:0/2970457179 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562314ef5b60 con 0x562314b948e0 2024-09-21T06:12:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.206+0000 7f5a19ffb640 10 client.15375 handle_command_reply: tid=0 2024-09-21T06:12:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 client.15375 shutdown 2024-09-21T06:12:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 msgr2=0x562314f87980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f87980 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009560 tx=0x7f5a2c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 shutdown_connections 2024-09-21T06:12:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b948e0 0x562314f9a130 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f93a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f87ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a19ffb640 0 client.15375 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/2970457179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f87980 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 >> 172.21.15.17:0/2970457179 conn(0x562314bca350 msgr2=0x562314f7f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 shutdown_connections 2024-09-21T06:12:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/2970457179 wait complete. 2024-09-21T06:12:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.207+0000 7f5a3ebd9740 20 client.15375 trim_cache size 0 max 16384 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.225+0000 7f5a3ebd9740 1 Processor -- start 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 -- start start 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f939a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f93ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f79600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562314f98470 con 0x562314bad0a0 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562314f98b40 con 0x562314bd5f60 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562314f99210 con 0x562314bb5280 2024-09-21T06:12:36.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f939a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f939a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60450/0 (socket says 172.21.15.17:60450) 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 -- 172.21.15.17:0/88993811 learned_addr learned my addr 172.21.15.17:0/88993811 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36c02640 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a35c00640 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f93ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 -- 172.21.15.17:0/88993811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 msgr2=0x562314f93ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f93ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 -- 172.21.15.17:0/88993811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 msgr2=0x562314f79600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f79600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.226+0000 7f5a36401640 1 -- 172.21.15.17:0/88993811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562314f996c0 con 0x562314bad0a0 2024-09-21T06:12:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.227+0000 7f5a36401640 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f939a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c003d40 tx=0x7f5a2c011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79ccc5b6fe94231 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.227+0000 7f5a1bfff640 1 -- 172.21.15.17:0/88993811 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c011e90 con 0x562314bad0a0 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.227+0000 7f5a1bfff640 1 -- 172.21.15.17:0/88993811 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a2c03a070 con 0x562314bad0a0 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.227+0000 7f5a1bfff640 1 -- 172.21.15.17:0/88993811 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c004020 con 0x562314bad0a0 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/88993811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 msgr2=0x562314f939a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f939a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c003d40 tx=0x7f5a2c011870 comp rx=0 tx=0).stop 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/88993811 shutdown_connections 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bd5f60 0x562314f79600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bb5280 0x562314f93ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/88993811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bad0a0 0x562314f939a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/88993811 >> 172.21.15.17:0/88993811 conn(0x562314bca350 msgr2=0x562314f86000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/88993811 shutdown_connections 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/88993811 wait complete. 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 -- start start 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.228+0000 7f5a3ebd9740 1 Processor -- start 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314fa26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bb5280 0x562314fa2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 0x562314f9cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562314f99fb0 con 0x562314bd5f60 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562314f998e0 con 0x562314bb5280 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562314f9a680 con 0x562314bad0a0 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 10 client.0 _ll_register_callbacks cb 0x7f5a2c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:36.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 0x562314f9cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 0x562314f9cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60452/0 (socket says 172.21.15.17:60452) 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 -- 172.21.15.17:0/3078570278 learned_addr learned my addr 172.21.15.17:0/3078570278 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a35c00640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bb5280 0x562314fa2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36401640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314fa26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 -- 172.21.15.17:0/3078570278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 msgr2=0x562314fa26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314fa26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 -- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bb5280 msgr2=0x562314fa2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bb5280 0x562314fa2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 -- 172.21.15.17:0/3078570278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562314f9d300 con 0x562314bd5f60 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a36c02640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 0x562314f9cb70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5a28031040 tx=0x7f5a280ce0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a8d6a246a703ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:36.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a19ffb640 1 -- 172.21.15.17:0/3078570278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a280d7db0 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a19ffb640 1 -- 172.21.15.17:0/3078570278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f5a28004b40 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.229+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a2c03a070 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a19ffb640 1 -- 172.21.15.17:0/3078570278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a28044e70 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562315006020 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a19ffb640 1 -- 172.21.15.17:0/3078570278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a2c03a070 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a19ffb640 1 -- 172.21.15.17:0/3078570278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5a280cd880 con 0x562314bd5f60 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:12:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 10 client.15381 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 20 client.15381 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b69c90 0x562315009920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 4 client.15381 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "status"}) -- 0x562314ef1610 con 0x562314b69c90 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.230+0000 7f5a36401640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b69c90 0x562315009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a36401640 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b69c90 0x562315009920 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed099cc7f0056f17 server_cookie=86e3772a63bd460b in_seq=0 out_seq=0 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a19ffb640 10 client.15381 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a19ffb640 1 -- 172.21.15.17:0/3078570278 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562314ef1610 con 0x562314b69c90 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a19ffb640 10 client.15381 handle_command_reply: tid=0 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 client.15381 shutdown 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 msgr2=0x562314f9cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 0x562314f9cb70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5a28031040 tx=0x7f5a280ce0a0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 shutdown_connections 2024-09-21T06:12:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562314b69c90 0x562315009920 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562314bd5f60 0x562314f9cb70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562314bb5280 0x562314fa2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 --2- 172.21.15.17:0/3078570278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562314bad0a0 0x562314fa26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 >> 172.21.15.17:0/3078570278 conn(0x562314bca350 msgr2=0x562314f79600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a19ffb640 0 client.15381 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 shutdown_connections 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 1 -- 172.21.15.17:0/3078570278 wait complete. 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.231+0000 7f5a3ebd9740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:36.252 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24656, 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 138.68663614900001, 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 25, 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 149.45272816799999 2024-09-21T06:12:36.253 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f5a1c0b6590 msgr2=0x7f5a1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f5a1c0b6590 0x7f5a1c0b8aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x562314f7ab80 tx=0x7f5a2c005f90 comp rx=0 tx=0).stop 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 msgr2=0x7f5a3019fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a3019fbd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005cc0 tx=0x7f5a28003f90 comp rx=0 tx=0).stop 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 shutdown_connections 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f5a1c0b6590 0x7f5a1c0b8aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a30109e40 0x7f5a3019fbd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a301094f0 0x7f5a3019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 --2- 172.21.15.17:0/2316580416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a30103bb0 0x7f5a3019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 >> 172.21.15.17:0/2316580416 conn(0x7f5a300ff600 msgr2=0x7f5a30101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 shutdown_connections 2024-09-21T06:12:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:36.232+0000 7f5a38665640 1 -- 172.21.15.17:0/2316580416 wait complete. 2024-09-21T06:12:36.939 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T06:12:36.950 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T06:12:36.950 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T06:12:36.950 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-21T06:12:36.950 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:12:36.950 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:36.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:36.951 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-21T06:12:36.968 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T06:12:36.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:36.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:12:37.032 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:36 smithi017 ceph-mon[31080]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:37.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:37.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-21T06:12:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:36 smithi089 ceph-mon[33879]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:37.151 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T06:12:37.151 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T06:12:37.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T06:12:37.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:36 smithi081 ceph-mon[33870]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:37.410 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 -- 172.21.15.17:0/158537882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0109df0 msgr2=0x7fc4c0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/158537882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0109df0 0x7fc4c0110620 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009ca0 tx=0x7fc4b802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 -- 172.21.15.17:0/158537882 shutdown_connections 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/158537882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0109df0 0x7fc4c0110620 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/158537882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c01094a0 0x7fc4c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/158537882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c0103b60 0x7fc4c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 -- 172.21.15.17:0/158537882 >> 172.21.15.17:0/158537882 conn(0x7fc4c007b850 msgr2=0x7fc4c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 -- 172.21.15.17:0/158537882 shutdown_connections 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 -- 172.21.15.17:0/158537882 wait complete. 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.930+0000 7fc4c4c29640 1 Processor -- start 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 -- start start 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 0x7fc4c019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c01094a0 0x7fc4c019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0109df0 0x7fc4c019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01139b0 con 0x7fc4c0103b60 2024-09-21T06:12:37.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0113830 con 0x7fc4c01094a0 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4c4c29640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0113b30 con 0x7fc4c0109df0 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 0x7fc4c019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 0x7fc4c019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60482/0 (socket says 172.21.15.17:60482) 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 -- 172.21.15.17:0/1879254844 learned_addr learned my addr 172.21.15.17:0/1879254844 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4b7fff640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c01094a0 0x7fc4c019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4bed9d640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0109df0 0x7fc4c019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 -- 172.21.15.17:0/1879254844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0109df0 msgr2=0x7fc4c019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0109df0 0x7fc4c019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 -- 172.21.15.17:0/1879254844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c01094a0 msgr2=0x7fc4c019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c01094a0 0x7fc4c019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.931+0000 7fc4be59c640 1 -- 172.21.15.17:0/1879254844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c01a0310 con 0x7fc4c0103b60 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.932+0000 7fc4be59c640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 0x7fc4c019a3a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d950 tx=0x7fc4b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.932+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0017070 con 0x7fc4c0103b60 2024-09-21T06:12:37.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.932+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4b0009c30 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.932+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c01a0600 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.932+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000f620 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.932+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c01a6d60 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.933+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c0103f70 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.935+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc4b0005030 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.936+0000 7fc4b77fe640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc4ac0b6590 0x7fc4ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.936+0000 7fc4b7fff640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc4ac0b6590 0x7fc4ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.936+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fc4b00e7240 con 0x7fc4c0103b60 2024-09-21T06:12:37.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.937+0000 7fc4b7fff640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc4ac0b6590 0x7fc4ac0b8aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0107160 tx=0x7fc4a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:37.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:37.940+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4b00ad760 con 0x7fc4c0103b60 2024-09-21T06:12:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.167+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4c002e640 con 0x7fc4c0103b60 2024-09-21T06:12:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.168+0000 7fc4b77fe640 1 -- 172.21.15.17:0/1879254844 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7fc4b0009de0 con 0x7fc4c0103b60 2024-09-21T06:12:38.170 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:12:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc4ac0b6590 msgr2=0x7fc4ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc4ac0b6590 0x7fc4ac0b8aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0107160 tx=0x7fc4a800b410 comp rx=0 tx=0).stop 2024-09-21T06:12:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 msgr2=0x7fc4c019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 0x7fc4c019a3a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d950 tx=0x7fc4b000de10 comp rx=0 tx=0).stop 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 shutdown_connections 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fc4ac0b6590 0x7fc4ac0b8aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0109df0 0x7fc4c019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4c01094a0 0x7fc4c019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 --2- 172.21.15.17:0/1879254844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4c0103b60 0x7fc4c019a3a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 >> 172.21.15.17:0/1879254844 conn(0x7fc4c007b850 msgr2=0x7fc4c01054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 shutdown_connections 2024-09-21T06:12:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:38.170+0000 7fc4c4c29640 1 -- 172.21.15.17:0/1879254844 wait complete. 2024-09-21T06:12:38.869 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:38 smithi017 ceph-mon[31080]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:38.870 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:38 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1879254844' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:12:38.901 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:12:38.902 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:12:38.902 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:12:38.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:38.902 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-21T06:12:38.920 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:12:38.921 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42118sec preferred_lft 42118sec 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:12:38.922 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-21T06:12:38.922 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:12:38.922 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:12:38.923 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:12:38.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:12:38.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-21T06:12:38.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-21T06:12:38.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:12:38.923 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:12:39.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:12:39.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:39.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:39.069 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:12:39.094 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-21T06:12:39.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:39.096 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-21T06:12:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:38 smithi089 ceph-mon[33879]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:38 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1879254844' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:12:39.153 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-21T06:12:39.153 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:12:39.153 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T06:12:39.153 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T06:12:39.153 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:12:39.154 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:12:39.154 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:12:39.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T06:12:39.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T06:12:39.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T06:12:39.154 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:12:39.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:12:39.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:38 smithi081 ceph-mon[33870]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:12:39.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:38 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1879254844' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:12:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:39.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:39.283 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-21T06:12:39.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:39.300 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-21T06:12:39.356 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:12:39.356 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:12:39.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:39.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:12:39.356 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:12:39.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:12:39.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:39.476 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:12:39.477 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:12:39.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:12:39.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:39.596 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:12:39.596 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-21T06:12:39.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-21T06:12:39.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:12:39.596 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-21T06:12:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:12:39.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:39.675 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-21T06:12:39.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:12:39.675 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:39.691 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:12:39.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:12:39.691 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:39.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-21T06:12:39.814 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-21T06:12:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:12:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0fb66eb7e22b894c0be8f4c043f772073f61b190582bd94c6fd74f53fa049a39/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/a59bf23c5fa1d3a3e1dc6c6e88f96b5a71fff510acc583b3e2f54a1dbf1a83da/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f48b8bf5180f530deb86eb3fe5e7bbeacfdcb5084311763c09756df80051576/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/55ad209a74bb6d967e997c1eafcecc32c449fddbab9b596bb5e6d37bcf4290c4/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6d1e4e4b2622105eff3086a2515232f383de93b8a23ac352e22c187589d5a87e/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/28d07ea1c7d1f2fe4a02e9bcffb01bbe8926b9b4067c35b4b4ffb4d7377e9d64/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6aa0e85692310b56b099c79814d404bc7e2f718d517d1896484241fd3f9b8e9e/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e8fe9fd427f979cc878775012cfe91ad8d0015df9d47975bc075bb9bc5d07807/merged 2024-09-21T06:12:39.873 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eaba1a93d1e3a87c691933777c14d6c1a8dc9cd8f8dddb9aa62f8539d2ac5f88/merged 2024-09-21T06:12:39.874 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/654aa8e9c4191d0b67711a7338f002fe0715925321955d8a330644bc0299c3c6/merged 2024-09-21T06:12:39.874 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-21T06:12:39.874 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:39.874 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:39.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:39.874 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-21T06:12:39.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T06:12:39.927 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/d5efea2b-aa59-44db-b6b8-34a1fe3caa14 --client_fs=cephfs) 2024-09-21T06:12:39.970 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-21T06:12:39.996 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:12:40.054 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-21T06:12:40.054 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-21T06:12:40.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0fb66eb7e22b894c0be8f4c043f772073f61b190582bd94c6fd74f53fa049a39/merged 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/a59bf23c5fa1d3a3e1dc6c6e88f96b5a71fff510acc583b3e2f54a1dbf1a83da/merged 2024-09-21T06:12:40.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f48b8bf5180f530deb86eb3fe5e7bbeacfdcb5084311763c09756df80051576/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/55ad209a74bb6d967e997c1eafcecc32c449fddbab9b596bb5e6d37bcf4290c4/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6d1e4e4b2622105eff3086a2515232f383de93b8a23ac352e22c187589d5a87e/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/28d07ea1c7d1f2fe4a02e9bcffb01bbe8926b9b4067c35b4b4ffb4d7377e9d64/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6aa0e85692310b56b099c79814d404bc7e2f718d517d1896484241fd3f9b8e9e/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e8fe9fd427f979cc878775012cfe91ad8d0015df9d47975bc075bb9bc5d07807/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eaba1a93d1e3a87c691933777c14d6c1a8dc9cd8f8dddb9aa62f8539d2ac5f88/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/654aa8e9c4191d0b67711a7338f002fe0715925321955d8a330644bc0299c3c6/merged 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:40.057 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:40.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:40.058 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-21T06:12:40.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-21T06:12:40.061+0000 7ff266887480 -1 init, newargv = 0x7ff254056f60 newargc=15 2024-09-21T06:12:40.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[85618]: starting ceph client 2024-09-21T06:12:40.081 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[85618]: starting fuse 2024-09-21T06:12:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:40 smithi089 ceph-mon[33879]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:41.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:40 smithi017 ceph-mon[31080]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:41.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-21T06:12:41.214 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:12:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:40 smithi081 ceph-mon[33870]: pgmap v371: 129 pgs: 129 active+clean; 645 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:12:41.274 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-21T06:12:41.274 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-21T06:12:41.274 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-21T06:12:41.274 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-21T06:12:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0fb66eb7e22b894c0be8f4c043f772073f61b190582bd94c6fd74f53fa049a39/merged 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/a59bf23c5fa1d3a3e1dc6c6e88f96b5a71fff510acc583b3e2f54a1dbf1a83da/merged 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-21T06:12:41.276 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f48b8bf5180f530deb86eb3fe5e7bbeacfdcb5084311763c09756df80051576/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/55ad209a74bb6d967e997c1eafcecc32c449fddbab9b596bb5e6d37bcf4290c4/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6d1e4e4b2622105eff3086a2515232f383de93b8a23ac352e22c187589d5a87e/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/28d07ea1c7d1f2fe4a02e9bcffb01bbe8926b9b4067c35b4b4ffb4d7377e9d64/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6aa0e85692310b56b099c79814d404bc7e2f718d517d1896484241fd3f9b8e9e/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e8fe9fd427f979cc878775012cfe91ad8d0015df9d47975bc075bb9bc5d07807/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eaba1a93d1e3a87c691933777c14d6c1a8dc9cd8f8dddb9aa62f8539d2ac5f88/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/654aa8e9c4191d0b67711a7338f002fe0715925321955d8a330644bc0299c3c6/merged 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:12:41.277 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:41.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:41.278 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-21T06:12:41.333 INFO:teuthology.orchestra.run.smithi017.stdout:120 2024-09-21T06:12:41.333 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T06:12:41.334 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-21T06:12:41.335 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-21T06:12:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.85618.asok 2024-09-21T06:12:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:12:41.476 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85618.asok 2024-09-21T06:12:41.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:41.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85618.asok status 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "85618", 2024-09-21T06:12:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/volumes/qa/sv_0/d5efea2b-aa59-44db-b6b8-34a1fe3caa14" 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 15393, 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 15393 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 965959337 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:12:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 965959337 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.15393 192.168.0.1:0/965959337", 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/965959337", 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 5, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 25, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 84, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-21T06:12:41.627 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:41.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:41.634 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-21T06:12:41.634 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:41.651 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-21T06:12:41.651 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:41.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:12:41.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:41.719 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:12:41.728 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:12:41.729 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T06:12:41.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T06:12:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 -- 172.21.15.17:0/1684904810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 msgr2=0x7f7c4c104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 --2- 172.21.15.17:0/1684904810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c104b50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009900 tx=0x7f7c3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:12:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 -- 172.21.15.17:0/1684904810 shutdown_connections 2024-09-21T06:12:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 --2- 172.21.15.17:0/1684904810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c104b50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 --2- 172.21.15.17:0/1684904810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 0x7f7c4c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 --2- 172.21.15.17:0/1684904810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 0x7f7c4c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.871+0000 7f7c5334a640 1 -- 172.21.15.17:0/1684904810 >> 172.21.15.17:0/1684904810 conn(0x7f7c4c0ff020 msgr2=0x7f7c4c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 -- 172.21.15.17:0/1684904810 shutdown_connections 2024-09-21T06:12:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 -- 172.21.15.17:0/1684904810 wait complete. 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 Processor -- start 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 -- start start 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 0x7f7c4c19c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 0x7f7c4c19d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c10f220 con 0x7f7c4c104740 2024-09-21T06:12:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c10f0a0 con 0x7f7c4c1036c0 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.872+0000 7f7c5334a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c10f3a0 con 0x7f7c4c1050e0 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c19c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58802/0 (socket says 172.21.15.17:58802) 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 -- 172.21.15.17:0/107341184 learned_addr learned my addr 172.21.15.17:0/107341184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c510e6640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 0x7f7c4c19c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c518e7640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 0x7f7c4c19d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 -- 172.21.15.17:0/107341184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 msgr2=0x7f7c4c19d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 0x7f7c4c19d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 -- 172.21.15.17:0/107341184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 msgr2=0x7f7c4c19c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 0x7f7c4c19c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 -- 172.21.15.17:0/107341184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c19db60 con 0x7f7c4c104740 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c510e6640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 0x7f7c4c19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c518e7640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 0x7f7c4c19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c508e5640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c19c790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009230 tx=0x7f7c3c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c03f030 con 0x7f7c4c104740 2024-09-21T06:12:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c19ddf0 con 0x7f7c4c104740 2024-09-21T06:12:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c3c003c90 con 0x7f7c4c104740 2024-09-21T06:12:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c035070 con 0x7f7c4c104740 2024-09-21T06:12:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.873+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a4540 con 0x7f7c4c104740 2024-09-21T06:12:41.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.874+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c1a4710 con 0x7f7c4c104740 2024-09-21T06:12:41.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.876+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7c3c042030 con 0x7f7c4c104740 2024-09-21T06:12:41.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.877+0000 7f7c427fc640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c380b6510 0x7f7c380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:41.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.877+0000 7f7c510e6640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c380b6510 0x7f7c380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:41.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.877+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f7c3c1082f0 con 0x7f7c4c104740 2024-09-21T06:12:41.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.877+0000 7f7c510e6640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c380b6510 0x7f7c380b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c480058c0 tx=0x7f7c48005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:41.880+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c3c0ce790 con 0x7f7c4c104740 2024-09-21T06:12:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.109+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f7c4c1a48e0 con 0x7f7c4c104740 2024-09-21T06:12:42.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.786+0000 7f7c427fc640 1 -- 172.21.15.17:0/107341184 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f7c3c0d2b70 con 0x7f7c4c104740 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c380b6510 msgr2=0x7f7c380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c380b6510 0x7f7c380b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c480058c0 tx=0x7f7c48005d30 comp rx=0 tx=0).stop 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 msgr2=0x7f7c4c19c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c19c790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009230 tx=0x7f7c3c004360 comp rx=0 tx=0).stop 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 shutdown_connections 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7c380b6510 0x7f7c380b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c104740 0x7f7c4c19c790 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c4c1050e0 0x7f7c4c19d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 --2- 172.21.15.17:0/107341184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4c1036c0 0x7f7c4c19c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.788+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 >> 172.21.15.17:0/107341184 conn(0x7f7c4c0ff020 msgr2=0x7f7c4c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.789+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 shutdown_connections 2024-09-21T06:12:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:42.789+0000 7f7c5334a640 1 -- 172.21.15.17:0/107341184 wait complete. 2024-09-21T06:12:42.807 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T06:12:42.817 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T06:12:42.828 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:12:42.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:12:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:42 smithi089 ceph-mon[33879]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:12:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:42 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/107341184' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:12:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:42 smithi017 ceph-mon[31080]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:12:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:42 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/107341184' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:12:43.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:42 smithi081 ceph-mon[33870]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:12:43.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:42 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/107341184' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:12:43.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 -- 172.21.15.17:0/2380132041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 msgr2=0x7ff914110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 --2- 172.21.15.17:0/2380132041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff914110620 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009ca0 tx=0x7ff90c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 -- 172.21.15.17:0/2380132041 shutdown_connections 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 --2- 172.21.15.17:0/2380132041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff914110620 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 --2- 172.21.15.17:0/2380132041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9141094a0 0x7ff9141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 --2- 172.21.15.17:0/2380132041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff914103b60 0x7ff914103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 -- 172.21.15.17:0/2380132041 >> 172.21.15.17:0/2380132041 conn(0x7ff91407b850 msgr2=0x7ff91407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 -- 172.21.15.17:0/2380132041 shutdown_connections 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.576+0000 7ff91c72f640 1 -- 172.21.15.17:0/2380132041 wait complete. 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 Processor -- start 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 -- start start 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914103b60 0x7ff91419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141094a0 0x7ff91419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff91419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141139b0 con 0x7ff914109df0 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff914113830 con 0x7ff914103b60 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91c72f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff914113b30 con 0x7ff9141094a0 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91accc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff91419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91accc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff91419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58820/0 (socket says 172.21.15.17:58820) 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91accc640 1 -- 172.21.15.17:0/419438756 learned_addr learned my addr 172.21.15.17:0/419438756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff91a4cb640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914103b60 0x7ff91419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.577+0000 7ff919cca640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141094a0 0x7ff91419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91accc640 1 -- 172.21.15.17:0/419438756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141094a0 msgr2=0x7ff91419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91accc640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141094a0 0x7ff91419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91accc640 1 -- 172.21.15.17:0/419438756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914103b60 msgr2=0x7ff91419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91accc640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914103b60 0x7ff91419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91accc640 1 -- 172.21.15.17:0/419438756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9141a0430 con 0x7ff914109df0 2024-09-21T06:12:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91accc640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff91419fd00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff90c005cc0 tx=0x7ff90c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c032e00 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9141a06c0 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff90c0044d0 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c030b70 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.578+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141a6e80 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.579+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff914104de0 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.581+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff90c004680 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.582+0000 7ff90b7fe640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff9000b6510 0x7ff9000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.582+0000 7ff91a4cb640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff9000b6510 0x7ff9000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.582+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff90c108860 con 0x7ff914109df0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.582+0000 7ff91a4cb640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff9000b6510 0x7ff9000b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff910005fd0 tx=0x7ff91000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:43.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.586+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff90c0ced60 con 0x7ff914109df0 2024-09-21T06:12:43.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.772+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff914063800 con 0x7ff9000b6510 2024-09-21T06:12:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.778+0000 7ff90b7fe640 1 -- 172.21.15.17:0/419438756 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340689 (secure 0 0 0) 0x7ff914063800 con 0x7ff9000b6510 2024-09-21T06:12:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff9000b6510 msgr2=0x7ff9000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff9000b6510 0x7ff9000b8a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff910005fd0 tx=0x7ff91000b390 comp rx=0 tx=0).stop 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 msgr2=0x7ff91419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff91419fd00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff90c005cc0 tx=0x7ff90c032a10 comp rx=0 tx=0).stop 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 shutdown_connections 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff9000b6510 0x7ff9000b8a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff914109df0 0x7ff91419fd00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9141094a0 0x7ff91419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 --2- 172.21.15.17:0/419438756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914103b60 0x7ff91419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 >> 172.21.15.17:0/419438756 conn(0x7ff91407b850 msgr2=0x7ff914105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 shutdown_connections 2024-09-21T06:12:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:43.781+0000 7ff91c72f640 1 -- 172.21.15.17:0/419438756 wait complete. 2024-09-21T06:12:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:43 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/107341184' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:12:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:43 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:12:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:43 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/107341184' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:12:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:43 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:12:44.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:43 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/107341184' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:12:44.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:43 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:12:44.526 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-21T06:12:43.165378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662152,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":710,"num_read_kb":454,"num_write":303,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372944,"kb_used_data":11216,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568880,"statfs":{"total":1151940427776,"available":1151558533120,"internally_reserved":0,"allocated":11485184,"data_stored":7642652,"data_compressed":461643,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1479,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003651"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888698+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:11:47.888698+0000","last_peered":"2024-09-21T06:11:47.888698+0000","last_clean":"2024-09-21T06:11:47.888698+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:11:47.888698+0000","last_undegraded":"2024-09-21T06:11:47.888698+0000","last_fullsized":"2024-09-21T06:11:47.888698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515378+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:12:15.515378+0000","last_peered":"2024-09-21T06:12:15.515378+0000","last_clean":"2024-09-21T06:12:15.515378+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:12:15.515378+0000","last_undegraded":"2024-09-21T06:12:15.515378+0000","last_fullsized":"2024-09-21T06:12:15.515378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683054+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:11:47.683054+0000","last_peered":"2024-09-21T06:11:47.683054+0000","last_clean":"2024-09-21T06:11:47.683054+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:11:47.683054+0000","last_undegraded":"2024-09-21T06:11:47.683054+0000","last_fullsized":"2024-09-21T06:11:47.683054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684717+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:11:47.684717+0000","last_peered":"2024-09-21T06:11:47.684717+0000","last_clean":"2024-09-21T06:11:47.684717+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:11:47.684717+0000","last_undegraded":"2024-09-21T06:11:47.684717+0000","last_fullsized":"2024-09-21T06:11:47.684717+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528390+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:12:15.528390+0000","last_peered":"2024-09-21T06:12:15.528390+0000","last_clean":"2024-09-21T06:12:15.528390+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:12:15.528390+0000","last_undegraded":"2024-09-21T06:12:15.528390+0000","last_fullsized":"2024-09-21T06:12:15.528390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766526+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:11:47.766526+0000","last_peered":"2024-09-21T06:11:47.766526+0000","last_clean":"2024-09-21T06:11:47.766526+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:11:47.766526+0000","last_undegraded":"2024-09-21T06:11:47.766526+0000","last_fullsized":"2024-09-21T06:11:47.766526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685224+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:11:47.685224+0000","last_peered":"2024-09-21T06:11:47.685224+0000","last_clean":"2024-09-21T06:11:47.685224+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:11:47.685224+0000","last_undegraded":"2024-09-21T06:11:47.685224+0000","last_fullsized":"2024-09-21T06:11:47.685224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528030+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:12:15.528030+0000","last_peered":"2024-09-21T06:12:15.528030+0000","last_clean":"2024-09-21T06:12:15.528030+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:12:15.528030+0000","last_undegraded":"2024-09-21T06:12:15.528030+0000","last_fullsized":"2024-09-21T06:12:15.528030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766810+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:11:47.766810+0000","last_peered":"2024-09-21T06:11:47.766810+0000","last_clean":"2024-09-21T06:11:47.766810+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:11:47.766810+0000","last_undegraded":"2024-09-21T06:11:47.766810+0000","last_fullsized":"2024-09-21T06:11:47.766810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685451+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:11:47.685451+0000","last_peered":"2024-09-21T06:11:47.685451+0000","last_clean":"2024-09-21T06:11:47.685451+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:11:47.685451+0000","last_undegraded":"2024-09-21T06:11:47.685451+0000","last_fullsized":"2024-09-21T06:11:47.685451+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.533593+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:12:15.533593+0000","last_peered":"2024-09-21T06:12:15.533593+0000","last_clean":"2024-09-21T06:12:15.533593+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:12:15.533593+0000","last_undegraded":"2024-09-21T06:12:15.533593+0000","last_fullsized":"2024-09-21T06:12:15.533593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766802+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:11:47.766802+0000","last_peered":"2024-09-21T06:11:47.766802+0000","last_clean":"2024-09-21T06:11:47.766802+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:11:47.766802+0000","last_undegraded":"2024-09-21T06:11:47.766802+0000","last_fullsized":"2024-09-21T06:11:47.766802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530716+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:12:15.530716+0000","last_peered":"2024-09-21T06:12:15.530716+0000","last_clean":"2024-09-21T06:12:15.530716+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:12:15.530716+0000","last_undegraded":"2024-09-21T06:12:15.530716+0000","last_fullsized":"2024-09-21T06:12:15.530716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684943+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:11:47.684943+0000","last_peered":"2024-09-21T06:11:47.684943+0000","last_clean":"2024-09-21T06:11:47.684943+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:11:47.684943+0000","last_undegraded":"2024-09-21T06:11:47.684943+0000","last_fullsized":"2024-09-21T06:11:47.684943+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767278+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:11:47.767278+0000","last_peered":"2024-09-21T06:11:47.767278+0000","last_clean":"2024-09-21T06:11:47.767278+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:11:47.767278+0000","last_undegraded":"2024-09-21T06:11:47.767278+0000","last_fullsized":"2024-09-21T06:11:47.767278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529637+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:12:15.529637+0000","last_peered":"2024-09-21T06:12:15.529637+0000","last_clean":"2024-09-21T06:12:15.529637+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:12:15.529637+0000","last_undegraded":"2024-09-21T06:12:15.529637+0000","last_fullsized":"2024-09-21T06:12:15.529637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:51.194821+0000","last_change":"2024-09-21T06:11:47.688842+0000","last_active":"2024-09-21T06:11:51.194821+0000","last_peered":"2024-09-21T06:11:51.194821+0000","last_clean":"2024-09-21T06:11:51.194821+0000","last_became_active":"2024-09-21T06:11:47.685980+0000","last_became_peered":"2024-09-21T06:11:47.685980+0000","last_unstale":"2024-09-21T06:11:51.194821+0000","last_undegraded":"2024-09-21T06:11:51.194821+0000","last_fullsized":"2024-09-21T06:11:51.194821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:40.815179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767157+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:11:47.767157+0000","last_peered":"2024-09-21T06:11:47.767157+0000","last_clean":"2024-09-21T06:11:47.767157+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:11:47.767157+0000","last_undegraded":"2024-09-21T06:11:47.767157+0000","last_fullsized":"2024-09-21T06:11:47.767157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520061+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:12:15.520061+0000","last_peered":"2024-09-21T06:12:15.520061+0000","last_clean":"2024-09-21T06:12:15.520061+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:12:15.520061+0000","last_undegraded":"2024-09-21T06:12:15.520061+0000","last_fullsized":"2024-09-21T06:12:15.520061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684702+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:11:47.684702+0000","last_peered":"2024-09-21T06:11:47.684702+0000","last_clean":"2024-09-21T06:11:47.684702+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:11:47.684702+0000","last_undegraded":"2024-09-21T06:11:47.684702+0000","last_fullsized":"2024-09-21T06:11:47.684702+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684970+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:11:47.684970+0000","last_peered":"2024-09-21T06:11:47.684970+0000","last_clean":"2024-09-21T06:11:47.684970+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:11:47.684970+0000","last_undegraded":"2024-09-21T06:11:47.684970+0000","last_fullsized":"2024-09-21T06:11:47.684970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511365+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:12:15.511365+0000","last_peered":"2024-09-21T06:12:15.511365+0000","last_clean":"2024-09-21T06:12:15.511365+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:12:15.511365+0000","last_undegraded":"2024-09-21T06:12:15.511365+0000","last_fullsized":"2024-09-21T06:12:15.511365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678082+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:11:47.678082+0000","last_peered":"2024-09-21T06:11:47.678082+0000","last_clean":"2024-09-21T06:11:47.678082+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:11:47.678082+0000","last_undegraded":"2024-09-21T06:11:47.678082+0000","last_fullsized":"2024-09-21T06:11:47.678082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767365+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:11:47.767365+0000","last_peered":"2024-09-21T06:11:47.767365+0000","last_clean":"2024-09-21T06:11:47.767365+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:11:47.767365+0000","last_undegraded":"2024-09-21T06:11:47.767365+0000","last_fullsized":"2024-09-21T06:11:47.767365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526493+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:12:15.526493+0000","last_peered":"2024-09-21T06:12:15.526493+0000","last_clean":"2024-09-21T06:12:15.526493+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:12:15.526493+0000","last_undegraded":"2024-09-21T06:12:15.526493+0000","last_fullsized":"2024-09-21T06:12:15.526493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767552+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:11:47.767552+0000","last_peered":"2024-09-21T06:11:47.767552+0000","last_clean":"2024-09-21T06:11:47.767552+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:11:47.767552+0000","last_undegraded":"2024-09-21T06:11:47.767552+0000","last_fullsized":"2024-09-21T06:11:47.767552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683342+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:11:47.683342+0000","last_peered":"2024-09-21T06:11:47.683342+0000","last_clean":"2024-09-21T06:11:47.683342+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:11:47.683342+0000","last_undegraded":"2024-09-21T06:11:47.683342+0000","last_fullsized":"2024-09-21T06:11:47.683342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.516838+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:12:15.516838+0000","last_peered":"2024-09-21T06:12:15.516838+0000","last_clean":"2024-09-21T06:12:15.516838+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:12:15.516838+0000","last_undegraded":"2024-09-21T06:12:15.516838+0000","last_fullsized":"2024-09-21T06:12:15.516838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'12","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.569272+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:12:15.569272+0000","last_peered":"2024-09-21T06:12:15.569272+0000","last_clean":"2024-09-21T06:12:15.569272+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:12:15.569272+0000","last_undegraded":"2024-09-21T06:12:15.569272+0000","last_fullsized":"2024-09-21T06:12:15.569272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684254+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:11:47.684254+0000","last_peered":"2024-09-21T06:11:47.684254+0000","last_clean":"2024-09-21T06:11:47.684254+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:11:47.684254+0000","last_undegraded":"2024-09-21T06:11:47.684254+0000","last_fullsized":"2024-09-21T06:11:47.684254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.508678+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:12:15.508678+0000","last_peered":"2024-09-21T06:12:15.508678+0000","last_clean":"2024-09-21T06:12:15.508678+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:12:15.508678+0000","last_undegraded":"2024-09-21T06:12:15.508678+0000","last_fullsized":"2024-09-21T06:12:15.508678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685479+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:11:47.685479+0000","last_peered":"2024-09-21T06:11:47.685479+0000","last_clean":"2024-09-21T06:11:47.685479+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:11:47.685479+0000","last_undegraded":"2024-09-21T06:11:47.685479+0000","last_fullsized":"2024-09-21T06:11:47.685479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682161+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:11:47.682161+0000","last_peered":"2024-09-21T06:11:47.682161+0000","last_clean":"2024-09-21T06:11:47.682161+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:11:47.682161+0000","last_undegraded":"2024-09-21T06:11:47.682161+0000","last_fullsized":"2024-09-21T06:11:47.682161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517397+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:12:15.517397+0000","last_peered":"2024-09-21T06:12:15.517397+0000","last_clean":"2024-09-21T06:12:15.517397+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:12:15.517397+0000","last_undegraded":"2024-09-21T06:12:15.517397+0000","last_fullsized":"2024-09-21T06:12:15.517397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888263+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:11:47.888263+0000","last_peered":"2024-09-21T06:11:47.888263+0000","last_clean":"2024-09-21T06:11:47.888263+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:11:47.888263+0000","last_undegraded":"2024-09-21T06:11:47.888263+0000","last_fullsized":"2024-09-21T06:11:47.888263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685148+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:11:47.685148+0000","last_peered":"2024-09-21T06:11:47.685148+0000","last_clean":"2024-09-21T06:11:47.685148+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:11:47.685148+0000","last_undegraded":"2024-09-21T06:11:47.685148+0000","last_fullsized":"2024-09-21T06:11:47.685148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.527626+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:12:15.527626+0000","last_peered":"2024-09-21T06:12:15.527626+0000","last_clean":"2024-09-21T06:12:15.527626+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:12:15.527626+0000","last_undegraded":"2024-09-21T06:12:15.527626+0000","last_fullsized":"2024-09-21T06:12:15.527626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680958+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:11:47.680958+0000","last_peered":"2024-09-21T06:11:47.680958+0000","last_clean":"2024-09-21T06:11:47.680958+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:11:47.680958+0000","last_undegraded":"2024-09-21T06:11:47.680958+0000","last_fullsized":"2024-09-21T06:11:47.680958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677491+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:11:47.677491+0000","last_peered":"2024-09-21T06:11:47.677491+0000","last_clean":"2024-09-21T06:11:47.677491+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:11:47.677491+0000","last_undegraded":"2024-09-21T06:11:47.677491+0000","last_fullsized":"2024-09-21T06:11:47.677491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511982+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:12:15.511982+0000","last_peered":"2024-09-21T06:12:15.511982+0000","last_clean":"2024-09-21T06:12:15.511982+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:12:15.511982+0000","last_undegraded":"2024-09-21T06:12:15.511982+0000","last_fullsized":"2024-09-21T06:12:15.511982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:36.890747+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:12:36.890747+0000","last_peered":"2024-09-21T06:12:36.890747+0000","last_clean":"2024-09-21T06:12:36.890747+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:12:36.890747+0000","last_undegraded":"2024-09-21T06:12:36.890747+0000","last_fullsized":"2024-09-21T06:12:36.890747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677750+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:11:47.677750+0000","last_peered":"2024-09-21T06:11:47.677750+0000","last_clean":"2024-09-21T06:11:47.677750+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:11:47.677750+0000","last_undegraded":"2024-09-21T06:11:47.677750+0000","last_fullsized":"2024-09-21T06:11:47.677750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.518463+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:12:15.518463+0000","last_peered":"2024-09-21T06:12:15.518463+0000","last_clean":"2024-09-21T06:12:15.518463+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:12:15.518463+0000","last_undegraded":"2024-09-21T06:12:15.518463+0000","last_fullsized":"2024-09-21T06:12:15.518463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680635+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:11:47.680635+0000","last_peered":"2024-09-21T06:11:47.680635+0000","last_clean":"2024-09-21T06:11:47.680635+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:11:47.680635+0000","last_undegraded":"2024-09-21T06:11:47.680635+0000","last_fullsized":"2024-09-21T06:11:47.680635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678849+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:11:47.678849+0000","last_peered":"2024-09-21T06:11:47.678849+0000","last_clean":"2024-09-21T06:11:47.678849+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:11:47.678849+0000","last_undegraded":"2024-09-21T06:11:47.678849+0000","last_fullsized":"2024-09-21T06:11:47.678849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.525129+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:12:15.525129+0000","last_peered":"2024-09-21T06:12:15.525129+0000","last_clean":"2024-09-21T06:12:15.525129+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:12:15.525129+0000","last_undegraded":"2024-09-21T06:12:15.525129+0000","last_fullsized":"2024-09-21T06:12:15.525129+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767139+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:11:47.767139+0000","last_peered":"2024-09-21T06:11:47.767139+0000","last_clean":"2024-09-21T06:11:47.767139+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:11:47.767139+0000","last_undegraded":"2024-09-21T06:11:47.767139+0000","last_fullsized":"2024-09-21T06:11:47.767139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681028+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:11:47.681028+0000","last_peered":"2024-09-21T06:11:47.681028+0000","last_clean":"2024-09-21T06:11:47.681028+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:11:47.681028+0000","last_undegraded":"2024-09-21T06:11:47.681028+0000","last_fullsized":"2024-09-21T06:11:47.681028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681244+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:11:47.681244+0000","last_peered":"2024-09-21T06:11:47.681244+0000","last_clean":"2024-09-21T06:11:47.681244+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:11:47.681244+0000","last_undegraded":"2024-09-21T06:11:47.681244+0000","last_fullsized":"2024-09-21T06:11:47.681244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.531491+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:12:15.531491+0000","last_peered":"2024-09-21T06:12:15.531491+0000","last_clean":"2024-09-21T06:12:15.531491+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:12:15.531491+0000","last_undegraded":"2024-09-21T06:12:15.531491+0000","last_fullsized":"2024-09-21T06:12:15.531491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684700+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:11:47.684700+0000","last_peered":"2024-09-21T06:11:47.684700+0000","last_clean":"2024-09-21T06:11:47.684700+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:11:47.684700+0000","last_undegraded":"2024-09-21T06:11:47.684700+0000","last_fullsized":"2024-09-21T06:11:47.684700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678062+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:11:47.678062+0000","last_peered":"2024-09-21T06:11:47.678062+0000","last_clean":"2024-09-21T06:11:47.678062+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:11:47.678062+0000","last_undegraded":"2024-09-21T06:11:47.678062+0000","last_fullsized":"2024-09-21T06:11:47.678062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.522370+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:12:15.522370+0000","last_peered":"2024-09-21T06:12:15.522370+0000","last_clean":"2024-09-21T06:12:15.522370+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:12:15.522370+0000","last_undegraded":"2024-09-21T06:12:15.522370+0000","last_fullsized":"2024-09-21T06:12:15.522370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678990+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:11:47.678990+0000","last_peered":"2024-09-21T06:11:47.678990+0000","last_clean":"2024-09-21T06:11:47.678990+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:11:47.678990+0000","last_undegraded":"2024-09-21T06:11:47.678990+0000","last_fullsized":"2024-09-21T06:11:47.678990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953477+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:11:47.953477+0000","last_peered":"2024-09-21T06:11:47.953477+0000","last_clean":"2024-09-21T06:11:47.953477+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:11:47.953477+0000","last_undegraded":"2024-09-21T06:11:47.953477+0000","last_fullsized":"2024-09-21T06:11:47.953477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.522892+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:12:15.522892+0000","last_peered":"2024-09-21T06:12:15.522892+0000","last_clean":"2024-09-21T06:12:15.522892+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:12:15.522892+0000","last_undegraded":"2024-09-21T06:12:15.522892+0000","last_fullsized":"2024-09-21T06:12:15.522892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677748+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:11:47.677748+0000","last_peered":"2024-09-21T06:11:47.677748+0000","last_clean":"2024-09-21T06:11:47.677748+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:11:47.677748+0000","last_undegraded":"2024-09-21T06:11:47.677748+0000","last_fullsized":"2024-09-21T06:11:47.677748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678099+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:11:47.678099+0000","last_peered":"2024-09-21T06:11:47.678099+0000","last_clean":"2024-09-21T06:11:47.678099+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:11:47.678099+0000","last_undegraded":"2024-09-21T06:11:47.678099+0000","last_fullsized":"2024-09-21T06:11:47.678099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526693+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:12:15.526693+0000","last_peered":"2024-09-21T06:12:15.526693+0000","last_clean":"2024-09-21T06:12:15.526693+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:12:15.526693+0000","last_undegraded":"2024-09-21T06:12:15.526693+0000","last_fullsized":"2024-09-21T06:12:15.526693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682618+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:11:47.682618+0000","last_peered":"2024-09-21T06:11:47.682618+0000","last_clean":"2024-09-21T06:11:47.682618+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:11:47.682618+0000","last_undegraded":"2024-09-21T06:11:47.682618+0000","last_fullsized":"2024-09-21T06:11:47.682618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678272+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:11:47.678272+0000","last_peered":"2024-09-21T06:11:47.678272+0000","last_clean":"2024-09-21T06:11:47.678272+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:11:47.678272+0000","last_undegraded":"2024-09-21T06:11:47.678272+0000","last_fullsized":"2024-09-21T06:11:47.678272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532907+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:12:15.532907+0000","last_peered":"2024-09-21T06:12:15.532907+0000","last_clean":"2024-09-21T06:12:15.532907+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:12:15.532907+0000","last_undegraded":"2024-09-21T06:12:15.532907+0000","last_fullsized":"2024-09-21T06:12:15.532907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685080+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:11:47.685080+0000","last_peered":"2024-09-21T06:11:47.685080+0000","last_clean":"2024-09-21T06:11:47.685080+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:11:47.685080+0000","last_undegraded":"2024-09-21T06:11:47.685080+0000","last_fullsized":"2024-09-21T06:11:47.685080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677637+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:11:47.677637+0000","last_peered":"2024-09-21T06:11:47.677637+0000","last_clean":"2024-09-21T06:11:47.677637+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:11:47.677637+0000","last_undegraded":"2024-09-21T06:11:47.677637+0000","last_fullsized":"2024-09-21T06:11:47.677637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529962+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:12:15.529962+0000","last_peered":"2024-09-21T06:12:15.529962+0000","last_clean":"2024-09-21T06:12:15.529962+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:12:15.529962+0000","last_undegraded":"2024-09-21T06:12:15.529962+0000","last_fullsized":"2024-09-21T06:12:15.529962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:39.895930+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:12:39.895930+0000","last_peered":"2024-09-21T06:12:39.895930+0000","last_clean":"2024-09-21T06:12:39.895930+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:12:39.895930+0000","last_undegraded":"2024-09-21T06:12:39.895930+0000","last_fullsized":"2024-09-21T06:12:39.895930+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888565+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:11:47.888565+0000","last_peered":"2024-09-21T06:11:47.888565+0000","last_clean":"2024-09-21T06:11:47.888565+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:11:47.888565+0000","last_undegraded":"2024-09-21T06:11:47.888565+0000","last_fullsized":"2024-09-21T06:11:47.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.523455+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:12:15.523455+0000","last_peered":"2024-09-21T06:12:15.523455+0000","last_clean":"2024-09-21T06:12:15.523455+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:12:15.523455+0000","last_undegraded":"2024-09-21T06:12:15.523455+0000","last_fullsized":"2024-09-21T06:12:15.523455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678499+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:11:47.678499+0000","last_peered":"2024-09-21T06:11:47.678499+0000","last_clean":"2024-09-21T06:11:47.678499+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:11:47.678499+0000","last_undegraded":"2024-09-21T06:11:47.678499+0000","last_fullsized":"2024-09-21T06:11:47.678499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682187+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:11:47.682187+0000","last_peered":"2024-09-21T06:11:47.682187+0000","last_clean":"2024-09-21T06:11:47.682187+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:11:47.682187+0000","last_undegraded":"2024-09-21T06:11:47.682187+0000","last_fullsized":"2024-09-21T06:11:47.682187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517134+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:12:15.517134+0000","last_peered":"2024-09-21T06:12:15.517134+0000","last_clean":"2024-09-21T06:12:15.517134+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:12:15.517134+0000","last_undegraded":"2024-09-21T06:12:15.517134+0000","last_fullsized":"2024-09-21T06:12:15.517134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684367+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:11:47.684367+0000","last_peered":"2024-09-21T06:11:47.684367+0000","last_clean":"2024-09-21T06:11:47.684367+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:11:47.684367+0000","last_undegraded":"2024-09-21T06:11:47.684367+0000","last_fullsized":"2024-09-21T06:11:47.684367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678699+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:11:47.678699+0000","last_peered":"2024-09-21T06:11:47.678699+0000","last_clean":"2024-09-21T06:11:47.678699+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:11:47.678699+0000","last_undegraded":"2024-09-21T06:11:47.678699+0000","last_fullsized":"2024-09-21T06:11:47.678699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.518412+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:12:15.518412+0000","last_peered":"2024-09-21T06:12:15.518412+0000","last_clean":"2024-09-21T06:12:15.518412+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:12:15.518412+0000","last_undegraded":"2024-09-21T06:12:15.518412+0000","last_fullsized":"2024-09-21T06:12:15.518412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:40.072983+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:12:40.072983+0000","last_peered":"2024-09-21T06:12:40.072983+0000","last_clean":"2024-09-21T06:12:40.072983+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:12:40.072983+0000","last_undegraded":"2024-09-21T06:12:40.072983+0000","last_fullsized":"2024-09-21T06:12:40.072983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":171,"num_write":38,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817467+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:11:47.817467+0000","last_peered":"2024-09-21T06:11:47.817467+0000","last_clean":"2024-09-21T06:11:47.817467+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:11:47.817467+0000","last_undegraded":"2024-09-21T06:11:47.817467+0000","last_fullsized":"2024-09-21T06:11:47.817467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532696+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:12:15.532696+0000","last_peered":"2024-09-21T06:12:15.532696+0000","last_clean":"2024-09-21T06:12:15.532696+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:12:15.532696+0000","last_undegraded":"2024-09-21T06:12:15.532696+0000","last_fullsized":"2024-09-21T06:12:15.532696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678991+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:11:47.678991+0000","last_peered":"2024-09-21T06:11:47.678991+0000","last_clean":"2024-09-21T06:11:47.678991+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:11:47.678991+0000","last_undegraded":"2024-09-21T06:11:47.678991+0000","last_fullsized":"2024-09-21T06:11:47.678991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766973+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:11:47.766973+0000","last_peered":"2024-09-21T06:11:47.766973+0000","last_clean":"2024-09-21T06:11:47.766973+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:11:47.766973+0000","last_undegraded":"2024-09-21T06:11:47.766973+0000","last_fullsized":"2024-09-21T06:11:47.766973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526417+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:12:15.526417+0000","last_peered":"2024-09-21T06:12:15.526417+0000","last_clean":"2024-09-21T06:12:15.526417+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:12:15.526417+0000","last_undegraded":"2024-09-21T06:12:15.526417+0000","last_fullsized":"2024-09-21T06:12:15.526417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.771691+0000","last_change":"2024-09-21T06:11:47.771046+0000","last_active":"2024-09-21T06:11:47.771691+0000","last_peered":"2024-09-21T06:11:47.771691+0000","last_clean":"2024-09-21T06:11:47.771691+0000","last_became_active":"2024-09-21T06:11:47.768022+0000","last_became_peered":"2024-09-21T06:11:47.768022+0000","last_unstale":"2024-09-21T06:11:47.771691+0000","last_undegraded":"2024-09-21T06:11:47.771691+0000","last_fullsized":"2024-09-21T06:11:47.771691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:26.464373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887751+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:11:47.887751+0000","last_peered":"2024-09-21T06:11:47.887751+0000","last_clean":"2024-09-21T06:11:47.887751+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:11:47.887751+0000","last_undegraded":"2024-09-21T06:11:47.887751+0000","last_fullsized":"2024-09-21T06:11:47.887751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528028+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:12:15.528028+0000","last_peered":"2024-09-21T06:12:15.528028+0000","last_clean":"2024-09-21T06:12:15.528028+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:12:15.528028+0000","last_undegraded":"2024-09-21T06:12:15.528028+0000","last_fullsized":"2024-09-21T06:12:15.528028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:40.069481+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:12:40.069481+0000","last_peered":"2024-09-21T06:12:40.069481+0000","last_clean":"2024-09-21T06:12:40.069481+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:12:40.069481+0000","last_undegraded":"2024-09-21T06:12:40.069481+0000","last_fullsized":"2024-09-21T06:12:40.069481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684133+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:11:47.684133+0000","last_peered":"2024-09-21T06:11:47.684133+0000","last_clean":"2024-09-21T06:11:47.684133+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:11:47.684133+0000","last_undegraded":"2024-09-21T06:11:47.684133+0000","last_fullsized":"2024-09-21T06:11:47.684133+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953194+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:11:47.953194+0000","last_peered":"2024-09-21T06:11:47.953194+0000","last_clean":"2024-09-21T06:11:47.953194+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:11:47.953194+0000","last_undegraded":"2024-09-21T06:11:47.953194+0000","last_fullsized":"2024-09-21T06:11:47.953194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529878+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:12:15.529878+0000","last_peered":"2024-09-21T06:12:15.529878+0000","last_clean":"2024-09-21T06:12:15.529878+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:12:15.529878+0000","last_undegraded":"2024-09-21T06:12:15.529878+0000","last_fullsized":"2024-09-21T06:12:15.529878+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678773+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:11:47.678773+0000","last_peered":"2024-09-21T06:11:47.678773+0000","last_clean":"2024-09-21T06:11:47.678773+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:11:47.678773+0000","last_undegraded":"2024-09-21T06:11:47.678773+0000","last_fullsized":"2024-09-21T06:11:47.678773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682521+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:11:47.682521+0000","last_peered":"2024-09-21T06:11:47.682521+0000","last_clean":"2024-09-21T06:11:47.682521+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:11:47.682521+0000","last_undegraded":"2024-09-21T06:11:47.682521+0000","last_fullsized":"2024-09-21T06:11:47.682521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.507270+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:12:15.507270+0000","last_peered":"2024-09-21T06:12:15.507270+0000","last_clean":"2024-09-21T06:12:15.507270+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:12:15.507270+0000","last_undegraded":"2024-09-21T06:12:15.507270+0000","last_fullsized":"2024-09-21T06:12:15.507270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677106+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:11:47.677106+0000","last_peered":"2024-09-21T06:11:47.677106+0000","last_clean":"2024-09-21T06:11:47.677106+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:11:47.677106+0000","last_undegraded":"2024-09-21T06:11:47.677106+0000","last_fullsized":"2024-09-21T06:11:47.677106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817672+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:11:47.817672+0000","last_peered":"2024-09-21T06:11:47.817672+0000","last_clean":"2024-09-21T06:11:47.817672+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:11:47.817672+0000","last_undegraded":"2024-09-21T06:11:47.817672+0000","last_fullsized":"2024-09-21T06:11:47.817672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.509121+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:12:15.509121+0000","last_peered":"2024-09-21T06:12:15.509121+0000","last_clean":"2024-09-21T06:12:15.509121+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:12:15.509121+0000","last_undegraded":"2024-09-21T06:12:15.509121+0000","last_fullsized":"2024-09-21T06:12:15.509121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684408+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:11:47.684408+0000","last_peered":"2024-09-21T06:11:47.684408+0000","last_clean":"2024-09-21T06:11:47.684408+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:11:47.684408+0000","last_undegraded":"2024-09-21T06:11:47.684408+0000","last_fullsized":"2024-09-21T06:11:47.684408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:40.897934+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:12:40.897934+0000","last_peered":"2024-09-21T06:12:40.897934+0000","last_clean":"2024-09-21T06:12:40.897934+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:12:40.897934+0000","last_undegraded":"2024-09-21T06:12:40.897934+0000","last_fullsized":"2024-09-21T06:12:40.897934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.504178+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:12:15.504178+0000","last_peered":"2024-09-21T06:12:15.504178+0000","last_clean":"2024-09-21T06:12:15.504178+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:12:15.504178+0000","last_undegraded":"2024-09-21T06:12:15.504178+0000","last_fullsized":"2024-09-21T06:12:15.504178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684234+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:11:47.684234+0000","last_peered":"2024-09-21T06:11:47.684234+0000","last_clean":"2024-09-21T06:11:47.684234+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:11:47.684234+0000","last_undegraded":"2024-09-21T06:11:47.684234+0000","last_fullsized":"2024-09-21T06:11:47.684234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520206+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:12:15.520206+0000","last_peered":"2024-09-21T06:12:15.520206+0000","last_clean":"2024-09-21T06:12:15.520206+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:12:15.520206+0000","last_undegraded":"2024-09-21T06:12:15.520206+0000","last_fullsized":"2024-09-21T06:12:15.520206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520779+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:12:15.520779+0000","last_peered":"2024-09-21T06:12:15.520779+0000","last_clean":"2024-09-21T06:12:15.520779+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:12:15.520779+0000","last_undegraded":"2024-09-21T06:12:15.520779+0000","last_fullsized":"2024-09-21T06:12:15.520779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520465+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:12:15.520465+0000","last_peered":"2024-09-21T06:12:15.520465+0000","last_clean":"2024-09-21T06:12:15.520465+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:12:15.520465+0000","last_undegraded":"2024-09-21T06:12:15.520465+0000","last_fullsized":"2024-09-21T06:12:15.520465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526316+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:12:15.526316+0000","last_peered":"2024-09-21T06:12:15.526316+0000","last_clean":"2024-09-21T06:12:15.526316+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:12:15.526316+0000","last_undegraded":"2024-09-21T06:12:15.526316+0000","last_fullsized":"2024-09-21T06:12:15.526316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515205+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:12:15.515205+0000","last_peered":"2024-09-21T06:12:15.515205+0000","last_clean":"2024-09-21T06:12:15.515205+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:12:15.515205+0000","last_undegraded":"2024-09-21T06:12:15.515205+0000","last_fullsized":"2024-09-21T06:12:15.515205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.512408+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:12:15.512408+0000","last_peered":"2024-09-21T06:12:15.512408+0000","last_clean":"2024-09-21T06:12:15.512408+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:12:15.512408+0000","last_undegraded":"2024-09-21T06:12:15.512408+0000","last_fullsized":"2024-09-21T06:12:15.512408+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.534145+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:12:15.534145+0000","last_peered":"2024-09-21T06:12:15.534145+0000","last_clean":"2024-09-21T06:12:15.534145+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:12:15.534145+0000","last_undegraded":"2024-09-21T06:12:15.534145+0000","last_fullsized":"2024-09-21T06:12:15.534145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.506519+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:12:15.506519+0000","last_peered":"2024-09-21T06:12:15.506519+0000","last_clean":"2024-09-21T06:12:15.506519+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:12:15.506519+0000","last_undegraded":"2024-09-21T06:12:15.506519+0000","last_fullsized":"2024-09-21T06:12:15.506519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515287+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:12:15.515287+0000","last_peered":"2024-09-21T06:12:15.515287+0000","last_clean":"2024-09-21T06:12:15.515287+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:12:15.515287+0000","last_undegraded":"2024-09-21T06:12:15.515287+0000","last_fullsized":"2024-09-21T06:12:15.515287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.507300+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:12:15.507300+0000","last_peered":"2024-09-21T06:12:15.507300+0000","last_clean":"2024-09-21T06:12:15.507300+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:12:15.507300+0000","last_undegraded":"2024-09-21T06:12:15.507300+0000","last_fullsized":"2024-09-21T06:12:15.507300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.533005+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:12:15.533005+0000","last_peered":"2024-09-21T06:12:15.533005+0000","last_clean":"2024-09-21T06:12:15.533005+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:12:15.533005+0000","last_undegraded":"2024-09-21T06:12:15.533005+0000","last_fullsized":"2024-09-21T06:12:15.533005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517964+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:12:15.517964+0000","last_peered":"2024-09-21T06:12:15.517964+0000","last_clean":"2024-09-21T06:12:15.517964+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:12:15.517964+0000","last_undegraded":"2024-09-21T06:12:15.517964+0000","last_fullsized":"2024-09-21T06:12:15.517964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526826+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:12:15.526826+0000","last_peered":"2024-09-21T06:12:15.526826+0000","last_clean":"2024-09-21T06:12:15.526826+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:12:15.526826+0000","last_undegraded":"2024-09-21T06:12:15.526826+0000","last_fullsized":"2024-09-21T06:12:15.526826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.519072+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:12:15.519072+0000","last_peered":"2024-09-21T06:12:15.519072+0000","last_clean":"2024-09-21T06:12:15.519072+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:12:15.519072+0000","last_undegraded":"2024-09-21T06:12:15.519072+0000","last_fullsized":"2024-09-21T06:12:15.519072+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529805+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:12:15.529805+0000","last_peered":"2024-09-21T06:12:15.529805+0000","last_clean":"2024-09-21T06:12:15.529805+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:12:15.529805+0000","last_undegraded":"2024-09-21T06:12:15.529805+0000","last_fullsized":"2024-09-21T06:12:15.529805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517772+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:12:15.517772+0000","last_peered":"2024-09-21T06:12:15.517772+0000","last_clean":"2024-09-21T06:12:15.517772+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:12:15.517772+0000","last_undegraded":"2024-09-21T06:12:15.517772+0000","last_fullsized":"2024-09-21T06:12:15.517772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532761+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:12:15.532761+0000","last_peered":"2024-09-21T06:12:15.532761+0000","last_clean":"2024-09-21T06:12:15.532761+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:12:15.532761+0000","last_undegraded":"2024-09-21T06:12:15.532761+0000","last_fullsized":"2024-09-21T06:12:15.532761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526427+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:12:15.526427+0000","last_peered":"2024-09-21T06:12:15.526427+0000","last_clean":"2024-09-21T06:12:15.526427+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:12:15.526427+0000","last_undegraded":"2024-09-21T06:12:15.526427+0000","last_fullsized":"2024-09-21T06:12:15.526427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530631+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:12:15.530631+0000","last_peered":"2024-09-21T06:12:15.530631+0000","last_clean":"2024-09-21T06:12:15.530631+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:12:15.530631+0000","last_undegraded":"2024-09-21T06:12:15.530631+0000","last_fullsized":"2024-09-21T06:12:15.530631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.508209+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:12:15.508209+0000","last_peered":"2024-09-21T06:12:15.508209+0000","last_clean":"2024-09-21T06:12:15.508209+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:12:15.508209+0000","last_undegraded":"2024-09-21T06:12:15.508209+0000","last_fullsized":"2024-09-21T06:12:15.508209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.524445+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:12:15.524445+0000","last_peered":"2024-09-21T06:12:15.524445+0000","last_clean":"2024-09-21T06:12:15.524445+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:12:15.524445+0000","last_undegraded":"2024-09-21T06:12:15.524445+0000","last_fullsized":"2024-09-21T06:12:15.524445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.531564+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:12:15.531564+0000","last_peered":"2024-09-21T06:12:15.531564+0000","last_clean":"2024-09-21T06:12:15.531564+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:12:15.531564+0000","last_undegraded":"2024-09-21T06:12:15.531564+0000","last_fullsized":"2024-09-21T06:12:15.531564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520739+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:12:15.520739+0000","last_peered":"2024-09-21T06:12:15.520739+0000","last_clean":"2024-09-21T06:12:15.520739+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:12:15.520739+0000","last_undegraded":"2024-09-21T06:12:15.520739+0000","last_fullsized":"2024-09-21T06:12:15.520739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532755+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:12:15.532755+0000","last_peered":"2024-09-21T06:12:15.532755+0000","last_clean":"2024-09-21T06:12:15.532755+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:12:15.532755+0000","last_undegraded":"2024-09-21T06:12:15.532755+0000","last_fullsized":"2024-09-21T06:12:15.532755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529624+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:12:15.529624+0000","last_peered":"2024-09-21T06:12:15.529624+0000","last_clean":"2024-09-21T06:12:15.529624+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:12:15.529624+0000","last_undegraded":"2024-09-21T06:12:15.529624+0000","last_fullsized":"2024-09-21T06:12:15.529624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.519820+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:12:15.519820+0000","last_peered":"2024-09-21T06:12:15.519820+0000","last_clean":"2024-09-21T06:12:15.519820+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:12:15.519820+0000","last_undegraded":"2024-09-21T06:12:15.519820+0000","last_fullsized":"2024-09-21T06:12:15.519820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526074+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:12:15.526074+0000","last_peered":"2024-09-21T06:12:15.526074+0000","last_clean":"2024-09-21T06:12:15.526074+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:12:15.526074+0000","last_undegraded":"2024-09-21T06:12:15.526074+0000","last_fullsized":"2024-09-21T06:12:15.526074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.500611+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:12:15.500611+0000","last_peered":"2024-09-21T06:12:15.500611+0000","last_clean":"2024-09-21T06:12:15.500611+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:12:15.500611+0000","last_undegraded":"2024-09-21T06:12:15.500611+0000","last_fullsized":"2024-09-21T06:12:15.500611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.525142+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:12:15.525142+0000","last_peered":"2024-09-21T06:12:15.525142+0000","last_clean":"2024-09-21T06:12:15.525142+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:12:15.525142+0000","last_undegraded":"2024-09-21T06:12:15.525142+0000","last_fullsized":"2024-09-21T06:12:15.525142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529460+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:12:15.529460+0000","last_peered":"2024-09-21T06:12:15.529460+0000","last_clean":"2024-09-21T06:12:15.529460+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:12:15.529460+0000","last_undegraded":"2024-09-21T06:12:15.529460+0000","last_fullsized":"2024-09-21T06:12:15.529460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530065+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:12:15.530065+0000","last_peered":"2024-09-21T06:12:15.530065+0000","last_clean":"2024-09-21T06:12:15.530065+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:12:15.530065+0000","last_undegraded":"2024-09-21T06:12:15.530065+0000","last_fullsized":"2024-09-21T06:12:15.530065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517415+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:12:15.517415+0000","last_peered":"2024-09-21T06:12:15.517415+0000","last_clean":"2024-09-21T06:12:15.517415+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:12:15.517415+0000","last_undegraded":"2024-09-21T06:12:15.517415+0000","last_fullsized":"2024-09-21T06:12:15.517415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71550,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":634,"num_read_kb":390,"num_write":178,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":473624,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939696,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":1127331,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070517,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":477934,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":473736,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430271,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1070262,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593796,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":469014,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790026,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1065357,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953551,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":473664,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149779,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":469208,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":536735,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":535385,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":470402,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:12:44.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:12:44.799 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:45.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:44 smithi017 ceph-mon[31080]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:12:45.051 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:44 smithi017 ceph-mon[31080]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:44 smithi089 ceph-mon[33879]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:12:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:44 smithi089 ceph-mon[33879]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:44 smithi081 ceph-mon[33870]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:12:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:44 smithi081 ceph-mon[33870]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 -- 172.21.15.17:0/123974028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c8103b60 msgr2=0x7f60c8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 --2- 172.21.15.17:0/123974028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c8103b60 0x7f60c8103f70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009900 tx=0x7f60b802a410 comp rx=0 tx=0).stop 2024-09-21T06:12:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 -- 172.21.15.17:0/123974028 shutdown_connections 2024-09-21T06:12:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 --2- 172.21.15.17:0/123974028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 0x7f60c8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 --2- 172.21.15.17:0/123974028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c81094a0 0x7f60c81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 --2- 172.21.15.17:0/123974028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c8103b60 0x7f60c8103f70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 -- 172.21.15.17:0/123974028 >> 172.21.15.17:0/123974028 conn(0x7f60c807b850 msgr2=0x7f60c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.266+0000 7f60cd61d640 1 -- 172.21.15.17:0/123974028 shutdown_connections 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 -- 172.21.15.17:0/123974028 wait complete. 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 Processor -- start 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 -- start start 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c8103b60 0x7f60c819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 0x7f60c819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 0x7f60c819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8113960 con 0x7f60c81094a0 2024-09-21T06:12:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60c81137e0 con 0x7f60c8109df0 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.267+0000 7f60cd61d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8113ae0 con 0x7f60c8103b60 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 0x7f60c819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 0x7f60c819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58850/0 (socket says 172.21.15.17:58850) 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 -- 172.21.15.17:0/1176578121 learned_addr learned my addr 172.21.15.17:0/1176578121 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60c6ffd640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c8103b60 0x7f60c819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60c77fe640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 0x7f60c819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 -- 172.21.15.17:0/1176578121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c8103b60 msgr2=0x7f60c819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c8103b60 0x7f60c819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 -- 172.21.15.17:0/1176578121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 msgr2=0x7f60c819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 0x7f60c819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 -- 172.21.15.17:0/1176578121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c81a03c0 con 0x7f60c81094a0 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60c77fe640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 0x7f60c819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:45.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60bffff640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 0x7f60c819a9f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f60b000c970 tx=0x7f60b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0004220 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c81a06b0 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60b0007e40 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.268+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b00047a0 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.269+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81a6e10 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.269+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c8103f70 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.271+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f60b00079b0 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.272+0000 7f60c4ff9640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f60b40b6510 0x7f60b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.273+0000 7f60c6ffd640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f60b40b6510 0x7f60b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.273+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f60b00e7730 con 0x7f60c81094a0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.273+0000 7f60c6ffd640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f60b40b6510 0x7f60b40b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f60b80057c0 tx=0x7f60b80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.276+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60b0014030 con 0x7f60c81094a0 2024-09-21T06:12:45.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.462+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60c8063800 con 0x7f60b40b6510 2024-09-21T06:12:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.468+0000 7f60c4ff9640 1 -- 172.21.15.17:0/1176578121 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340691 (secure 0 0 0) 0x7f60c8063800 con 0x7f60b40b6510 2024-09-21T06:12:45.474 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:12:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f60b40b6510 msgr2=0x7f60b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f60b40b6510 0x7f60b40b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f60b80057c0 tx=0x7f60b80058d0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 msgr2=0x7f60c819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 0x7f60c819a9f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f60b000c970 tx=0x7f60b000ce30 comp rx=0 tx=0).stop 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 shutdown_connections 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f60b40b6510 0x7f60b40b8a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c81094a0 0x7f60c819a9f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c8109df0 0x7f60c819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 --2- 172.21.15.17:0/1176578121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c8103b60 0x7f60c819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 >> 172.21.15.17:0/1176578121 conn(0x7f60c807b850 msgr2=0x7f60c8107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 shutdown_connections 2024-09-21T06:12:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:45.472+0000 7f60cd61d640 1 -- 172.21.15.17:0/1176578121 wait complete. 2024-09-21T06:12:46.217 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-21T06:12:45.165923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662152,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":715,"num_read_kb":459,"num_write":304,"num_write_kb":2281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":746,"ondisk_log_size":746,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372952,"kb_used_data":11224,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568872,"statfs":{"total":1151940427776,"available":1151558524928,"internally_reserved":0,"allocated":11493376,"data_stored":7652829,"data_compressed":461643,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1479,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003658"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888698+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:11:47.888698+0000","last_peered":"2024-09-21T06:11:47.888698+0000","last_clean":"2024-09-21T06:11:47.888698+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:11:47.888698+0000","last_undegraded":"2024-09-21T06:11:47.888698+0000","last_fullsized":"2024-09-21T06:11:47.888698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515378+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:12:15.515378+0000","last_peered":"2024-09-21T06:12:15.515378+0000","last_clean":"2024-09-21T06:12:15.515378+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:12:15.515378+0000","last_undegraded":"2024-09-21T06:12:15.515378+0000","last_fullsized":"2024-09-21T06:12:15.515378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683054+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:11:47.683054+0000","last_peered":"2024-09-21T06:11:47.683054+0000","last_clean":"2024-09-21T06:11:47.683054+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:11:47.683054+0000","last_undegraded":"2024-09-21T06:11:47.683054+0000","last_fullsized":"2024-09-21T06:11:47.683054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684717+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:11:47.684717+0000","last_peered":"2024-09-21T06:11:47.684717+0000","last_clean":"2024-09-21T06:11:47.684717+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:11:47.684717+0000","last_undegraded":"2024-09-21T06:11:47.684717+0000","last_fullsized":"2024-09-21T06:11:47.684717+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528390+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:12:15.528390+0000","last_peered":"2024-09-21T06:12:15.528390+0000","last_clean":"2024-09-21T06:12:15.528390+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:12:15.528390+0000","last_undegraded":"2024-09-21T06:12:15.528390+0000","last_fullsized":"2024-09-21T06:12:15.528390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766526+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:11:47.766526+0000","last_peered":"2024-09-21T06:11:47.766526+0000","last_clean":"2024-09-21T06:11:47.766526+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:11:47.766526+0000","last_undegraded":"2024-09-21T06:11:47.766526+0000","last_fullsized":"2024-09-21T06:11:47.766526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685224+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:11:47.685224+0000","last_peered":"2024-09-21T06:11:47.685224+0000","last_clean":"2024-09-21T06:11:47.685224+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:11:47.685224+0000","last_undegraded":"2024-09-21T06:11:47.685224+0000","last_fullsized":"2024-09-21T06:11:47.685224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528030+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:12:15.528030+0000","last_peered":"2024-09-21T06:12:15.528030+0000","last_clean":"2024-09-21T06:12:15.528030+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:12:15.528030+0000","last_undegraded":"2024-09-21T06:12:15.528030+0000","last_fullsized":"2024-09-21T06:12:15.528030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766810+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:11:47.766810+0000","last_peered":"2024-09-21T06:11:47.766810+0000","last_clean":"2024-09-21T06:11:47.766810+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:11:47.766810+0000","last_undegraded":"2024-09-21T06:11:47.766810+0000","last_fullsized":"2024-09-21T06:11:47.766810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685451+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:11:47.685451+0000","last_peered":"2024-09-21T06:11:47.685451+0000","last_clean":"2024-09-21T06:11:47.685451+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:11:47.685451+0000","last_undegraded":"2024-09-21T06:11:47.685451+0000","last_fullsized":"2024-09-21T06:11:47.685451+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.533593+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:12:15.533593+0000","last_peered":"2024-09-21T06:12:15.533593+0000","last_clean":"2024-09-21T06:12:15.533593+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:12:15.533593+0000","last_undegraded":"2024-09-21T06:12:15.533593+0000","last_fullsized":"2024-09-21T06:12:15.533593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766802+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:11:47.766802+0000","last_peered":"2024-09-21T06:11:47.766802+0000","last_clean":"2024-09-21T06:11:47.766802+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:11:47.766802+0000","last_undegraded":"2024-09-21T06:11:47.766802+0000","last_fullsized":"2024-09-21T06:11:47.766802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530716+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:12:15.530716+0000","last_peered":"2024-09-21T06:12:15.530716+0000","last_clean":"2024-09-21T06:12:15.530716+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:12:15.530716+0000","last_undegraded":"2024-09-21T06:12:15.530716+0000","last_fullsized":"2024-09-21T06:12:15.530716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684943+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:11:47.684943+0000","last_peered":"2024-09-21T06:11:47.684943+0000","last_clean":"2024-09-21T06:11:47.684943+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:11:47.684943+0000","last_undegraded":"2024-09-21T06:11:47.684943+0000","last_fullsized":"2024-09-21T06:11:47.684943+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767278+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:11:47.767278+0000","last_peered":"2024-09-21T06:11:47.767278+0000","last_clean":"2024-09-21T06:11:47.767278+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:11:47.767278+0000","last_undegraded":"2024-09-21T06:11:47.767278+0000","last_fullsized":"2024-09-21T06:11:47.767278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529637+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:12:15.529637+0000","last_peered":"2024-09-21T06:12:15.529637+0000","last_clean":"2024-09-21T06:12:15.529637+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:12:15.529637+0000","last_undegraded":"2024-09-21T06:12:15.529637+0000","last_fullsized":"2024-09-21T06:12:15.529637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:51.194821+0000","last_change":"2024-09-21T06:11:47.688842+0000","last_active":"2024-09-21T06:11:51.194821+0000","last_peered":"2024-09-21T06:11:51.194821+0000","last_clean":"2024-09-21T06:11:51.194821+0000","last_became_active":"2024-09-21T06:11:47.685980+0000","last_became_peered":"2024-09-21T06:11:47.685980+0000","last_unstale":"2024-09-21T06:11:51.194821+0000","last_undegraded":"2024-09-21T06:11:51.194821+0000","last_fullsized":"2024-09-21T06:11:51.194821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:40.815179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767157+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:11:47.767157+0000","last_peered":"2024-09-21T06:11:47.767157+0000","last_clean":"2024-09-21T06:11:47.767157+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:11:47.767157+0000","last_undegraded":"2024-09-21T06:11:47.767157+0000","last_fullsized":"2024-09-21T06:11:47.767157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520061+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:12:15.520061+0000","last_peered":"2024-09-21T06:12:15.520061+0000","last_clean":"2024-09-21T06:12:15.520061+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:12:15.520061+0000","last_undegraded":"2024-09-21T06:12:15.520061+0000","last_fullsized":"2024-09-21T06:12:15.520061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684702+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:11:47.684702+0000","last_peered":"2024-09-21T06:11:47.684702+0000","last_clean":"2024-09-21T06:11:47.684702+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:11:47.684702+0000","last_undegraded":"2024-09-21T06:11:47.684702+0000","last_fullsized":"2024-09-21T06:11:47.684702+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684970+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:11:47.684970+0000","last_peered":"2024-09-21T06:11:47.684970+0000","last_clean":"2024-09-21T06:11:47.684970+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:11:47.684970+0000","last_undegraded":"2024-09-21T06:11:47.684970+0000","last_fullsized":"2024-09-21T06:11:47.684970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511365+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:12:15.511365+0000","last_peered":"2024-09-21T06:12:15.511365+0000","last_clean":"2024-09-21T06:12:15.511365+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:12:15.511365+0000","last_undegraded":"2024-09-21T06:12:15.511365+0000","last_fullsized":"2024-09-21T06:12:15.511365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678082+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:11:47.678082+0000","last_peered":"2024-09-21T06:11:47.678082+0000","last_clean":"2024-09-21T06:11:47.678082+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:11:47.678082+0000","last_undegraded":"2024-09-21T06:11:47.678082+0000","last_fullsized":"2024-09-21T06:11:47.678082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767365+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:11:47.767365+0000","last_peered":"2024-09-21T06:11:47.767365+0000","last_clean":"2024-09-21T06:11:47.767365+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:11:47.767365+0000","last_undegraded":"2024-09-21T06:11:47.767365+0000","last_fullsized":"2024-09-21T06:11:47.767365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526493+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:12:15.526493+0000","last_peered":"2024-09-21T06:12:15.526493+0000","last_clean":"2024-09-21T06:12:15.526493+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:12:15.526493+0000","last_undegraded":"2024-09-21T06:12:15.526493+0000","last_fullsized":"2024-09-21T06:12:15.526493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767552+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:11:47.767552+0000","last_peered":"2024-09-21T06:11:47.767552+0000","last_clean":"2024-09-21T06:11:47.767552+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:11:47.767552+0000","last_undegraded":"2024-09-21T06:11:47.767552+0000","last_fullsized":"2024-09-21T06:11:47.767552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683342+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:11:47.683342+0000","last_peered":"2024-09-21T06:11:47.683342+0000","last_clean":"2024-09-21T06:11:47.683342+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:11:47.683342+0000","last_undegraded":"2024-09-21T06:11:47.683342+0000","last_fullsized":"2024-09-21T06:11:47.683342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.516838+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:12:15.516838+0000","last_peered":"2024-09-21T06:12:15.516838+0000","last_clean":"2024-09-21T06:12:15.516838+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:12:15.516838+0000","last_undegraded":"2024-09-21T06:12:15.516838+0000","last_fullsized":"2024-09-21T06:12:15.516838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'12","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.569272+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:12:15.569272+0000","last_peered":"2024-09-21T06:12:15.569272+0000","last_clean":"2024-09-21T06:12:15.569272+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:12:15.569272+0000","last_undegraded":"2024-09-21T06:12:15.569272+0000","last_fullsized":"2024-09-21T06:12:15.569272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684254+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:11:47.684254+0000","last_peered":"2024-09-21T06:11:47.684254+0000","last_clean":"2024-09-21T06:11:47.684254+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:11:47.684254+0000","last_undegraded":"2024-09-21T06:11:47.684254+0000","last_fullsized":"2024-09-21T06:11:47.684254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.508678+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:12:15.508678+0000","last_peered":"2024-09-21T06:12:15.508678+0000","last_clean":"2024-09-21T06:12:15.508678+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:12:15.508678+0000","last_undegraded":"2024-09-21T06:12:15.508678+0000","last_fullsized":"2024-09-21T06:12:15.508678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685479+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:11:47.685479+0000","last_peered":"2024-09-21T06:11:47.685479+0000","last_clean":"2024-09-21T06:11:47.685479+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:11:47.685479+0000","last_undegraded":"2024-09-21T06:11:47.685479+0000","last_fullsized":"2024-09-21T06:11:47.685479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682161+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:11:47.682161+0000","last_peered":"2024-09-21T06:11:47.682161+0000","last_clean":"2024-09-21T06:11:47.682161+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:11:47.682161+0000","last_undegraded":"2024-09-21T06:11:47.682161+0000","last_fullsized":"2024-09-21T06:11:47.682161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517397+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:12:15.517397+0000","last_peered":"2024-09-21T06:12:15.517397+0000","last_clean":"2024-09-21T06:12:15.517397+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:12:15.517397+0000","last_undegraded":"2024-09-21T06:12:15.517397+0000","last_fullsized":"2024-09-21T06:12:15.517397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888263+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:11:47.888263+0000","last_peered":"2024-09-21T06:11:47.888263+0000","last_clean":"2024-09-21T06:11:47.888263+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:11:47.888263+0000","last_undegraded":"2024-09-21T06:11:47.888263+0000","last_fullsized":"2024-09-21T06:11:47.888263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685148+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:11:47.685148+0000","last_peered":"2024-09-21T06:11:47.685148+0000","last_clean":"2024-09-21T06:11:47.685148+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:11:47.685148+0000","last_undegraded":"2024-09-21T06:11:47.685148+0000","last_fullsized":"2024-09-21T06:11:47.685148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.527626+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:12:15.527626+0000","last_peered":"2024-09-21T06:12:15.527626+0000","last_clean":"2024-09-21T06:12:15.527626+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:12:15.527626+0000","last_undegraded":"2024-09-21T06:12:15.527626+0000","last_fullsized":"2024-09-21T06:12:15.527626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680958+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:11:47.680958+0000","last_peered":"2024-09-21T06:11:47.680958+0000","last_clean":"2024-09-21T06:11:47.680958+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:11:47.680958+0000","last_undegraded":"2024-09-21T06:11:47.680958+0000","last_fullsized":"2024-09-21T06:11:47.680958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677491+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:11:47.677491+0000","last_peered":"2024-09-21T06:11:47.677491+0000","last_clean":"2024-09-21T06:11:47.677491+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:11:47.677491+0000","last_undegraded":"2024-09-21T06:11:47.677491+0000","last_fullsized":"2024-09-21T06:11:47.677491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511982+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:12:15.511982+0000","last_peered":"2024-09-21T06:12:15.511982+0000","last_clean":"2024-09-21T06:12:15.511982+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:12:15.511982+0000","last_undegraded":"2024-09-21T06:12:15.511982+0000","last_fullsized":"2024-09-21T06:12:15.511982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:41.899744+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:12:41.899744+0000","last_peered":"2024-09-21T06:12:41.899744+0000","last_clean":"2024-09-21T06:12:41.899744+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:12:41.899744+0000","last_undegraded":"2024-09-21T06:12:41.899744+0000","last_fullsized":"2024-09-21T06:12:41.899744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677750+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:11:47.677750+0000","last_peered":"2024-09-21T06:11:47.677750+0000","last_clean":"2024-09-21T06:11:47.677750+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:11:47.677750+0000","last_undegraded":"2024-09-21T06:11:47.677750+0000","last_fullsized":"2024-09-21T06:11:47.677750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.518463+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:12:15.518463+0000","last_peered":"2024-09-21T06:12:15.518463+0000","last_clean":"2024-09-21T06:12:15.518463+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:12:15.518463+0000","last_undegraded":"2024-09-21T06:12:15.518463+0000","last_fullsized":"2024-09-21T06:12:15.518463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680635+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:11:47.680635+0000","last_peered":"2024-09-21T06:11:47.680635+0000","last_clean":"2024-09-21T06:11:47.680635+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:11:47.680635+0000","last_undegraded":"2024-09-21T06:11:47.680635+0000","last_fullsized":"2024-09-21T06:11:47.680635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678849+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:11:47.678849+0000","last_peered":"2024-09-21T06:11:47.678849+0000","last_clean":"2024-09-21T06:11:47.678849+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:11:47.678849+0000","last_undegraded":"2024-09-21T06:11:47.678849+0000","last_fullsized":"2024-09-21T06:11:47.678849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.525129+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:12:15.525129+0000","last_peered":"2024-09-21T06:12:15.525129+0000","last_clean":"2024-09-21T06:12:15.525129+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:12:15.525129+0000","last_undegraded":"2024-09-21T06:12:15.525129+0000","last_fullsized":"2024-09-21T06:12:15.525129+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767139+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:11:47.767139+0000","last_peered":"2024-09-21T06:11:47.767139+0000","last_clean":"2024-09-21T06:11:47.767139+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:11:47.767139+0000","last_undegraded":"2024-09-21T06:11:47.767139+0000","last_fullsized":"2024-09-21T06:11:47.767139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681028+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:11:47.681028+0000","last_peered":"2024-09-21T06:11:47.681028+0000","last_clean":"2024-09-21T06:11:47.681028+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:11:47.681028+0000","last_undegraded":"2024-09-21T06:11:47.681028+0000","last_fullsized":"2024-09-21T06:11:47.681028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681244+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:11:47.681244+0000","last_peered":"2024-09-21T06:11:47.681244+0000","last_clean":"2024-09-21T06:11:47.681244+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:11:47.681244+0000","last_undegraded":"2024-09-21T06:11:47.681244+0000","last_fullsized":"2024-09-21T06:11:47.681244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.531491+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:12:15.531491+0000","last_peered":"2024-09-21T06:12:15.531491+0000","last_clean":"2024-09-21T06:12:15.531491+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:12:15.531491+0000","last_undegraded":"2024-09-21T06:12:15.531491+0000","last_fullsized":"2024-09-21T06:12:15.531491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684700+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:11:47.684700+0000","last_peered":"2024-09-21T06:11:47.684700+0000","last_clean":"2024-09-21T06:11:47.684700+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:11:47.684700+0000","last_undegraded":"2024-09-21T06:11:47.684700+0000","last_fullsized":"2024-09-21T06:11:47.684700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678062+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:11:47.678062+0000","last_peered":"2024-09-21T06:11:47.678062+0000","last_clean":"2024-09-21T06:11:47.678062+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:11:47.678062+0000","last_undegraded":"2024-09-21T06:11:47.678062+0000","last_fullsized":"2024-09-21T06:11:47.678062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.522370+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:12:15.522370+0000","last_peered":"2024-09-21T06:12:15.522370+0000","last_clean":"2024-09-21T06:12:15.522370+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:12:15.522370+0000","last_undegraded":"2024-09-21T06:12:15.522370+0000","last_fullsized":"2024-09-21T06:12:15.522370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678990+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:11:47.678990+0000","last_peered":"2024-09-21T06:11:47.678990+0000","last_clean":"2024-09-21T06:11:47.678990+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:11:47.678990+0000","last_undegraded":"2024-09-21T06:11:47.678990+0000","last_fullsized":"2024-09-21T06:11:47.678990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953477+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:11:47.953477+0000","last_peered":"2024-09-21T06:11:47.953477+0000","last_clean":"2024-09-21T06:11:47.953477+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:11:47.953477+0000","last_undegraded":"2024-09-21T06:11:47.953477+0000","last_fullsized":"2024-09-21T06:11:47.953477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.522892+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:12:15.522892+0000","last_peered":"2024-09-21T06:12:15.522892+0000","last_clean":"2024-09-21T06:12:15.522892+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:12:15.522892+0000","last_undegraded":"2024-09-21T06:12:15.522892+0000","last_fullsized":"2024-09-21T06:12:15.522892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677748+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:11:47.677748+0000","last_peered":"2024-09-21T06:11:47.677748+0000","last_clean":"2024-09-21T06:11:47.677748+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:11:47.677748+0000","last_undegraded":"2024-09-21T06:11:47.677748+0000","last_fullsized":"2024-09-21T06:11:47.677748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678099+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:11:47.678099+0000","last_peered":"2024-09-21T06:11:47.678099+0000","last_clean":"2024-09-21T06:11:47.678099+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:11:47.678099+0000","last_undegraded":"2024-09-21T06:11:47.678099+0000","last_fullsized":"2024-09-21T06:11:47.678099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526693+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:12:15.526693+0000","last_peered":"2024-09-21T06:12:15.526693+0000","last_clean":"2024-09-21T06:12:15.526693+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:12:15.526693+0000","last_undegraded":"2024-09-21T06:12:15.526693+0000","last_fullsized":"2024-09-21T06:12:15.526693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682618+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:11:47.682618+0000","last_peered":"2024-09-21T06:11:47.682618+0000","last_clean":"2024-09-21T06:11:47.682618+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:11:47.682618+0000","last_undegraded":"2024-09-21T06:11:47.682618+0000","last_fullsized":"2024-09-21T06:11:47.682618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678272+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:11:47.678272+0000","last_peered":"2024-09-21T06:11:47.678272+0000","last_clean":"2024-09-21T06:11:47.678272+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:11:47.678272+0000","last_undegraded":"2024-09-21T06:11:47.678272+0000","last_fullsized":"2024-09-21T06:11:47.678272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532907+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:12:15.532907+0000","last_peered":"2024-09-21T06:12:15.532907+0000","last_clean":"2024-09-21T06:12:15.532907+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:12:15.532907+0000","last_undegraded":"2024-09-21T06:12:15.532907+0000","last_fullsized":"2024-09-21T06:12:15.532907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685080+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:11:47.685080+0000","last_peered":"2024-09-21T06:11:47.685080+0000","last_clean":"2024-09-21T06:11:47.685080+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:11:47.685080+0000","last_undegraded":"2024-09-21T06:11:47.685080+0000","last_fullsized":"2024-09-21T06:11:47.685080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677637+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:11:47.677637+0000","last_peered":"2024-09-21T06:11:47.677637+0000","last_clean":"2024-09-21T06:11:47.677637+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:11:47.677637+0000","last_undegraded":"2024-09-21T06:11:47.677637+0000","last_fullsized":"2024-09-21T06:11:47.677637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529962+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:12:15.529962+0000","last_peered":"2024-09-21T06:12:15.529962+0000","last_clean":"2024-09-21T06:12:15.529962+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:12:15.529962+0000","last_undegraded":"2024-09-21T06:12:15.529962+0000","last_fullsized":"2024-09-21T06:12:15.529962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":147,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:39.895930+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:12:39.895930+0000","last_peered":"2024-09-21T06:12:39.895930+0000","last_clean":"2024-09-21T06:12:39.895930+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:12:39.895930+0000","last_undegraded":"2024-09-21T06:12:39.895930+0000","last_fullsized":"2024-09-21T06:12:39.895930+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888565+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:11:47.888565+0000","last_peered":"2024-09-21T06:11:47.888565+0000","last_clean":"2024-09-21T06:11:47.888565+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:11:47.888565+0000","last_undegraded":"2024-09-21T06:11:47.888565+0000","last_fullsized":"2024-09-21T06:11:47.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.523455+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:12:15.523455+0000","last_peered":"2024-09-21T06:12:15.523455+0000","last_clean":"2024-09-21T06:12:15.523455+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:12:15.523455+0000","last_undegraded":"2024-09-21T06:12:15.523455+0000","last_fullsized":"2024-09-21T06:12:15.523455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678499+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:11:47.678499+0000","last_peered":"2024-09-21T06:11:47.678499+0000","last_clean":"2024-09-21T06:11:47.678499+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:11:47.678499+0000","last_undegraded":"2024-09-21T06:11:47.678499+0000","last_fullsized":"2024-09-21T06:11:47.678499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682187+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:11:47.682187+0000","last_peered":"2024-09-21T06:11:47.682187+0000","last_clean":"2024-09-21T06:11:47.682187+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:11:47.682187+0000","last_undegraded":"2024-09-21T06:11:47.682187+0000","last_fullsized":"2024-09-21T06:11:47.682187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517134+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:12:15.517134+0000","last_peered":"2024-09-21T06:12:15.517134+0000","last_clean":"2024-09-21T06:12:15.517134+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:12:15.517134+0000","last_undegraded":"2024-09-21T06:12:15.517134+0000","last_fullsized":"2024-09-21T06:12:15.517134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684367+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:11:47.684367+0000","last_peered":"2024-09-21T06:11:47.684367+0000","last_clean":"2024-09-21T06:11:47.684367+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:11:47.684367+0000","last_undegraded":"2024-09-21T06:11:47.684367+0000","last_fullsized":"2024-09-21T06:11:47.684367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678699+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:11:47.678699+0000","last_peered":"2024-09-21T06:11:47.678699+0000","last_clean":"2024-09-21T06:11:47.678699+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:11:47.678699+0000","last_undegraded":"2024-09-21T06:11:47.678699+0000","last_fullsized":"2024-09-21T06:11:47.678699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.518412+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:12:15.518412+0000","last_peered":"2024-09-21T06:12:15.518412+0000","last_clean":"2024-09-21T06:12:15.518412+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:12:15.518412+0000","last_undegraded":"2024-09-21T06:12:15.518412+0000","last_fullsized":"2024-09-21T06:12:15.518412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:40.072983+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:12:40.072983+0000","last_peered":"2024-09-21T06:12:40.072983+0000","last_clean":"2024-09-21T06:12:40.072983+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:12:40.072983+0000","last_undegraded":"2024-09-21T06:12:40.072983+0000","last_fullsized":"2024-09-21T06:12:40.072983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":171,"num_write":38,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817467+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:11:47.817467+0000","last_peered":"2024-09-21T06:11:47.817467+0000","last_clean":"2024-09-21T06:11:47.817467+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:11:47.817467+0000","last_undegraded":"2024-09-21T06:11:47.817467+0000","last_fullsized":"2024-09-21T06:11:47.817467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532696+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:12:15.532696+0000","last_peered":"2024-09-21T06:12:15.532696+0000","last_clean":"2024-09-21T06:12:15.532696+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:12:15.532696+0000","last_undegraded":"2024-09-21T06:12:15.532696+0000","last_fullsized":"2024-09-21T06:12:15.532696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678991+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:11:47.678991+0000","last_peered":"2024-09-21T06:11:47.678991+0000","last_clean":"2024-09-21T06:11:47.678991+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:11:47.678991+0000","last_undegraded":"2024-09-21T06:11:47.678991+0000","last_fullsized":"2024-09-21T06:11:47.678991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766973+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:11:47.766973+0000","last_peered":"2024-09-21T06:11:47.766973+0000","last_clean":"2024-09-21T06:11:47.766973+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:11:47.766973+0000","last_undegraded":"2024-09-21T06:11:47.766973+0000","last_fullsized":"2024-09-21T06:11:47.766973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526535+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:12:15.526535+0000","last_peered":"2024-09-21T06:12:15.526535+0000","last_clean":"2024-09-21T06:12:15.526535+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:12:15.526535+0000","last_undegraded":"2024-09-21T06:12:15.526535+0000","last_fullsized":"2024-09-21T06:12:15.526535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.771691+0000","last_change":"2024-09-21T06:11:47.771046+0000","last_active":"2024-09-21T06:11:47.771691+0000","last_peered":"2024-09-21T06:11:47.771691+0000","last_clean":"2024-09-21T06:11:47.771691+0000","last_became_active":"2024-09-21T06:11:47.768022+0000","last_became_peered":"2024-09-21T06:11:47.768022+0000","last_unstale":"2024-09-21T06:11:47.771691+0000","last_undegraded":"2024-09-21T06:11:47.771691+0000","last_fullsized":"2024-09-21T06:11:47.771691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:26.464373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887751+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:11:47.887751+0000","last_peered":"2024-09-21T06:11:47.887751+0000","last_clean":"2024-09-21T06:11:47.887751+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:11:47.887751+0000","last_undegraded":"2024-09-21T06:11:47.887751+0000","last_fullsized":"2024-09-21T06:11:47.887751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528752+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:12:15.528752+0000","last_peered":"2024-09-21T06:12:15.528752+0000","last_clean":"2024-09-21T06:12:15.528752+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:12:15.528752+0000","last_undegraded":"2024-09-21T06:12:15.528752+0000","last_fullsized":"2024-09-21T06:12:15.528752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":145,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:40.069481+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:12:40.069481+0000","last_peered":"2024-09-21T06:12:40.069481+0000","last_clean":"2024-09-21T06:12:40.069481+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:12:40.069481+0000","last_undegraded":"2024-09-21T06:12:40.069481+0000","last_fullsized":"2024-09-21T06:12:40.069481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684433+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:11:47.684433+0000","last_peered":"2024-09-21T06:11:47.684433+0000","last_clean":"2024-09-21T06:11:47.684433+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:11:47.684433+0000","last_undegraded":"2024-09-21T06:11:47.684433+0000","last_fullsized":"2024-09-21T06:11:47.684433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953194+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:11:47.953194+0000","last_peered":"2024-09-21T06:11:47.953194+0000","last_clean":"2024-09-21T06:11:47.953194+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:11:47.953194+0000","last_undegraded":"2024-09-21T06:11:47.953194+0000","last_fullsized":"2024-09-21T06:11:47.953194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529878+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:12:15.529878+0000","last_peered":"2024-09-21T06:12:15.529878+0000","last_clean":"2024-09-21T06:12:15.529878+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:12:15.529878+0000","last_undegraded":"2024-09-21T06:12:15.529878+0000","last_fullsized":"2024-09-21T06:12:15.529878+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678773+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:11:47.678773+0000","last_peered":"2024-09-21T06:11:47.678773+0000","last_clean":"2024-09-21T06:11:47.678773+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:11:47.678773+0000","last_undegraded":"2024-09-21T06:11:47.678773+0000","last_fullsized":"2024-09-21T06:11:47.678773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682521+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:11:47.682521+0000","last_peered":"2024-09-21T06:11:47.682521+0000","last_clean":"2024-09-21T06:11:47.682521+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:11:47.682521+0000","last_undegraded":"2024-09-21T06:11:47.682521+0000","last_fullsized":"2024-09-21T06:11:47.682521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.507447+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:12:15.507447+0000","last_peered":"2024-09-21T06:12:15.507447+0000","last_clean":"2024-09-21T06:12:15.507447+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:12:15.507447+0000","last_undegraded":"2024-09-21T06:12:15.507447+0000","last_fullsized":"2024-09-21T06:12:15.507447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677169+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:11:47.677169+0000","last_peered":"2024-09-21T06:11:47.677169+0000","last_clean":"2024-09-21T06:11:47.677169+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:11:47.677169+0000","last_undegraded":"2024-09-21T06:11:47.677169+0000","last_fullsized":"2024-09-21T06:11:47.677169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817672+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:11:47.817672+0000","last_peered":"2024-09-21T06:11:47.817672+0000","last_clean":"2024-09-21T06:11:47.817672+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:11:47.817672+0000","last_undegraded":"2024-09-21T06:11:47.817672+0000","last_fullsized":"2024-09-21T06:11:47.817672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.509121+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:12:15.509121+0000","last_peered":"2024-09-21T06:12:15.509121+0000","last_clean":"2024-09-21T06:12:15.509121+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:12:15.509121+0000","last_undegraded":"2024-09-21T06:12:15.509121+0000","last_fullsized":"2024-09-21T06:12:15.509121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684408+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:11:47.684408+0000","last_peered":"2024-09-21T06:11:47.684408+0000","last_clean":"2024-09-21T06:11:47.684408+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:11:47.684408+0000","last_undegraded":"2024-09-21T06:11:47.684408+0000","last_fullsized":"2024-09-21T06:11:47.684408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:40.897934+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:12:40.897934+0000","last_peered":"2024-09-21T06:12:40.897934+0000","last_clean":"2024-09-21T06:12:40.897934+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:12:40.897934+0000","last_undegraded":"2024-09-21T06:12:40.897934+0000","last_fullsized":"2024-09-21T06:12:40.897934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.504178+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:12:15.504178+0000","last_peered":"2024-09-21T06:12:15.504178+0000","last_clean":"2024-09-21T06:12:15.504178+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:12:15.504178+0000","last_undegraded":"2024-09-21T06:12:15.504178+0000","last_fullsized":"2024-09-21T06:12:15.504178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684234+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:11:47.684234+0000","last_peered":"2024-09-21T06:11:47.684234+0000","last_clean":"2024-09-21T06:11:47.684234+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:11:47.684234+0000","last_undegraded":"2024-09-21T06:11:47.684234+0000","last_fullsized":"2024-09-21T06:11:47.684234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520206+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:12:15.520206+0000","last_peered":"2024-09-21T06:12:15.520206+0000","last_clean":"2024-09-21T06:12:15.520206+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:12:15.520206+0000","last_undegraded":"2024-09-21T06:12:15.520206+0000","last_fullsized":"2024-09-21T06:12:15.520206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520779+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:12:15.520779+0000","last_peered":"2024-09-21T06:12:15.520779+0000","last_clean":"2024-09-21T06:12:15.520779+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:12:15.520779+0000","last_undegraded":"2024-09-21T06:12:15.520779+0000","last_fullsized":"2024-09-21T06:12:15.520779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520465+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:12:15.520465+0000","last_peered":"2024-09-21T06:12:15.520465+0000","last_clean":"2024-09-21T06:12:15.520465+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:12:15.520465+0000","last_undegraded":"2024-09-21T06:12:15.520465+0000","last_fullsized":"2024-09-21T06:12:15.520465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526316+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:12:15.526316+0000","last_peered":"2024-09-21T06:12:15.526316+0000","last_clean":"2024-09-21T06:12:15.526316+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:12:15.526316+0000","last_undegraded":"2024-09-21T06:12:15.526316+0000","last_fullsized":"2024-09-21T06:12:15.526316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515205+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:12:15.515205+0000","last_peered":"2024-09-21T06:12:15.515205+0000","last_clean":"2024-09-21T06:12:15.515205+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:12:15.515205+0000","last_undegraded":"2024-09-21T06:12:15.515205+0000","last_fullsized":"2024-09-21T06:12:15.515205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.512408+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:12:15.512408+0000","last_peered":"2024-09-21T06:12:15.512408+0000","last_clean":"2024-09-21T06:12:15.512408+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:12:15.512408+0000","last_undegraded":"2024-09-21T06:12:15.512408+0000","last_fullsized":"2024-09-21T06:12:15.512408+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.534145+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:12:15.534145+0000","last_peered":"2024-09-21T06:12:15.534145+0000","last_clean":"2024-09-21T06:12:15.534145+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:12:15.534145+0000","last_undegraded":"2024-09-21T06:12:15.534145+0000","last_fullsized":"2024-09-21T06:12:15.534145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.506519+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:12:15.506519+0000","last_peered":"2024-09-21T06:12:15.506519+0000","last_clean":"2024-09-21T06:12:15.506519+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:12:15.506519+0000","last_undegraded":"2024-09-21T06:12:15.506519+0000","last_fullsized":"2024-09-21T06:12:15.506519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515287+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:12:15.515287+0000","last_peered":"2024-09-21T06:12:15.515287+0000","last_clean":"2024-09-21T06:12:15.515287+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:12:15.515287+0000","last_undegraded":"2024-09-21T06:12:15.515287+0000","last_fullsized":"2024-09-21T06:12:15.515287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.507300+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:12:15.507300+0000","last_peered":"2024-09-21T06:12:15.507300+0000","last_clean":"2024-09-21T06:12:15.507300+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:12:15.507300+0000","last_undegraded":"2024-09-21T06:12:15.507300+0000","last_fullsized":"2024-09-21T06:12:15.507300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.533005+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:12:15.533005+0000","last_peered":"2024-09-21T06:12:15.533005+0000","last_clean":"2024-09-21T06:12:15.533005+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:12:15.533005+0000","last_undegraded":"2024-09-21T06:12:15.533005+0000","last_fullsized":"2024-09-21T06:12:15.533005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517964+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:12:15.517964+0000","last_peered":"2024-09-21T06:12:15.517964+0000","last_clean":"2024-09-21T06:12:15.517964+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:12:15.517964+0000","last_undegraded":"2024-09-21T06:12:15.517964+0000","last_fullsized":"2024-09-21T06:12:15.517964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526826+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:12:15.526826+0000","last_peered":"2024-09-21T06:12:15.526826+0000","last_clean":"2024-09-21T06:12:15.526826+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:12:15.526826+0000","last_undegraded":"2024-09-21T06:12:15.526826+0000","last_fullsized":"2024-09-21T06:12:15.526826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.519072+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:12:15.519072+0000","last_peered":"2024-09-21T06:12:15.519072+0000","last_clean":"2024-09-21T06:12:15.519072+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:12:15.519072+0000","last_undegraded":"2024-09-21T06:12:15.519072+0000","last_fullsized":"2024-09-21T06:12:15.519072+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529805+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:12:15.529805+0000","last_peered":"2024-09-21T06:12:15.529805+0000","last_clean":"2024-09-21T06:12:15.529805+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:12:15.529805+0000","last_undegraded":"2024-09-21T06:12:15.529805+0000","last_fullsized":"2024-09-21T06:12:15.529805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517772+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:12:15.517772+0000","last_peered":"2024-09-21T06:12:15.517772+0000","last_clean":"2024-09-21T06:12:15.517772+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:12:15.517772+0000","last_undegraded":"2024-09-21T06:12:15.517772+0000","last_fullsized":"2024-09-21T06:12:15.517772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532761+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:12:15.532761+0000","last_peered":"2024-09-21T06:12:15.532761+0000","last_clean":"2024-09-21T06:12:15.532761+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:12:15.532761+0000","last_undegraded":"2024-09-21T06:12:15.532761+0000","last_fullsized":"2024-09-21T06:12:15.532761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526427+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:12:15.526427+0000","last_peered":"2024-09-21T06:12:15.526427+0000","last_clean":"2024-09-21T06:12:15.526427+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:12:15.526427+0000","last_undegraded":"2024-09-21T06:12:15.526427+0000","last_fullsized":"2024-09-21T06:12:15.526427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530631+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:12:15.530631+0000","last_peered":"2024-09-21T06:12:15.530631+0000","last_clean":"2024-09-21T06:12:15.530631+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:12:15.530631+0000","last_undegraded":"2024-09-21T06:12:15.530631+0000","last_fullsized":"2024-09-21T06:12:15.530631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511306+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:12:15.511306+0000","last_peered":"2024-09-21T06:12:15.511306+0000","last_clean":"2024-09-21T06:12:15.511306+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:12:15.511306+0000","last_undegraded":"2024-09-21T06:12:15.511306+0000","last_fullsized":"2024-09-21T06:12:15.511306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.524445+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:12:15.524445+0000","last_peered":"2024-09-21T06:12:15.524445+0000","last_clean":"2024-09-21T06:12:15.524445+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:12:15.524445+0000","last_undegraded":"2024-09-21T06:12:15.524445+0000","last_fullsized":"2024-09-21T06:12:15.524445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.531564+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:12:15.531564+0000","last_peered":"2024-09-21T06:12:15.531564+0000","last_clean":"2024-09-21T06:12:15.531564+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:12:15.531564+0000","last_undegraded":"2024-09-21T06:12:15.531564+0000","last_fullsized":"2024-09-21T06:12:15.531564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520739+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:12:15.520739+0000","last_peered":"2024-09-21T06:12:15.520739+0000","last_clean":"2024-09-21T06:12:15.520739+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:12:15.520739+0000","last_undegraded":"2024-09-21T06:12:15.520739+0000","last_fullsized":"2024-09-21T06:12:15.520739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532893+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:12:15.532893+0000","last_peered":"2024-09-21T06:12:15.532893+0000","last_clean":"2024-09-21T06:12:15.532893+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:12:15.532893+0000","last_undegraded":"2024-09-21T06:12:15.532893+0000","last_fullsized":"2024-09-21T06:12:15.532893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529624+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:12:15.529624+0000","last_peered":"2024-09-21T06:12:15.529624+0000","last_clean":"2024-09-21T06:12:15.529624+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:12:15.529624+0000","last_undegraded":"2024-09-21T06:12:15.529624+0000","last_fullsized":"2024-09-21T06:12:15.529624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.519820+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:12:15.519820+0000","last_peered":"2024-09-21T06:12:15.519820+0000","last_clean":"2024-09-21T06:12:15.519820+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:12:15.519820+0000","last_undegraded":"2024-09-21T06:12:15.519820+0000","last_fullsized":"2024-09-21T06:12:15.519820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526074+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:12:15.526074+0000","last_peered":"2024-09-21T06:12:15.526074+0000","last_clean":"2024-09-21T06:12:15.526074+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:12:15.526074+0000","last_undegraded":"2024-09-21T06:12:15.526074+0000","last_fullsized":"2024-09-21T06:12:15.526074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.500611+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:12:15.500611+0000","last_peered":"2024-09-21T06:12:15.500611+0000","last_clean":"2024-09-21T06:12:15.500611+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:12:15.500611+0000","last_undegraded":"2024-09-21T06:12:15.500611+0000","last_fullsized":"2024-09-21T06:12:15.500611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.525142+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:12:15.525142+0000","last_peered":"2024-09-21T06:12:15.525142+0000","last_clean":"2024-09-21T06:12:15.525142+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:12:15.525142+0000","last_undegraded":"2024-09-21T06:12:15.525142+0000","last_fullsized":"2024-09-21T06:12:15.525142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529460+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:12:15.529460+0000","last_peered":"2024-09-21T06:12:15.529460+0000","last_clean":"2024-09-21T06:12:15.529460+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:12:15.529460+0000","last_undegraded":"2024-09-21T06:12:15.529460+0000","last_fullsized":"2024-09-21T06:12:15.529460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530065+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:12:15.530065+0000","last_peered":"2024-09-21T06:12:15.530065+0000","last_clean":"2024-09-21T06:12:15.530065+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:12:15.530065+0000","last_undegraded":"2024-09-21T06:12:15.530065+0000","last_fullsized":"2024-09-21T06:12:15.530065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517415+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:12:15.517415+0000","last_peered":"2024-09-21T06:12:15.517415+0000","last_clean":"2024-09-21T06:12:15.517415+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:12:15.517415+0000","last_undegraded":"2024-09-21T06:12:15.517415+0000","last_fullsized":"2024-09-21T06:12:15.517415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71550,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":639,"num_read_kb":395,"num_write":179,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":223348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":473624,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939696,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":1127331,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070517,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":477934,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266746,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":473736,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430271,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1070262,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":469014,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790026,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1065357,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953551,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":473664,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149780,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":469208,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":542070,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":540227,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":470402,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:12:46.222 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:12:46.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:12:46.493 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:46.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:46 smithi017 ceph-mon[31080]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:12:46.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:46 smithi017 ceph-mon[31080]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 -- 172.21.15.17:0/2171160360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 msgr2=0x7f2870103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 --2- 172.21.15.17:0/2171160360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f2870103fa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2858009900 tx=0x7f285802a410 comp rx=0 tx=0).stop 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 -- 172.21.15.17:0/2171160360 shutdown_connections 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 --2- 172.21.15.17:0/2171160360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 0x7f2870110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 --2- 172.21.15.17:0/2171160360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28701094d0 0x7f28701098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 --2- 172.21.15.17:0/2171160360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f2870103fa0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.000+0000 7f287725f640 1 -- 172.21.15.17:0/2171160360 >> 172.21.15.17:0/2171160360 conn(0x7f28700ff600 msgr2=0x7f2870101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.001+0000 7f287725f640 1 -- 172.21.15.17:0/2171160360 shutdown_connections 2024-09-21T06:12:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.001+0000 7f287725f640 1 -- 172.21.15.17:0/2171160360 wait complete. 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.001+0000 7f287725f640 1 Processor -- start 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.001+0000 7f287725f640 1 -- start start 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.001+0000 7f287725f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f287019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.001+0000 7f287725f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28701094d0 0x7f287019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f287725f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 0x7f287019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f287725f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2870113990 con 0x7f2870103b90 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f287725f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2870113810 con 0x7f28701094d0 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f287725f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2870113b10 con 0x7f2870109e20 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f287019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f287019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58874/0 (socket says 172.21.15.17:58874) 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 -- 172.21.15.17:0/2288459673 learned_addr learned my addr 172.21.15.17:0/2288459673 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f28757fc640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 0x7f287019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f286ffff640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28701094d0 0x7f287019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 -- 172.21.15.17:0/2288459673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 msgr2=0x7f287019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 0x7f287019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 -- 172.21.15.17:0/2288459673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28701094d0 msgr2=0x7f287019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28701094d0 0x7f287019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 -- 172.21.15.17:0/2288459673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28701a0370 con 0x7f2870103b90 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f28757fc640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 0x7f287019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f2874ffb640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f287019a400 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2858009230 tx=0x7f2858004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285803f030 con 0x7f2870103b90 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28701a0600 con 0x7f2870103b90 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2858003a80 con 0x7f2870103b90 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.002+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858035070 con 0x7f2870103b90 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.003+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28701a6dc0 con 0x7f2870103b90 2024-09-21T06:12:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.004+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2870104e10 con 0x7f2870103b90 2024-09-21T06:12:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.005+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2858042030 con 0x7f2870103b90 2024-09-21T06:12:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.006+0000 7f286dffb640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f285c0b6510 0x7f285c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.006+0000 7f286ffff640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f285c0b6510 0x7f285c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.006+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f2858108280 con 0x7f2870103b90 2024-09-21T06:12:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.007+0000 7f286ffff640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f285c0b6510 0x7f285c0b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2860005fd0 tx=0x7f2860005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.009+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28580ce720 con 0x7f2870103b90 2024-09-21T06:12:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:46 smithi089 ceph-mon[33879]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:12:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:46 smithi089 ceph-mon[33879]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.196+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 --> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2870063800 con 0x7f285c0b6510 2024-09-21T06:12:47.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.202+0000 7f286dffb640 1 -- 172.21.15.17:0/2288459673 <== mgr.14152 v2:172.21.15.17:6800/1923174301 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340693 (secure 0 0 0) 0x7f2870063800 con 0x7f285c0b6510 2024-09-21T06:12:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f285c0b6510 msgr2=0x7f285c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f285c0b6510 0x7f285c0b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2860005fd0 tx=0x7f2860005850 comp rx=0 tx=0).stop 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 msgr2=0x7f287019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f287019a400 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2858009230 tx=0x7f2858004270 comp rx=0 tx=0).stop 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 shutdown_connections 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f285c0b6510 0x7f285c0b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2870109e20 0x7f287019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28701094d0 0x7f287019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 --2- 172.21.15.17:0/2288459673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870103b90 0x7f287019a400 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 >> 172.21.15.17:0/2288459673 conn(0x7f28700ff600 msgr2=0x7f2870101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 shutdown_connections 2024-09-21T06:12:47.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:47.205+0000 7f287725f640 1 -- 172.21.15.17:0/2288459673 wait complete. 2024-09-21T06:12:47.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:46 smithi081 ceph-mon[33870]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:12:47.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:46 smithi081 ceph-mon[33870]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:47.971 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-21T06:12:47.166438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666501,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":743,"num_read_kb":476,"num_write":307,"num_write_kb":2287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":748,"ondisk_log_size":748,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372956,"kb_used_data":11228,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568868,"statfs":{"total":1151940427776,"available":1151558520832,"internally_reserved":0,"allocated":11497472,"data_stored":7658657,"data_compressed":461643,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5828,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":48,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003662"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888698+0000","last_change":"2024-09-21T06:10:14.528872+0000","last_active":"2024-09-21T06:11:47.888698+0000","last_peered":"2024-09-21T06:11:47.888698+0000","last_clean":"2024-09-21T06:11:47.888698+0000","last_became_active":"2024-09-21T06:10:14.528630+0000","last_became_peered":"2024-09-21T06:10:14.528630+0000","last_unstale":"2024-09-21T06:11:47.888698+0000","last_undegraded":"2024-09-21T06:11:47.888698+0000","last_fullsized":"2024-09-21T06:11:47.888698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:59.479171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515378+0000","last_change":"2024-09-21T06:10:16.537299+0000","last_active":"2024-09-21T06:12:15.515378+0000","last_peered":"2024-09-21T06:12:15.515378+0000","last_clean":"2024-09-21T06:12:15.515378+0000","last_became_active":"2024-09-21T06:10:16.536959+0000","last_became_peered":"2024-09-21T06:10:16.536959+0000","last_unstale":"2024-09-21T06:12:15.515378+0000","last_undegraded":"2024-09-21T06:12:15.515378+0000","last_fullsized":"2024-09-21T06:12:15.515378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:29.482295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683054+0000","last_change":"2024-09-21T06:10:23.593582+0000","last_active":"2024-09-21T06:11:47.683054+0000","last_peered":"2024-09-21T06:11:47.683054+0000","last_clean":"2024-09-21T06:11:47.683054+0000","last_became_active":"2024-09-21T06:10:23.593125+0000","last_became_peered":"2024-09-21T06:10:23.593125+0000","last_unstale":"2024-09-21T06:11:47.683054+0000","last_undegraded":"2024-09-21T06:11:47.683054+0000","last_fullsized":"2024-09-21T06:11:47.683054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:47.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684717+0000","last_change":"2024-09-21T06:10:14.604144+0000","last_active":"2024-09-21T06:11:47.684717+0000","last_peered":"2024-09-21T06:11:47.684717+0000","last_clean":"2024-09-21T06:11:47.684717+0000","last_became_active":"2024-09-21T06:10:14.603676+0000","last_became_peered":"2024-09-21T06:10:14.603676+0000","last_unstale":"2024-09-21T06:11:47.684717+0000","last_undegraded":"2024-09-21T06:11:47.684717+0000","last_fullsized":"2024-09-21T06:11:47.684717+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:10.051593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528390+0000","last_change":"2024-09-21T06:10:16.536515+0000","last_active":"2024-09-21T06:12:15.528390+0000","last_peered":"2024-09-21T06:12:15.528390+0000","last_clean":"2024-09-21T06:12:15.528390+0000","last_became_active":"2024-09-21T06:10:16.536129+0000","last_became_peered":"2024-09-21T06:10:16.536129+0000","last_unstale":"2024-09-21T06:12:15.528390+0000","last_undegraded":"2024-09-21T06:12:15.528390+0000","last_fullsized":"2024-09-21T06:12:15.528390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:23.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766526+0000","last_change":"2024-09-21T06:10:23.585457+0000","last_active":"2024-09-21T06:11:47.766526+0000","last_peered":"2024-09-21T06:11:47.766526+0000","last_clean":"2024-09-21T06:11:47.766526+0000","last_became_active":"2024-09-21T06:10:23.585044+0000","last_became_peered":"2024-09-21T06:10:23.585044+0000","last_unstale":"2024-09-21T06:11:47.766526+0000","last_undegraded":"2024-09-21T06:11:47.766526+0000","last_fullsized":"2024-09-21T06:11:47.766526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.979565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685582+0000","last_change":"2024-09-21T06:10:46.680312+0000","last_active":"2024-09-21T06:11:47.685582+0000","last_peered":"2024-09-21T06:11:47.685582+0000","last_clean":"2024-09-21T06:11:47.685582+0000","last_became_active":"2024-09-21T06:10:46.673253+0000","last_became_peered":"2024-09-21T06:10:46.673253+0000","last_unstale":"2024-09-21T06:11:47.685582+0000","last_undegraded":"2024-09-21T06:11:47.685582+0000","last_fullsized":"2024-09-21T06:11:47.685582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528030+0000","last_change":"2024-09-21T06:10:16.541246+0000","last_active":"2024-09-21T06:12:15.528030+0000","last_peered":"2024-09-21T06:12:15.528030+0000","last_clean":"2024-09-21T06:12:15.528030+0000","last_became_active":"2024-09-21T06:10:16.540850+0000","last_became_peered":"2024-09-21T06:10:16.540850+0000","last_unstale":"2024-09-21T06:12:15.528030+0000","last_undegraded":"2024-09-21T06:12:15.528030+0000","last_fullsized":"2024-09-21T06:12:15.528030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:19.099565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766810+0000","last_change":"2024-09-21T06:10:46.783736+0000","last_active":"2024-09-21T06:11:47.766810+0000","last_peered":"2024-09-21T06:11:47.766810+0000","last_clean":"2024-09-21T06:11:47.766810+0000","last_became_active":"2024-09-21T06:10:46.783242+0000","last_became_peered":"2024-09-21T06:10:46.783242+0000","last_unstale":"2024-09-21T06:11:47.766810+0000","last_undegraded":"2024-09-21T06:11:47.766810+0000","last_fullsized":"2024-09-21T06:11:47.766810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:50.847167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685516+0000","last_change":"2024-09-21T06:10:14.528678+0000","last_active":"2024-09-21T06:11:47.685516+0000","last_peered":"2024-09-21T06:11:47.685516+0000","last_clean":"2024-09-21T06:11:47.685516+0000","last_became_active":"2024-09-21T06:10:14.528290+0000","last_became_peered":"2024-09-21T06:10:14.528290+0000","last_unstale":"2024-09-21T06:11:47.685516+0000","last_undegraded":"2024-09-21T06:11:47.685516+0000","last_fullsized":"2024-09-21T06:11:47.685516+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:49.477569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.533708+0000","last_change":"2024-09-21T06:10:16.535019+0000","last_active":"2024-09-21T06:12:15.533708+0000","last_peered":"2024-09-21T06:12:15.533708+0000","last_clean":"2024-09-21T06:12:15.533708+0000","last_became_active":"2024-09-21T06:10:16.533176+0000","last_became_peered":"2024-09-21T06:10:16.533176+0000","last_unstale":"2024-09-21T06:12:15.533708+0000","last_undegraded":"2024-09-21T06:12:15.533708+0000","last_fullsized":"2024-09-21T06:12:15.533708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.080065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.766802+0000","last_change":"2024-09-21T06:10:23.581217+0000","last_active":"2024-09-21T06:11:47.766802+0000","last_peered":"2024-09-21T06:11:47.766802+0000","last_clean":"2024-09-21T06:11:47.766802+0000","last_became_active":"2024-09-21T06:10:23.580718+0000","last_became_peered":"2024-09-21T06:10:23.580718+0000","last_unstale":"2024-09-21T06:11:47.766802+0000","last_undegraded":"2024-09-21T06:11:47.766802+0000","last_fullsized":"2024-09-21T06:11:47.766802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:23.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530716+0000","last_change":"2024-09-21T06:10:16.549973+0000","last_active":"2024-09-21T06:12:15.530716+0000","last_peered":"2024-09-21T06:12:15.530716+0000","last_clean":"2024-09-21T06:12:15.530716+0000","last_became_active":"2024-09-21T06:10:16.549598+0000","last_became_peered":"2024-09-21T06:10:16.549598+0000","last_unstale":"2024-09-21T06:12:15.530716+0000","last_undegraded":"2024-09-21T06:12:15.530716+0000","last_fullsized":"2024-09-21T06:12:15.530716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:21.180089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684943+0000","last_change":"2024-09-21T06:10:14.529982+0000","last_active":"2024-09-21T06:11:47.684943+0000","last_peered":"2024-09-21T06:11:47.684943+0000","last_clean":"2024-09-21T06:11:47.684943+0000","last_became_active":"2024-09-21T06:10:14.529523+0000","last_became_peered":"2024-09-21T06:10:14.529523+0000","last_unstale":"2024-09-21T06:11:47.684943+0000","last_undegraded":"2024-09-21T06:11:47.684943+0000","last_fullsized":"2024-09-21T06:11:47.684943+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:05.993893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767278+0000","last_change":"2024-09-21T06:10:23.979848+0000","last_active":"2024-09-21T06:11:47.767278+0000","last_peered":"2024-09-21T06:11:47.767278+0000","last_clean":"2024-09-21T06:11:47.767278+0000","last_became_active":"2024-09-21T06:10:23.979324+0000","last_became_peered":"2024-09-21T06:10:23.979324+0000","last_unstale":"2024-09-21T06:11:47.767278+0000","last_undegraded":"2024-09-21T06:11:47.767278+0000","last_fullsized":"2024-09-21T06:11:47.767278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:15.750478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529637+0000","last_change":"2024-09-21T06:10:16.533870+0000","last_active":"2024-09-21T06:12:15.529637+0000","last_peered":"2024-09-21T06:12:15.529637+0000","last_clean":"2024-09-21T06:12:15.529637+0000","last_became_active":"2024-09-21T06:10:16.533465+0000","last_became_peered":"2024-09-21T06:10:16.533465+0000","last_unstale":"2024-09-21T06:12:15.529637+0000","last_undegraded":"2024-09-21T06:12:15.529637+0000","last_fullsized":"2024-09-21T06:12:15.529637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:26.646329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:51.194821+0000","last_change":"2024-09-21T06:11:47.688842+0000","last_active":"2024-09-21T06:11:51.194821+0000","last_peered":"2024-09-21T06:11:51.194821+0000","last_clean":"2024-09-21T06:11:51.194821+0000","last_became_active":"2024-09-21T06:11:47.685980+0000","last_became_peered":"2024-09-21T06:11:47.685980+0000","last_unstale":"2024-09-21T06:11:51.194821+0000","last_undegraded":"2024-09-21T06:11:51.194821+0000","last_fullsized":"2024-09-21T06:11:51.194821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:29:40.815179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767157+0000","last_change":"2024-09-21T06:10:23.584920+0000","last_active":"2024-09-21T06:11:47.767157+0000","last_peered":"2024-09-21T06:11:47.767157+0000","last_clean":"2024-09-21T06:11:47.767157+0000","last_became_active":"2024-09-21T06:10:23.584392+0000","last_became_peered":"2024-09-21T06:10:23.584392+0000","last_unstale":"2024-09-21T06:11:47.767157+0000","last_undegraded":"2024-09-21T06:11:47.767157+0000","last_fullsized":"2024-09-21T06:11:47.767157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:27.799268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520061+0000","last_change":"2024-09-21T06:10:16.545496+0000","last_active":"2024-09-21T06:12:15.520061+0000","last_peered":"2024-09-21T06:12:15.520061+0000","last_clean":"2024-09-21T06:12:15.520061+0000","last_became_active":"2024-09-21T06:10:16.545155+0000","last_became_peered":"2024-09-21T06:10:16.545155+0000","last_unstale":"2024-09-21T06:12:15.520061+0000","last_undegraded":"2024-09-21T06:12:15.520061+0000","last_fullsized":"2024-09-21T06:12:15.520061+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:31.487091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684702+0000","last_change":"2024-09-21T06:10:14.526746+0000","last_active":"2024-09-21T06:11:47.684702+0000","last_peered":"2024-09-21T06:11:47.684702+0000","last_clean":"2024-09-21T06:11:47.684702+0000","last_became_active":"2024-09-21T06:10:14.526341+0000","last_became_peered":"2024-09-21T06:10:14.526341+0000","last_unstale":"2024-09-21T06:11:47.684702+0000","last_undegraded":"2024-09-21T06:11:47.684702+0000","last_fullsized":"2024-09-21T06:11:47.684702+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:35.784391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684970+0000","last_change":"2024-09-21T06:10:46.785088+0000","last_active":"2024-09-21T06:11:47.684970+0000","last_peered":"2024-09-21T06:11:47.684970+0000","last_clean":"2024-09-21T06:11:47.684970+0000","last_became_active":"2024-09-21T06:10:46.784408+0000","last_became_peered":"2024-09-21T06:10:46.784408+0000","last_unstale":"2024-09-21T06:11:47.684970+0000","last_undegraded":"2024-09-21T06:11:47.684970+0000","last_fullsized":"2024-09-21T06:11:47.684970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:28.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511365+0000","last_change":"2024-09-21T06:10:16.537998+0000","last_active":"2024-09-21T06:12:15.511365+0000","last_peered":"2024-09-21T06:12:15.511365+0000","last_clean":"2024-09-21T06:12:15.511365+0000","last_became_active":"2024-09-21T06:10:16.537233+0000","last_became_peered":"2024-09-21T06:10:16.537233+0000","last_unstale":"2024-09-21T06:12:15.511365+0000","last_undegraded":"2024-09-21T06:12:15.511365+0000","last_fullsized":"2024-09-21T06:12:15.511365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:51.162550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678082+0000","last_change":"2024-09-21T06:10:14.604599+0000","last_active":"2024-09-21T06:11:47.678082+0000","last_peered":"2024-09-21T06:11:47.678082+0000","last_clean":"2024-09-21T06:11:47.678082+0000","last_became_active":"2024-09-21T06:10:14.604163+0000","last_became_peered":"2024-09-21T06:10:14.604163+0000","last_unstale":"2024-09-21T06:11:47.678082+0000","last_undegraded":"2024-09-21T06:11:47.678082+0000","last_fullsized":"2024-09-21T06:11:47.678082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:42.705147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767365+0000","last_change":"2024-09-21T06:10:46.672355+0000","last_active":"2024-09-21T06:11:47.767365+0000","last_peered":"2024-09-21T06:11:47.767365+0000","last_clean":"2024-09-21T06:11:47.767365+0000","last_became_active":"2024-09-21T06:10:46.671508+0000","last_became_peered":"2024-09-21T06:10:46.671508+0000","last_unstale":"2024-09-21T06:11:47.767365+0000","last_undegraded":"2024-09-21T06:11:47.767365+0000","last_fullsized":"2024-09-21T06:11:47.767365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:10:14.543797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526493+0000","last_change":"2024-09-21T06:10:16.541980+0000","last_active":"2024-09-21T06:12:15.526493+0000","last_peered":"2024-09-21T06:12:15.526493+0000","last_clean":"2024-09-21T06:12:15.526493+0000","last_became_active":"2024-09-21T06:10:16.541604+0000","last_became_peered":"2024-09-21T06:10:16.541604+0000","last_unstale":"2024-09-21T06:12:15.526493+0000","last_undegraded":"2024-09-21T06:12:15.526493+0000","last_fullsized":"2024-09-21T06:12:15.526493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:10.586766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767552+0000","last_change":"2024-09-21T06:10:15.398363+0000","last_active":"2024-09-21T06:11:47.767552+0000","last_peered":"2024-09-21T06:11:47.767552+0000","last_clean":"2024-09-21T06:11:47.767552+0000","last_became_active":"2024-09-21T06:10:15.397911+0000","last_became_peered":"2024-09-21T06:10:15.397911+0000","last_unstale":"2024-09-21T06:11:47.767552+0000","last_undegraded":"2024-09-21T06:11:47.767552+0000","last_fullsized":"2024-09-21T06:11:47.767552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:23.989705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.683342+0000","last_change":"2024-09-21T06:10:23.583935+0000","last_active":"2024-09-21T06:11:47.683342+0000","last_peered":"2024-09-21T06:11:47.683342+0000","last_clean":"2024-09-21T06:11:47.683342+0000","last_became_active":"2024-09-21T06:10:23.583350+0000","last_became_peered":"2024-09-21T06:10:23.583350+0000","last_unstale":"2024-09-21T06:11:47.683342+0000","last_undegraded":"2024-09-21T06:11:47.683342+0000","last_fullsized":"2024-09-21T06:11:47.683342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:49.045370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.516838+0000","last_change":"2024-09-21T06:10:16.542535+0000","last_active":"2024-09-21T06:12:15.516838+0000","last_peered":"2024-09-21T06:12:15.516838+0000","last_clean":"2024-09-21T06:12:15.516838+0000","last_became_active":"2024-09-21T06:10:16.542100+0000","last_became_peered":"2024-09-21T06:10:16.542100+0000","last_unstale":"2024-09-21T06:12:15.516838+0000","last_undegraded":"2024-09-21T06:12:15.516838+0000","last_fullsized":"2024-09-21T06:12:15.516838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:59.821727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'13","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:25.171734+0000","last_change":"2024-09-21T06:10:14.523520+0000","last_active":"2024-09-21T06:12:25.171734+0000","last_peered":"2024-09-21T06:12:25.171734+0000","last_clean":"2024-09-21T06:12:25.171734+0000","last_became_active":"2024-09-21T06:10:14.523162+0000","last_became_peered":"2024-09-21T06:10:14.523162+0000","last_unstale":"2024-09-21T06:12:25.171734+0000","last_undegraded":"2024-09-21T06:12:25.171734+0000","last_fullsized":"2024-09-21T06:12:25.171734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:39.558531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684254+0000","last_change":"2024-09-21T06:10:23.979658+0000","last_active":"2024-09-21T06:11:47.684254+0000","last_peered":"2024-09-21T06:11:47.684254+0000","last_clean":"2024-09-21T06:11:47.684254+0000","last_became_active":"2024-09-21T06:10:23.979163+0000","last_became_peered":"2024-09-21T06:10:23.979163+0000","last_unstale":"2024-09-21T06:11:47.684254+0000","last_undegraded":"2024-09-21T06:11:47.684254+0000","last_fullsized":"2024-09-21T06:11:47.684254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:39.195664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.508678+0000","last_change":"2024-09-21T06:10:16.537267+0000","last_active":"2024-09-21T06:12:15.508678+0000","last_peered":"2024-09-21T06:12:15.508678+0000","last_clean":"2024-09-21T06:12:15.508678+0000","last_became_active":"2024-09-21T06:10:16.536940+0000","last_became_peered":"2024-09-21T06:10:16.536940+0000","last_unstale":"2024-09-21T06:12:15.508678+0000","last_undegraded":"2024-09-21T06:12:15.508678+0000","last_fullsized":"2024-09-21T06:12:15.508678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:29.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685479+0000","last_change":"2024-09-21T06:10:14.604688+0000","last_active":"2024-09-21T06:11:47.685479+0000","last_peered":"2024-09-21T06:11:47.685479+0000","last_clean":"2024-09-21T06:11:47.685479+0000","last_became_active":"2024-09-21T06:10:14.604078+0000","last_became_peered":"2024-09-21T06:10:14.604078+0000","last_unstale":"2024-09-21T06:11:47.685479+0000","last_undegraded":"2024-09-21T06:11:47.685479+0000","last_fullsized":"2024-09-21T06:11:47.685479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:43.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682161+0000","last_change":"2024-09-21T06:10:23.589470+0000","last_active":"2024-09-21T06:11:47.682161+0000","last_peered":"2024-09-21T06:11:47.682161+0000","last_clean":"2024-09-21T06:11:47.682161+0000","last_became_active":"2024-09-21T06:10:23.589038+0000","last_became_peered":"2024-09-21T06:10:23.589038+0000","last_unstale":"2024-09-21T06:11:47.682161+0000","last_undegraded":"2024-09-21T06:11:47.682161+0000","last_fullsized":"2024-09-21T06:11:47.682161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:11.550989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517397+0000","last_change":"2024-09-21T06:10:16.530467+0000","last_active":"2024-09-21T06:12:15.517397+0000","last_peered":"2024-09-21T06:12:15.517397+0000","last_clean":"2024-09-21T06:12:15.517397+0000","last_became_active":"2024-09-21T06:10:16.530099+0000","last_became_peered":"2024-09-21T06:10:16.530099+0000","last_unstale":"2024-09-21T06:12:15.517397+0000","last_undegraded":"2024-09-21T06:12:15.517397+0000","last_fullsized":"2024-09-21T06:12:15.517397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:06.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888263+0000","last_change":"2024-09-21T06:10:14.606323+0000","last_active":"2024-09-21T06:11:47.888263+0000","last_peered":"2024-09-21T06:11:47.888263+0000","last_clean":"2024-09-21T06:11:47.888263+0000","last_became_active":"2024-09-21T06:10:14.605956+0000","last_became_peered":"2024-09-21T06:10:14.605956+0000","last_unstale":"2024-09-21T06:11:47.888263+0000","last_undegraded":"2024-09-21T06:11:47.888263+0000","last_fullsized":"2024-09-21T06:11:47.888263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:38.429890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685148+0000","last_change":"2024-09-21T06:10:23.979943+0000","last_active":"2024-09-21T06:11:47.685148+0000","last_peered":"2024-09-21T06:11:47.685148+0000","last_clean":"2024-09-21T06:11:47.685148+0000","last_became_active":"2024-09-21T06:10:23.979377+0000","last_became_peered":"2024-09-21T06:10:23.979377+0000","last_unstale":"2024-09-21T06:11:47.685148+0000","last_undegraded":"2024-09-21T06:11:47.685148+0000","last_fullsized":"2024-09-21T06:11:47.685148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.665562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.527626+0000","last_change":"2024-09-21T06:10:16.535369+0000","last_active":"2024-09-21T06:12:15.527626+0000","last_peered":"2024-09-21T06:12:15.527626+0000","last_clean":"2024-09-21T06:12:15.527626+0000","last_became_active":"2024-09-21T06:10:16.534966+0000","last_became_peered":"2024-09-21T06:10:16.534966+0000","last_unstale":"2024-09-21T06:12:15.527626+0000","last_undegraded":"2024-09-21T06:12:15.527626+0000","last_fullsized":"2024-09-21T06:12:15.527626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:21.124462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680958+0000","last_change":"2024-09-21T06:10:14.533612+0000","last_active":"2024-09-21T06:11:47.680958+0000","last_peered":"2024-09-21T06:11:47.680958+0000","last_clean":"2024-09-21T06:11:47.680958+0000","last_became_active":"2024-09-21T06:10:14.533108+0000","last_became_peered":"2024-09-21T06:10:14.533108+0000","last_unstale":"2024-09-21T06:11:47.680958+0000","last_undegraded":"2024-09-21T06:11:47.680958+0000","last_fullsized":"2024-09-21T06:11:47.680958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:13.779094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677491+0000","last_change":"2024-09-21T06:10:23.586279+0000","last_active":"2024-09-21T06:11:47.677491+0000","last_peered":"2024-09-21T06:11:47.677491+0000","last_clean":"2024-09-21T06:11:47.677491+0000","last_became_active":"2024-09-21T06:10:23.585875+0000","last_became_peered":"2024-09-21T06:10:23.585875+0000","last_unstale":"2024-09-21T06:11:47.677491+0000","last_undegraded":"2024-09-21T06:11:47.677491+0000","last_fullsized":"2024-09-21T06:11:47.677491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:24.792226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511982+0000","last_change":"2024-09-21T06:10:16.538002+0000","last_active":"2024-09-21T06:12:15.511982+0000","last_peered":"2024-09-21T06:12:15.511982+0000","last_clean":"2024-09-21T06:12:15.511982+0000","last_became_active":"2024-09-21T06:10:16.537549+0000","last_became_peered":"2024-09-21T06:10:16.537549+0000","last_unstale":"2024-09-21T06:12:15.511982+0000","last_undegraded":"2024-09-21T06:12:15.511982+0000","last_fullsized":"2024-09-21T06:12:15.511982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:38.186894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:41.899744+0000","last_change":"2024-09-21T06:10:14.604191+0000","last_active":"2024-09-21T06:12:41.899744+0000","last_peered":"2024-09-21T06:12:41.899744+0000","last_clean":"2024-09-21T06:12:41.899744+0000","last_became_active":"2024-09-21T06:10:14.603831+0000","last_became_peered":"2024-09-21T06:10:14.603831+0000","last_unstale":"2024-09-21T06:12:41.899744+0000","last_undegraded":"2024-09-21T06:12:41.899744+0000","last_fullsized":"2024-09-21T06:12:41.899744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:02.634194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677750+0000","last_change":"2024-09-21T06:10:23.979801+0000","last_active":"2024-09-21T06:11:47.677750+0000","last_peered":"2024-09-21T06:11:47.677750+0000","last_clean":"2024-09-21T06:11:47.677750+0000","last_became_active":"2024-09-21T06:10:23.979298+0000","last_became_peered":"2024-09-21T06:10:23.979298+0000","last_unstale":"2024-09-21T06:11:47.677750+0000","last_undegraded":"2024-09-21T06:11:47.677750+0000","last_fullsized":"2024-09-21T06:11:47.677750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:54.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.518463+0000","last_change":"2024-09-21T06:10:16.537185+0000","last_active":"2024-09-21T06:12:15.518463+0000","last_peered":"2024-09-21T06:12:15.518463+0000","last_clean":"2024-09-21T06:12:15.518463+0000","last_became_active":"2024-09-21T06:10:16.536831+0000","last_became_peered":"2024-09-21T06:10:16.536831+0000","last_unstale":"2024-09-21T06:12:15.518463+0000","last_undegraded":"2024-09-21T06:12:15.518463+0000","last_fullsized":"2024-09-21T06:12:15.518463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:08.727984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.680635+0000","last_change":"2024-09-21T06:10:14.534228+0000","last_active":"2024-09-21T06:11:47.680635+0000","last_peered":"2024-09-21T06:11:47.680635+0000","last_clean":"2024-09-21T06:11:47.680635+0000","last_became_active":"2024-09-21T06:10:14.533633+0000","last_became_peered":"2024-09-21T06:10:14.533633+0000","last_unstale":"2024-09-21T06:11:47.680635+0000","last_undegraded":"2024-09-21T06:11:47.680635+0000","last_fullsized":"2024-09-21T06:11:47.680635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:03.038748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678849+0000","last_change":"2024-09-21T06:10:23.981140+0000","last_active":"2024-09-21T06:11:47.678849+0000","last_peered":"2024-09-21T06:11:47.678849+0000","last_clean":"2024-09-21T06:11:47.678849+0000","last_became_active":"2024-09-21T06:10:23.980254+0000","last_became_peered":"2024-09-21T06:10:23.980254+0000","last_unstale":"2024-09-21T06:11:47.678849+0000","last_undegraded":"2024-09-21T06:11:47.678849+0000","last_fullsized":"2024-09-21T06:11:47.678849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:59.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.525129+0000","last_change":"2024-09-21T06:10:16.535110+0000","last_active":"2024-09-21T06:12:15.525129+0000","last_peered":"2024-09-21T06:12:15.525129+0000","last_clean":"2024-09-21T06:12:15.525129+0000","last_became_active":"2024-09-21T06:10:16.534770+0000","last_became_peered":"2024-09-21T06:10:16.534770+0000","last_unstale":"2024-09-21T06:12:15.525129+0000","last_undegraded":"2024-09-21T06:12:15.525129+0000","last_fullsized":"2024-09-21T06:12:15.525129+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:10.613220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767139+0000","last_change":"2024-09-21T06:10:14.525864+0000","last_active":"2024-09-21T06:11:47.767139+0000","last_peered":"2024-09-21T06:11:47.767139+0000","last_clean":"2024-09-21T06:11:47.767139+0000","last_became_active":"2024-09-21T06:10:14.525425+0000","last_became_peered":"2024-09-21T06:10:14.525425+0000","last_unstale":"2024-09-21T06:11:47.767139+0000","last_undegraded":"2024-09-21T06:11:47.767139+0000","last_fullsized":"2024-09-21T06:11:47.767139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:10.281323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":108,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681028+0000","last_change":"2024-09-21T06:09:01.427437+0000","last_active":"2024-09-21T06:11:47.681028+0000","last_peered":"2024-09-21T06:11:47.681028+0000","last_clean":"2024-09-21T06:11:47.681028+0000","last_became_active":"2024-09-21T06:09:01.421988+0000","last_became_peered":"2024-09-21T06:09:01.421988+0000","last_unstale":"2024-09-21T06:11:47.681028+0000","last_undegraded":"2024-09-21T06:11:47.681028+0000","last_fullsized":"2024-09-21T06:11:47.681028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:05:36.425900+0000","last_clean_scrub_stamp":"2024-09-21T06:05:36.425900+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:02.768987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.681244+0000","last_change":"2024-09-21T06:10:23.587538+0000","last_active":"2024-09-21T06:11:47.681244+0000","last_peered":"2024-09-21T06:11:47.681244+0000","last_clean":"2024-09-21T06:11:47.681244+0000","last_became_active":"2024-09-21T06:10:23.587070+0000","last_became_peered":"2024-09-21T06:10:23.587070+0000","last_unstale":"2024-09-21T06:11:47.681244+0000","last_undegraded":"2024-09-21T06:11:47.681244+0000","last_fullsized":"2024-09-21T06:11:47.681244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:56.508485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.531491+0000","last_change":"2024-09-21T06:10:16.542769+0000","last_active":"2024-09-21T06:12:15.531491+0000","last_peered":"2024-09-21T06:12:15.531491+0000","last_clean":"2024-09-21T06:12:15.531491+0000","last_became_active":"2024-09-21T06:10:16.542378+0000","last_became_peered":"2024-09-21T06:10:16.542378+0000","last_unstale":"2024-09-21T06:12:15.531491+0000","last_undegraded":"2024-09-21T06:12:15.531491+0000","last_fullsized":"2024-09-21T06:12:15.531491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:14.914003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684700+0000","last_change":"2024-09-21T06:10:15.398048+0000","last_active":"2024-09-21T06:11:47.684700+0000","last_peered":"2024-09-21T06:11:47.684700+0000","last_clean":"2024-09-21T06:11:47.684700+0000","last_became_active":"2024-09-21T06:10:15.397615+0000","last_became_peered":"2024-09-21T06:10:15.397615+0000","last_unstale":"2024-09-21T06:11:47.684700+0000","last_undegraded":"2024-09-21T06:11:47.684700+0000","last_fullsized":"2024-09-21T06:11:47.684700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:41.310568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678062+0000","last_change":"2024-09-21T06:10:23.582841+0000","last_active":"2024-09-21T06:11:47.678062+0000","last_peered":"2024-09-21T06:11:47.678062+0000","last_clean":"2024-09-21T06:11:47.678062+0000","last_became_active":"2024-09-21T06:10:23.582289+0000","last_became_peered":"2024-09-21T06:10:23.582289+0000","last_unstale":"2024-09-21T06:11:47.678062+0000","last_undegraded":"2024-09-21T06:11:47.678062+0000","last_fullsized":"2024-09-21T06:11:47.678062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:24.777329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.522370+0000","last_change":"2024-09-21T06:10:16.549127+0000","last_active":"2024-09-21T06:12:15.522370+0000","last_peered":"2024-09-21T06:12:15.522370+0000","last_clean":"2024-09-21T06:12:15.522370+0000","last_became_active":"2024-09-21T06:10:16.548171+0000","last_became_peered":"2024-09-21T06:10:16.548171+0000","last_unstale":"2024-09-21T06:12:15.522370+0000","last_undegraded":"2024-09-21T06:12:15.522370+0000","last_fullsized":"2024-09-21T06:12:15.522370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:35.337843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678990+0000","last_change":"2024-09-21T06:10:14.526292+0000","last_active":"2024-09-21T06:11:47.678990+0000","last_peered":"2024-09-21T06:11:47.678990+0000","last_clean":"2024-09-21T06:11:47.678990+0000","last_became_active":"2024-09-21T06:10:14.525864+0000","last_became_peered":"2024-09-21T06:10:14.525864+0000","last_unstale":"2024-09-21T06:11:47.678990+0000","last_undegraded":"2024-09-21T06:11:47.678990+0000","last_fullsized":"2024-09-21T06:11:47.678990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:12.697296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953477+0000","last_change":"2024-09-21T06:10:23.588328+0000","last_active":"2024-09-21T06:11:47.953477+0000","last_peered":"2024-09-21T06:11:47.953477+0000","last_clean":"2024-09-21T06:11:47.953477+0000","last_became_active":"2024-09-21T06:10:23.587443+0000","last_became_peered":"2024-09-21T06:10:23.587443+0000","last_unstale":"2024-09-21T06:11:47.953477+0000","last_undegraded":"2024-09-21T06:11:47.953477+0000","last_fullsized":"2024-09-21T06:11:47.953477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:08.119835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.522892+0000","last_change":"2024-09-21T06:10:16.544084+0000","last_active":"2024-09-21T06:12:15.522892+0000","last_peered":"2024-09-21T06:12:15.522892+0000","last_clean":"2024-09-21T06:12:15.522892+0000","last_became_active":"2024-09-21T06:10:16.543727+0000","last_became_peered":"2024-09-21T06:10:16.543727+0000","last_unstale":"2024-09-21T06:12:15.522892+0000","last_undegraded":"2024-09-21T06:12:15.522892+0000","last_fullsized":"2024-09-21T06:12:15.522892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:30.101518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677748+0000","last_change":"2024-09-21T06:10:14.524180+0000","last_active":"2024-09-21T06:11:47.677748+0000","last_peered":"2024-09-21T06:11:47.677748+0000","last_clean":"2024-09-21T06:11:47.677748+0000","last_became_active":"2024-09-21T06:10:14.523760+0000","last_became_peered":"2024-09-21T06:10:14.523760+0000","last_unstale":"2024-09-21T06:11:47.677748+0000","last_undegraded":"2024-09-21T06:11:47.677748+0000","last_fullsized":"2024-09-21T06:11:47.677748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:21.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678099+0000","last_change":"2024-09-21T06:10:23.586178+0000","last_active":"2024-09-21T06:11:47.678099+0000","last_peered":"2024-09-21T06:11:47.678099+0000","last_clean":"2024-09-21T06:11:47.678099+0000","last_became_active":"2024-09-21T06:10:23.585656+0000","last_became_peered":"2024-09-21T06:10:23.585656+0000","last_unstale":"2024-09-21T06:11:47.678099+0000","last_undegraded":"2024-09-21T06:11:47.678099+0000","last_fullsized":"2024-09-21T06:11:47.678099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:45:07.102979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526693+0000","last_change":"2024-09-21T06:10:16.541462+0000","last_active":"2024-09-21T06:12:15.526693+0000","last_peered":"2024-09-21T06:12:15.526693+0000","last_clean":"2024-09-21T06:12:15.526693+0000","last_became_active":"2024-09-21T06:10:16.540824+0000","last_became_peered":"2024-09-21T06:10:16.540824+0000","last_unstale":"2024-09-21T06:12:15.526693+0000","last_undegraded":"2024-09-21T06:12:15.526693+0000","last_fullsized":"2024-09-21T06:12:15.526693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:37.338517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682618+0000","last_change":"2024-09-21T06:10:46.677935+0000","last_active":"2024-09-21T06:11:47.682618+0000","last_peered":"2024-09-21T06:11:47.682618+0000","last_clean":"2024-09-21T06:11:47.682618+0000","last_became_active":"2024-09-21T06:10:46.671374+0000","last_became_peered":"2024-09-21T06:10:46.671374+0000","last_unstale":"2024-09-21T06:11:47.682618+0000","last_undegraded":"2024-09-21T06:11:47.682618+0000","last_fullsized":"2024-09-21T06:11:47.682618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:18.803808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678272+0000","last_change":"2024-09-21T06:10:23.580748+0000","last_active":"2024-09-21T06:11:47.678272+0000","last_peered":"2024-09-21T06:11:47.678272+0000","last_clean":"2024-09-21T06:11:47.678272+0000","last_became_active":"2024-09-21T06:10:23.580289+0000","last_became_peered":"2024-09-21T06:10:23.580289+0000","last_unstale":"2024-09-21T06:11:47.678272+0000","last_undegraded":"2024-09-21T06:11:47.678272+0000","last_fullsized":"2024-09-21T06:11:47.678272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:36.854641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532907+0000","last_change":"2024-09-21T06:10:16.534271+0000","last_active":"2024-09-21T06:12:15.532907+0000","last_peered":"2024-09-21T06:12:15.532907+0000","last_clean":"2024-09-21T06:12:15.532907+0000","last_became_active":"2024-09-21T06:10:16.533170+0000","last_became_peered":"2024-09-21T06:10:16.533170+0000","last_unstale":"2024-09-21T06:12:15.532907+0000","last_undegraded":"2024-09-21T06:12:15.532907+0000","last_fullsized":"2024-09-21T06:12:15.532907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:07.683311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.685080+0000","last_change":"2024-09-21T06:10:14.604234+0000","last_active":"2024-09-21T06:11:47.685080+0000","last_peered":"2024-09-21T06:11:47.685080+0000","last_clean":"2024-09-21T06:11:47.685080+0000","last_became_active":"2024-09-21T06:10:14.603842+0000","last_became_peered":"2024-09-21T06:10:14.603842+0000","last_unstale":"2024-09-21T06:11:47.685080+0000","last_undegraded":"2024-09-21T06:11:47.685080+0000","last_fullsized":"2024-09-21T06:11:47.685080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:24.615801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677637+0000","last_change":"2024-09-21T06:10:23.590112+0000","last_active":"2024-09-21T06:11:47.677637+0000","last_peered":"2024-09-21T06:11:47.677637+0000","last_clean":"2024-09-21T06:11:47.677637+0000","last_became_active":"2024-09-21T06:10:23.589706+0000","last_became_peered":"2024-09-21T06:10:23.589706+0000","last_unstale":"2024-09-21T06:11:47.677637+0000","last_undegraded":"2024-09-21T06:11:47.677637+0000","last_fullsized":"2024-09-21T06:11:47.677637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:30:33.173027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529962+0000","last_change":"2024-09-21T06:10:16.549692+0000","last_active":"2024-09-21T06:12:15.529962+0000","last_peered":"2024-09-21T06:12:15.529962+0000","last_clean":"2024-09-21T06:12:15.529962+0000","last_became_active":"2024-09-21T06:10:16.548424+0000","last_became_peered":"2024-09-21T06:10:16.548424+0000","last_unstale":"2024-09-21T06:12:15.529962+0000","last_undegraded":"2024-09-21T06:12:15.529962+0000","last_fullsized":"2024-09-21T06:12:15.529962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:52.834081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":153,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:43.903449+0000","last_change":"2024-09-21T06:10:14.529227+0000","last_active":"2024-09-21T06:12:43.903449+0000","last_peered":"2024-09-21T06:12:43.903449+0000","last_clean":"2024-09-21T06:12:43.903449+0000","last_became_active":"2024-09-21T06:10:14.528814+0000","last_became_peered":"2024-09-21T06:10:14.528814+0000","last_unstale":"2024-09-21T06:12:43.903449+0000","last_undegraded":"2024-09-21T06:12:43.903449+0000","last_fullsized":"2024-09-21T06:12:43.903449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:03.344657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.888565+0000","last_change":"2024-09-21T06:10:23.590328+0000","last_active":"2024-09-21T06:11:47.888565+0000","last_peered":"2024-09-21T06:11:47.888565+0000","last_clean":"2024-09-21T06:11:47.888565+0000","last_became_active":"2024-09-21T06:10:23.589922+0000","last_became_peered":"2024-09-21T06:10:23.589922+0000","last_unstale":"2024-09-21T06:11:47.888565+0000","last_undegraded":"2024-09-21T06:11:47.888565+0000","last_fullsized":"2024-09-21T06:11:47.888565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:47.707577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.523455+0000","last_change":"2024-09-21T06:10:46.668846+0000","last_active":"2024-09-21T06:12:15.523455+0000","last_peered":"2024-09-21T06:12:15.523455+0000","last_clean":"2024-09-21T06:12:15.523455+0000","last_became_active":"2024-09-21T06:10:46.668392+0000","last_became_peered":"2024-09-21T06:10:46.668392+0000","last_unstale":"2024-09-21T06:12:15.523455+0000","last_undegraded":"2024-09-21T06:12:15.523455+0000","last_fullsized":"2024-09-21T06:12:15.523455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:45.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678499+0000","last_change":"2024-09-21T06:10:14.530564+0000","last_active":"2024-09-21T06:11:47.678499+0000","last_peered":"2024-09-21T06:11:47.678499+0000","last_clean":"2024-09-21T06:11:47.678499+0000","last_became_active":"2024-09-21T06:10:14.530163+0000","last_became_peered":"2024-09-21T06:10:14.530163+0000","last_unstale":"2024-09-21T06:11:47.678499+0000","last_undegraded":"2024-09-21T06:11:47.678499+0000","last_fullsized":"2024-09-21T06:11:47.678499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:04.521264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682243+0000","last_change":"2024-09-21T06:10:23.593881+0000","last_active":"2024-09-21T06:11:47.682243+0000","last_peered":"2024-09-21T06:11:47.682243+0000","last_clean":"2024-09-21T06:11:47.682243+0000","last_became_active":"2024-09-21T06:10:23.593292+0000","last_became_peered":"2024-09-21T06:10:23.593292+0000","last_unstale":"2024-09-21T06:11:47.682243+0000","last_undegraded":"2024-09-21T06:11:47.682243+0000","last_fullsized":"2024-09-21T06:11:47.682243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:55.280448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517134+0000","last_change":"2024-09-21T06:10:16.544231+0000","last_active":"2024-09-21T06:12:15.517134+0000","last_peered":"2024-09-21T06:12:15.517134+0000","last_clean":"2024-09-21T06:12:15.517134+0000","last_became_active":"2024-09-21T06:10:16.543866+0000","last_became_peered":"2024-09-21T06:10:16.543866+0000","last_unstale":"2024-09-21T06:12:15.517134+0000","last_undegraded":"2024-09-21T06:12:15.517134+0000","last_fullsized":"2024-09-21T06:12:15.517134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:46.015862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684367+0000","last_change":"2024-09-21T06:10:14.527372+0000","last_active":"2024-09-21T06:11:47.684367+0000","last_peered":"2024-09-21T06:11:47.684367+0000","last_clean":"2024-09-21T06:11:47.684367+0000","last_became_active":"2024-09-21T06:10:14.526971+0000","last_became_peered":"2024-09-21T06:10:14.526971+0000","last_unstale":"2024-09-21T06:11:47.684367+0000","last_undegraded":"2024-09-21T06:11:47.684367+0000","last_fullsized":"2024-09-21T06:11:47.684367+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:56.987818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678699+0000","last_change":"2024-09-21T06:10:23.584179+0000","last_active":"2024-09-21T06:11:47.678699+0000","last_peered":"2024-09-21T06:11:47.678699+0000","last_clean":"2024-09-21T06:11:47.678699+0000","last_became_active":"2024-09-21T06:10:23.583715+0000","last_became_peered":"2024-09-21T06:10:23.583715+0000","last_unstale":"2024-09-21T06:11:47.678699+0000","last_undegraded":"2024-09-21T06:11:47.678699+0000","last_fullsized":"2024-09-21T06:11:47.678699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:31.550485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.518412+0000","last_change":"2024-09-21T06:10:16.546411+0000","last_active":"2024-09-21T06:12:15.518412+0000","last_peered":"2024-09-21T06:12:15.518412+0000","last_clean":"2024-09-21T06:12:15.518412+0000","last_became_active":"2024-09-21T06:10:16.546040+0000","last_became_peered":"2024-09-21T06:10:16.546040+0000","last_unstale":"2024-09-21T06:12:15.518412+0000","last_undegraded":"2024-09-21T06:12:15.518412+0000","last_fullsized":"2024-09-21T06:12:15.518412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:59.466188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'38","reported_seq":302,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:44.904947+0000","last_change":"2024-09-21T06:10:14.531743+0000","last_active":"2024-09-21T06:12:44.904947+0000","last_peered":"2024-09-21T06:12:44.904947+0000","last_clean":"2024-09-21T06:12:44.904947+0000","last_became_active":"2024-09-21T06:10:14.531376+0000","last_became_peered":"2024-09-21T06:10:14.531376+0000","last_unstale":"2024-09-21T06:12:44.904947+0000","last_undegraded":"2024-09-21T06:12:44.904947+0000","last_fullsized":"2024-09-21T06:12:44.904947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:59.126779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":182,"num_write":39,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817467+0000","last_change":"2024-09-21T06:10:46.671450+0000","last_active":"2024-09-21T06:11:47.817467+0000","last_peered":"2024-09-21T06:11:47.817467+0000","last_clean":"2024-09-21T06:11:47.817467+0000","last_became_active":"2024-09-21T06:10:46.670721+0000","last_became_peered":"2024-09-21T06:10:46.670721+0000","last_unstale":"2024-09-21T06:11:47.817467+0000","last_undegraded":"2024-09-21T06:11:47.817467+0000","last_fullsized":"2024-09-21T06:11:47.817467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:15.492976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532696+0000","last_change":"2024-09-21T06:10:46.671602+0000","last_active":"2024-09-21T06:12:15.532696+0000","last_peered":"2024-09-21T06:12:15.532696+0000","last_clean":"2024-09-21T06:12:15.532696+0000","last_became_active":"2024-09-21T06:10:46.671192+0000","last_became_peered":"2024-09-21T06:10:46.671192+0000","last_unstale":"2024-09-21T06:12:15.532696+0000","last_undegraded":"2024-09-21T06:12:15.532696+0000","last_fullsized":"2024-09-21T06:12:15.532696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:11.615305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678991+0000","last_change":"2024-09-21T06:10:14.604626+0000","last_active":"2024-09-21T06:11:47.678991+0000","last_peered":"2024-09-21T06:11:47.678991+0000","last_clean":"2024-09-21T06:11:47.678991+0000","last_became_active":"2024-09-21T06:10:14.604182+0000","last_became_peered":"2024-09-21T06:10:14.604182+0000","last_unstale":"2024-09-21T06:11:47.678991+0000","last_undegraded":"2024-09-21T06:11:47.678991+0000","last_fullsized":"2024-09-21T06:11:47.678991+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:42:13.394469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.767012+0000","last_change":"2024-09-21T06:10:23.584942+0000","last_active":"2024-09-21T06:11:47.767012+0000","last_peered":"2024-09-21T06:11:47.767012+0000","last_clean":"2024-09-21T06:11:47.767012+0000","last_became_active":"2024-09-21T06:10:23.584445+0000","last_became_peered":"2024-09-21T06:10:23.584445+0000","last_unstale":"2024-09-21T06:11:47.767012+0000","last_undegraded":"2024-09-21T06:11:47.767012+0000","last_fullsized":"2024-09-21T06:11:47.767012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:53.552132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526535+0000","last_change":"2024-09-21T06:10:16.541858+0000","last_active":"2024-09-21T06:12:15.526535+0000","last_peered":"2024-09-21T06:12:15.526535+0000","last_clean":"2024-09-21T06:12:15.526535+0000","last_became_active":"2024-09-21T06:10:16.541400+0000","last_became_peered":"2024-09-21T06:10:16.541400+0000","last_unstale":"2024-09-21T06:12:15.526535+0000","last_undegraded":"2024-09-21T06:12:15.526535+0000","last_fullsized":"2024-09-21T06:12:15.526535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:12.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.771691+0000","last_change":"2024-09-21T06:11:47.771046+0000","last_active":"2024-09-21T06:11:47.771691+0000","last_peered":"2024-09-21T06:11:47.771691+0000","last_clean":"2024-09-21T06:11:47.771691+0000","last_became_active":"2024-09-21T06:11:47.768022+0000","last_became_peered":"2024-09-21T06:11:47.768022+0000","last_unstale":"2024-09-21T06:11:47.771691+0000","last_undegraded":"2024-09-21T06:11:47.771691+0000","last_fullsized":"2024-09-21T06:11:47.771691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:26.464373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.887821+0000","last_change":"2024-09-21T06:10:23.594669+0000","last_active":"2024-09-21T06:11:47.887821+0000","last_peered":"2024-09-21T06:11:47.887821+0000","last_clean":"2024-09-21T06:11:47.887821+0000","last_became_active":"2024-09-21T06:10:23.592895+0000","last_became_peered":"2024-09-21T06:10:23.592895+0000","last_unstale":"2024-09-21T06:11:47.887821+0000","last_undegraded":"2024-09-21T06:11:47.887821+0000","last_fullsized":"2024-09-21T06:11:47.887821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:53.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.528752+0000","last_change":"2024-09-21T06:10:16.542338+0000","last_active":"2024-09-21T06:12:15.528752+0000","last_peered":"2024-09-21T06:12:15.528752+0000","last_clean":"2024-09-21T06:12:15.528752+0000","last_became_active":"2024-09-21T06:10:16.541724+0000","last_became_peered":"2024-09-21T06:10:16.541724+0000","last_unstale":"2024-09-21T06:12:15.528752+0000","last_undegraded":"2024-09-21T06:12:15.528752+0000","last_fullsized":"2024-09-21T06:12:15.528752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:43.147042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:43.903076+0000","last_change":"2024-09-21T06:10:14.529946+0000","last_active":"2024-09-21T06:12:43.903076+0000","last_peered":"2024-09-21T06:12:43.903076+0000","last_clean":"2024-09-21T06:12:43.903076+0000","last_became_active":"2024-09-21T06:10:14.529452+0000","last_became_peered":"2024-09-21T06:10:14.529452+0000","last_unstale":"2024-09-21T06:12:43.903076+0000","last_undegraded":"2024-09-21T06:12:43.903076+0000","last_fullsized":"2024-09-21T06:12:43.903076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:39.971759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684433+0000","last_change":"2024-09-21T06:10:23.587824+0000","last_active":"2024-09-21T06:11:47.684433+0000","last_peered":"2024-09-21T06:11:47.684433+0000","last_clean":"2024-09-21T06:11:47.684433+0000","last_became_active":"2024-09-21T06:10:23.587393+0000","last_became_peered":"2024-09-21T06:10:23.587393+0000","last_unstale":"2024-09-21T06:11:47.684433+0000","last_undegraded":"2024-09-21T06:11:47.684433+0000","last_fullsized":"2024-09-21T06:11:47.684433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:47.400668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.953194+0000","last_change":"2024-09-21T06:10:23.582703+0000","last_active":"2024-09-21T06:11:47.953194+0000","last_peered":"2024-09-21T06:11:47.953194+0000","last_clean":"2024-09-21T06:11:47.953194+0000","last_became_active":"2024-09-21T06:10:23.582208+0000","last_became_peered":"2024-09-21T06:10:23.582208+0000","last_unstale":"2024-09-21T06:11:47.953194+0000","last_undegraded":"2024-09-21T06:11:47.953194+0000","last_fullsized":"2024-09-21T06:11:47.953194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:19.669221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530013+0000","last_change":"2024-09-21T06:10:16.533991+0000","last_active":"2024-09-21T06:12:15.530013+0000","last_peered":"2024-09-21T06:12:15.530013+0000","last_clean":"2024-09-21T06:12:15.530013+0000","last_became_active":"2024-09-21T06:10:16.533591+0000","last_became_peered":"2024-09-21T06:10:16.533591+0000","last_unstale":"2024-09-21T06:12:15.530013+0000","last_undegraded":"2024-09-21T06:12:15.530013+0000","last_fullsized":"2024-09-21T06:12:15.530013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:23.852904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.678773+0000","last_change":"2024-09-21T06:10:14.530827+0000","last_active":"2024-09-21T06:11:47.678773+0000","last_peered":"2024-09-21T06:11:47.678773+0000","last_clean":"2024-09-21T06:11:47.678773+0000","last_became_active":"2024-09-21T06:10:14.530165+0000","last_became_peered":"2024-09-21T06:10:14.530165+0000","last_unstale":"2024-09-21T06:11:47.678773+0000","last_undegraded":"2024-09-21T06:11:47.678773+0000","last_fullsized":"2024-09-21T06:11:47.678773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:06.817883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.682521+0000","last_change":"2024-09-21T06:10:23.593998+0000","last_active":"2024-09-21T06:11:47.682521+0000","last_peered":"2024-09-21T06:11:47.682521+0000","last_clean":"2024-09-21T06:11:47.682521+0000","last_became_active":"2024-09-21T06:10:23.593294+0000","last_became_peered":"2024-09-21T06:10:23.593294+0000","last_unstale":"2024-09-21T06:11:47.682521+0000","last_undegraded":"2024-09-21T06:11:47.682521+0000","last_fullsized":"2024-09-21T06:11:47.682521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.507447+0000","last_change":"2024-09-21T06:10:16.529992+0000","last_active":"2024-09-21T06:12:15.507447+0000","last_peered":"2024-09-21T06:12:15.507447+0000","last_clean":"2024-09-21T06:12:15.507447+0000","last_became_active":"2024-09-21T06:10:16.529635+0000","last_became_peered":"2024-09-21T06:10:16.529635+0000","last_unstale":"2024-09-21T06:12:15.507447+0000","last_undegraded":"2024-09-21T06:12:15.507447+0000","last_fullsized":"2024-09-21T06:12:15.507447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:24.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.677169+0000","last_change":"2024-09-21T06:10:14.520858+0000","last_active":"2024-09-21T06:11:47.677169+0000","last_peered":"2024-09-21T06:11:47.677169+0000","last_clean":"2024-09-21T06:11:47.677169+0000","last_became_active":"2024-09-21T06:10:14.520433+0000","last_became_peered":"2024-09-21T06:10:14.520433+0000","last_unstale":"2024-09-21T06:11:47.677169+0000","last_undegraded":"2024-09-21T06:11:47.677169+0000","last_fullsized":"2024-09-21T06:11:47.677169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:14.543838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.817743+0000","last_change":"2024-09-21T06:10:14.529835+0000","last_active":"2024-09-21T06:11:47.817743+0000","last_peered":"2024-09-21T06:11:47.817743+0000","last_clean":"2024-09-21T06:11:47.817743+0000","last_became_active":"2024-09-21T06:10:14.529401+0000","last_became_peered":"2024-09-21T06:10:14.529401+0000","last_unstale":"2024-09-21T06:11:47.817743+0000","last_undegraded":"2024-09-21T06:11:47.817743+0000","last_fullsized":"2024-09-21T06:11:47.817743+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:53.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.509121+0000","last_change":"2024-09-21T06:10:46.783716+0000","last_active":"2024-09-21T06:12:15.509121+0000","last_peered":"2024-09-21T06:12:15.509121+0000","last_clean":"2024-09-21T06:12:15.509121+0000","last_became_active":"2024-09-21T06:10:46.783209+0000","last_became_peered":"2024-09-21T06:10:46.783209+0000","last_unstale":"2024-09-21T06:12:15.509121+0000","last_undegraded":"2024-09-21T06:12:15.509121+0000","last_fullsized":"2024-09-21T06:12:15.509121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:17.826009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684408+0000","last_change":"2024-09-21T06:10:23.593749+0000","last_active":"2024-09-21T06:11:47.684408+0000","last_peered":"2024-09-21T06:11:47.684408+0000","last_clean":"2024-09-21T06:11:47.684408+0000","last_became_active":"2024-09-21T06:10:23.593214+0000","last_became_peered":"2024-09-21T06:10:23.593214+0000","last_unstale":"2024-09-21T06:11:47.684408+0000","last_undegraded":"2024-09-21T06:11:47.684408+0000","last_fullsized":"2024-09-21T06:11:47.684408+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:41.783610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":155,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:45.907001+0000","last_change":"2024-09-21T06:10:14.533186+0000","last_active":"2024-09-21T06:12:45.907001+0000","last_peered":"2024-09-21T06:12:45.907001+0000","last_clean":"2024-09-21T06:12:45.907001+0000","last_became_active":"2024-09-21T06:10:14.532716+0000","last_became_peered":"2024-09-21T06:10:14.532716+0000","last_unstale":"2024-09-21T06:12:45.907001+0000","last_undegraded":"2024-09-21T06:12:45.907001+0000","last_fullsized":"2024-09-21T06:12:45.907001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:13.504617+0000","last_clean_scrub_stamp":"2024-09-21T06:10:13.504617+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:34.088898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.504311+0000","last_change":"2024-09-21T06:10:16.537338+0000","last_active":"2024-09-21T06:12:15.504311+0000","last_peered":"2024-09-21T06:12:15.504311+0000","last_clean":"2024-09-21T06:12:15.504311+0000","last_became_active":"2024-09-21T06:10:16.534534+0000","last_became_peered":"2024-09-21T06:10:16.534534+0000","last_unstale":"2024-09-21T06:12:15.504311+0000","last_undegraded":"2024-09-21T06:12:15.504311+0000","last_fullsized":"2024-09-21T06:12:15.504311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:42.470946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:11:47.684234+0000","last_change":"2024-09-21T06:10:23.587693+0000","last_active":"2024-09-21T06:11:47.684234+0000","last_peered":"2024-09-21T06:11:47.684234+0000","last_clean":"2024-09-21T06:11:47.684234+0000","last_became_active":"2024-09-21T06:10:23.587291+0000","last_became_peered":"2024-09-21T06:10:23.587291+0000","last_unstale":"2024-09-21T06:11:47.684234+0000","last_undegraded":"2024-09-21T06:11:47.684234+0000","last_fullsized":"2024-09-21T06:11:47.684234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:22.562973+0000","last_clean_scrub_stamp":"2024-09-21T06:10:22.562973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:13.015775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520206+0000","last_change":"2024-09-21T06:10:16.544562+0000","last_active":"2024-09-21T06:12:15.520206+0000","last_peered":"2024-09-21T06:12:15.520206+0000","last_clean":"2024-09-21T06:12:15.520206+0000","last_became_active":"2024-09-21T06:10:16.543563+0000","last_became_peered":"2024-09-21T06:10:16.543563+0000","last_unstale":"2024-09-21T06:12:15.520206+0000","last_undegraded":"2024-09-21T06:12:15.520206+0000","last_fullsized":"2024-09-21T06:12:15.520206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:20.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520779+0000","last_change":"2024-09-21T06:10:16.539747+0000","last_active":"2024-09-21T06:12:15.520779+0000","last_peered":"2024-09-21T06:12:15.520779+0000","last_clean":"2024-09-21T06:12:15.520779+0000","last_became_active":"2024-09-21T06:10:16.538346+0000","last_became_peered":"2024-09-21T06:10:16.538346+0000","last_unstale":"2024-09-21T06:12:15.520779+0000","last_undegraded":"2024-09-21T06:12:15.520779+0000","last_fullsized":"2024-09-21T06:12:15.520779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:13.276367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520465+0000","last_change":"2024-09-21T06:10:16.538031+0000","last_active":"2024-09-21T06:12:15.520465+0000","last_peered":"2024-09-21T06:12:15.520465+0000","last_clean":"2024-09-21T06:12:15.520465+0000","last_became_active":"2024-09-21T06:10:16.536683+0000","last_became_peered":"2024-09-21T06:10:16.536683+0000","last_unstale":"2024-09-21T06:12:15.520465+0000","last_undegraded":"2024-09-21T06:12:15.520465+0000","last_fullsized":"2024-09-21T06:12:15.520465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:28:50.072610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526316+0000","last_change":"2024-09-21T06:10:16.535223+0000","last_active":"2024-09-21T06:12:15.526316+0000","last_peered":"2024-09-21T06:12:15.526316+0000","last_clean":"2024-09-21T06:12:15.526316+0000","last_became_active":"2024-09-21T06:10:16.534848+0000","last_became_peered":"2024-09-21T06:10:16.534848+0000","last_unstale":"2024-09-21T06:12:15.526316+0000","last_undegraded":"2024-09-21T06:12:15.526316+0000","last_fullsized":"2024-09-21T06:12:15.526316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:39.631504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515205+0000","last_change":"2024-09-21T06:10:46.784562+0000","last_active":"2024-09-21T06:12:15.515205+0000","last_peered":"2024-09-21T06:12:15.515205+0000","last_clean":"2024-09-21T06:12:15.515205+0000","last_became_active":"2024-09-21T06:10:46.783892+0000","last_became_peered":"2024-09-21T06:10:46.783892+0000","last_unstale":"2024-09-21T06:12:15.515205+0000","last_undegraded":"2024-09-21T06:12:15.515205+0000","last_fullsized":"2024-09-21T06:12:15.515205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:07.854643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.512408+0000","last_change":"2024-09-21T06:10:16.542153+0000","last_active":"2024-09-21T06:12:15.512408+0000","last_peered":"2024-09-21T06:12:15.512408+0000","last_clean":"2024-09-21T06:12:15.512408+0000","last_became_active":"2024-09-21T06:10:16.541749+0000","last_became_peered":"2024-09-21T06:10:16.541749+0000","last_unstale":"2024-09-21T06:12:15.512408+0000","last_undegraded":"2024-09-21T06:12:15.512408+0000","last_fullsized":"2024-09-21T06:12:15.512408+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:43.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.534145+0000","last_change":"2024-09-21T06:10:16.537556+0000","last_active":"2024-09-21T06:12:15.534145+0000","last_peered":"2024-09-21T06:12:15.534145+0000","last_clean":"2024-09-21T06:12:15.534145+0000","last_became_active":"2024-09-21T06:10:16.537191+0000","last_became_peered":"2024-09-21T06:10:16.537191+0000","last_unstale":"2024-09-21T06:12:15.534145+0000","last_undegraded":"2024-09-21T06:12:15.534145+0000","last_fullsized":"2024-09-21T06:12:15.534145+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:27:43.022737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.506519+0000","last_change":"2024-09-21T06:10:16.536622+0000","last_active":"2024-09-21T06:12:15.506519+0000","last_peered":"2024-09-21T06:12:15.506519+0000","last_clean":"2024-09-21T06:12:15.506519+0000","last_became_active":"2024-09-21T06:10:16.536132+0000","last_became_peered":"2024-09-21T06:10:16.536132+0000","last_unstale":"2024-09-21T06:12:15.506519+0000","last_undegraded":"2024-09-21T06:12:15.506519+0000","last_fullsized":"2024-09-21T06:12:15.506519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:16.092247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.515287+0000","last_change":"2024-09-21T06:10:16.530509+0000","last_active":"2024-09-21T06:12:15.515287+0000","last_peered":"2024-09-21T06:12:15.515287+0000","last_clean":"2024-09-21T06:12:15.515287+0000","last_became_active":"2024-09-21T06:10:16.530057+0000","last_became_peered":"2024-09-21T06:10:16.530057+0000","last_unstale":"2024-09-21T06:12:15.515287+0000","last_undegraded":"2024-09-21T06:12:15.515287+0000","last_fullsized":"2024-09-21T06:12:15.515287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:21.264828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.507300+0000","last_change":"2024-09-21T06:10:16.536530+0000","last_active":"2024-09-21T06:12:15.507300+0000","last_peered":"2024-09-21T06:12:15.507300+0000","last_clean":"2024-09-21T06:12:15.507300+0000","last_became_active":"2024-09-21T06:10:16.536105+0000","last_became_peered":"2024-09-21T06:10:16.536105+0000","last_unstale":"2024-09-21T06:12:15.507300+0000","last_undegraded":"2024-09-21T06:12:15.507300+0000","last_fullsized":"2024-09-21T06:12:15.507300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:08.756748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.533005+0000","last_change":"2024-09-21T06:10:16.549201+0000","last_active":"2024-09-21T06:12:15.533005+0000","last_peered":"2024-09-21T06:12:15.533005+0000","last_clean":"2024-09-21T06:12:15.533005+0000","last_became_active":"2024-09-21T06:10:16.548719+0000","last_became_peered":"2024-09-21T06:10:16.548719+0000","last_unstale":"2024-09-21T06:12:15.533005+0000","last_undegraded":"2024-09-21T06:12:15.533005+0000","last_fullsized":"2024-09-21T06:12:15.533005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:08.123439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517964+0000","last_change":"2024-09-21T06:10:16.544167+0000","last_active":"2024-09-21T06:12:15.517964+0000","last_peered":"2024-09-21T06:12:15.517964+0000","last_clean":"2024-09-21T06:12:15.517964+0000","last_became_active":"2024-09-21T06:10:16.543182+0000","last_became_peered":"2024-09-21T06:10:16.543182+0000","last_unstale":"2024-09-21T06:12:15.517964+0000","last_undegraded":"2024-09-21T06:12:15.517964+0000","last_fullsized":"2024-09-21T06:12:15.517964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:43.961558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526826+0000","last_change":"2024-09-21T06:10:16.539814+0000","last_active":"2024-09-21T06:12:15.526826+0000","last_peered":"2024-09-21T06:12:15.526826+0000","last_clean":"2024-09-21T06:12:15.526826+0000","last_became_active":"2024-09-21T06:10:16.539448+0000","last_became_peered":"2024-09-21T06:10:16.539448+0000","last_unstale":"2024-09-21T06:12:15.526826+0000","last_undegraded":"2024-09-21T06:12:15.526826+0000","last_fullsized":"2024-09-21T06:12:15.526826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:48.330479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.519072+0000","last_change":"2024-09-21T06:10:16.537284+0000","last_active":"2024-09-21T06:12:15.519072+0000","last_peered":"2024-09-21T06:12:15.519072+0000","last_clean":"2024-09-21T06:12:15.519072+0000","last_became_active":"2024-09-21T06:10:16.536857+0000","last_became_peered":"2024-09-21T06:10:16.536857+0000","last_unstale":"2024-09-21T06:12:15.519072+0000","last_undegraded":"2024-09-21T06:12:15.519072+0000","last_fullsized":"2024-09-21T06:12:15.519072+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:41.326760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529805+0000","last_change":"2024-09-21T06:10:16.539052+0000","last_active":"2024-09-21T06:12:15.529805+0000","last_peered":"2024-09-21T06:12:15.529805+0000","last_clean":"2024-09-21T06:12:15.529805+0000","last_became_active":"2024-09-21T06:10:16.538736+0000","last_became_peered":"2024-09-21T06:10:16.538736+0000","last_unstale":"2024-09-21T06:12:15.529805+0000","last_undegraded":"2024-09-21T06:12:15.529805+0000","last_fullsized":"2024-09-21T06:12:15.529805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:08.303775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517772+0000","last_change":"2024-09-21T06:10:16.546559+0000","last_active":"2024-09-21T06:12:15.517772+0000","last_peered":"2024-09-21T06:12:15.517772+0000","last_clean":"2024-09-21T06:12:15.517772+0000","last_became_active":"2024-09-21T06:10:16.546117+0000","last_became_peered":"2024-09-21T06:10:16.546117+0000","last_unstale":"2024-09-21T06:12:15.517772+0000","last_undegraded":"2024-09-21T06:12:15.517772+0000","last_fullsized":"2024-09-21T06:12:15.517772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:50.189382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532761+0000","last_change":"2024-09-21T06:10:16.548411+0000","last_active":"2024-09-21T06:12:15.532761+0000","last_peered":"2024-09-21T06:12:15.532761+0000","last_clean":"2024-09-21T06:12:15.532761+0000","last_became_active":"2024-09-21T06:10:16.548034+0000","last_became_peered":"2024-09-21T06:10:16.548034+0000","last_unstale":"2024-09-21T06:12:15.532761+0000","last_undegraded":"2024-09-21T06:12:15.532761+0000","last_fullsized":"2024-09-21T06:12:15.532761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:07.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526427+0000","last_change":"2024-09-21T06:10:16.542348+0000","last_active":"2024-09-21T06:12:15.526427+0000","last_peered":"2024-09-21T06:12:15.526427+0000","last_clean":"2024-09-21T06:12:15.526427+0000","last_became_active":"2024-09-21T06:10:16.541180+0000","last_became_peered":"2024-09-21T06:10:16.541180+0000","last_unstale":"2024-09-21T06:12:15.526427+0000","last_undegraded":"2024-09-21T06:12:15.526427+0000","last_fullsized":"2024-09-21T06:12:15.526427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:07.164747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530631+0000","last_change":"2024-09-21T06:10:16.540526+0000","last_active":"2024-09-21T06:12:15.530631+0000","last_peered":"2024-09-21T06:12:15.530631+0000","last_clean":"2024-09-21T06:12:15.530631+0000","last_became_active":"2024-09-21T06:10:16.540199+0000","last_became_peered":"2024-09-21T06:10:16.540199+0000","last_unstale":"2024-09-21T06:12:15.530631+0000","last_undegraded":"2024-09-21T06:12:15.530631+0000","last_fullsized":"2024-09-21T06:12:15.530631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:16.930090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.511306+0000","last_change":"2024-09-21T06:10:16.528697+0000","last_active":"2024-09-21T06:12:15.511306+0000","last_peered":"2024-09-21T06:12:15.511306+0000","last_clean":"2024-09-21T06:12:15.511306+0000","last_became_active":"2024-09-21T06:10:16.528328+0000","last_became_peered":"2024-09-21T06:10:16.528328+0000","last_unstale":"2024-09-21T06:12:15.511306+0000","last_undegraded":"2024-09-21T06:12:15.511306+0000","last_fullsized":"2024-09-21T06:12:15.511306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:14.231745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.524692+0000","last_change":"2024-09-21T06:10:16.535970+0000","last_active":"2024-09-21T06:12:15.524692+0000","last_peered":"2024-09-21T06:12:15.524692+0000","last_clean":"2024-09-21T06:12:15.524692+0000","last_became_active":"2024-09-21T06:10:16.535592+0000","last_became_peered":"2024-09-21T06:10:16.535592+0000","last_unstale":"2024-09-21T06:12:15.524692+0000","last_undegraded":"2024-09-21T06:12:15.524692+0000","last_fullsized":"2024-09-21T06:12:15.524692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:32.330553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.531564+0000","last_change":"2024-09-21T06:10:16.551228+0000","last_active":"2024-09-21T06:12:15.531564+0000","last_peered":"2024-09-21T06:12:15.531564+0000","last_clean":"2024-09-21T06:12:15.531564+0000","last_became_active":"2024-09-21T06:10:16.550680+0000","last_became_peered":"2024-09-21T06:10:16.550680+0000","last_unstale":"2024-09-21T06:12:15.531564+0000","last_undegraded":"2024-09-21T06:12:15.531564+0000","last_fullsized":"2024-09-21T06:12:15.531564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:56.958039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.520889+0000","last_change":"2024-09-21T06:10:16.541972+0000","last_active":"2024-09-21T06:12:15.520889+0000","last_peered":"2024-09-21T06:12:15.520889+0000","last_clean":"2024-09-21T06:12:15.520889+0000","last_became_active":"2024-09-21T06:10:16.541233+0000","last_became_peered":"2024-09-21T06:10:16.541233+0000","last_unstale":"2024-09-21T06:12:15.520889+0000","last_undegraded":"2024-09-21T06:12:15.520889+0000","last_fullsized":"2024-09-21T06:12:15.520889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:23.879962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.532893+0000","last_change":"2024-09-21T06:10:16.543417+0000","last_active":"2024-09-21T06:12:15.532893+0000","last_peered":"2024-09-21T06:12:15.532893+0000","last_clean":"2024-09-21T06:12:15.532893+0000","last_became_active":"2024-09-21T06:10:16.543087+0000","last_became_peered":"2024-09-21T06:10:16.543087+0000","last_unstale":"2024-09-21T06:12:15.532893+0000","last_undegraded":"2024-09-21T06:12:15.532893+0000","last_fullsized":"2024-09-21T06:12:15.532893+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:40.515423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529624+0000","last_change":"2024-09-21T06:10:16.538168+0000","last_active":"2024-09-21T06:12:15.529624+0000","last_peered":"2024-09-21T06:12:15.529624+0000","last_clean":"2024-09-21T06:12:15.529624+0000","last_became_active":"2024-09-21T06:10:16.537349+0000","last_became_peered":"2024-09-21T06:10:16.537349+0000","last_unstale":"2024-09-21T06:12:15.529624+0000","last_undegraded":"2024-09-21T06:12:15.529624+0000","last_fullsized":"2024-09-21T06:12:15.529624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:55.628298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.519820+0000","last_change":"2024-09-21T06:10:16.549178+0000","last_active":"2024-09-21T06:12:15.519820+0000","last_peered":"2024-09-21T06:12:15.519820+0000","last_clean":"2024-09-21T06:12:15.519820+0000","last_became_active":"2024-09-21T06:10:16.548455+0000","last_became_peered":"2024-09-21T06:10:16.548455+0000","last_unstale":"2024-09-21T06:12:15.519820+0000","last_undegraded":"2024-09-21T06:12:15.519820+0000","last_fullsized":"2024-09-21T06:12:15.519820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:06.299387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.526074+0000","last_change":"2024-09-21T06:10:16.533576+0000","last_active":"2024-09-21T06:12:15.526074+0000","last_peered":"2024-09-21T06:12:15.526074+0000","last_clean":"2024-09-21T06:12:15.526074+0000","last_became_active":"2024-09-21T06:10:16.532477+0000","last_became_peered":"2024-09-21T06:10:16.532477+0000","last_unstale":"2024-09-21T06:12:15.526074+0000","last_undegraded":"2024-09-21T06:12:15.526074+0000","last_fullsized":"2024-09-21T06:12:15.526074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:14.360752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.506981+0000","last_change":"2024-09-21T06:10:16.530283+0000","last_active":"2024-09-21T06:12:15.506981+0000","last_peered":"2024-09-21T06:12:15.506981+0000","last_clean":"2024-09-21T06:12:15.506981+0000","last_became_active":"2024-09-21T06:10:16.528958+0000","last_became_peered":"2024-09-21T06:10:16.528958+0000","last_unstale":"2024-09-21T06:12:15.506981+0000","last_undegraded":"2024-09-21T06:12:15.506981+0000","last_fullsized":"2024-09-21T06:12:15.506981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:48.814511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.525142+0000","last_change":"2024-09-21T06:10:16.544905+0000","last_active":"2024-09-21T06:12:15.525142+0000","last_peered":"2024-09-21T06:12:15.525142+0000","last_clean":"2024-09-21T06:12:15.525142+0000","last_became_active":"2024-09-21T06:10:16.544562+0000","last_became_peered":"2024-09-21T06:10:16.544562+0000","last_unstale":"2024-09-21T06:12:15.525142+0000","last_undegraded":"2024-09-21T06:12:15.525142+0000","last_fullsized":"2024-09-21T06:12:15.525142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:24.075765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.529460+0000","last_change":"2024-09-21T06:10:16.541590+0000","last_active":"2024-09-21T06:12:15.529460+0000","last_peered":"2024-09-21T06:12:15.529460+0000","last_clean":"2024-09-21T06:12:15.529460+0000","last_became_active":"2024-09-21T06:10:16.541063+0000","last_became_peered":"2024-09-21T06:10:16.541063+0000","last_unstale":"2024-09-21T06:12:15.529460+0000","last_undegraded":"2024-09-21T06:12:15.529460+0000","last_fullsized":"2024-09-21T06:12:15.529460+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:57.836248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.530065+0000","last_change":"2024-09-21T06:10:16.537241+0000","last_active":"2024-09-21T06:12:15.530065+0000","last_peered":"2024-09-21T06:12:15.530065+0000","last_clean":"2024-09-21T06:12:15.530065+0000","last_became_active":"2024-09-21T06:10:16.536846+0000","last_became_peered":"2024-09-21T06:10:16.536846+0000","last_unstale":"2024-09-21T06:12:15.530065+0000","last_undegraded":"2024-09-21T06:12:15.530065+0000","last_fullsized":"2024-09-21T06:12:15.530065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:12.966834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T06:12:15.517415+0000","last_change":"2024-09-21T06:10:16.545887+0000","last_active":"2024-09-21T06:12:15.517415+0000","last_peered":"2024-09-21T06:12:15.517415+0000","last_clean":"2024-09-21T06:12:15.517415+0000","last_became_active":"2024-09-21T06:10:16.545499+0000","last_became_peered":"2024-09-21T06:10:16.545499+0000","last_unstale":"2024-09-21T06:12:15.517415+0000","last_undegraded":"2024-09-21T06:12:15.517415+0000","last_fullsized":"2024-09-21T06:12:15.517415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:10:15.512744+0000","last_clean_scrub_stamp":"2024-09-21T06:10:15.512744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:13.810957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75899,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":667,"num_read_kb":412,"num_write":182,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":227697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214518,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":473624,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939697,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1132666,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070518,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":477934,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266747,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":473736,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430271,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1070262,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":469014,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790027,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1065357,"data_compressed":65690,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953552,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":474157,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149780,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":469208,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":542070,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":540227,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":470402,"data_compressed":29397,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34673,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36293,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:12:47.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:48.233 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 -- 172.21.15.17:0/325260863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a8103b60 msgr2=0x7f32a8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 --2- 172.21.15.17:0/325260863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a8103b60 0x7f32a8103f70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3298009900 tx=0x7f329802a410 comp rx=0 tx=0).stop 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 -- 172.21.15.17:0/325260863 shutdown_connections 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 --2- 172.21.15.17:0/325260863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a8109df0 0x7f32a8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 --2- 172.21.15.17:0/325260863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a81094a0 0x7f32a81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 --2- 172.21.15.17:0/325260863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a8103b60 0x7f32a8103f70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.733+0000 7f32ade45640 1 -- 172.21.15.17:0/325260863 >> 172.21.15.17:0/325260863 conn(0x7f32a807b850 msgr2=0x7f32a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.734+0000 7f32ade45640 1 -- 172.21.15.17:0/325260863 shutdown_connections 2024-09-21T06:12:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.734+0000 7f32ade45640 1 -- 172.21.15.17:0/325260863 wait complete. 2024-09-21T06:12:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.734+0000 7f32ade45640 1 Processor -- start 2024-09-21T06:12:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 -- start start 2024-09-21T06:12:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8103b60 0x7f32a819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 0x7f32a819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a8109df0 0x7f32a81a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32a81139b0 con 0x7f32a81094a0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8113830 con 0x7f32a8109df0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.735+0000 7f32ade45640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8113b30 con 0x7f32a8103b60 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 0x7f32a819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 0x7f32a819cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39316/0 (socket says 172.21.15.17:39316) 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 -- 172.21.15.17:0/1826369850 learned_addr learned my addr 172.21.15.17:0/1826369850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a77fe640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8103b60 0x7f32a819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a7fff640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a8109df0 0x7f32a81a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 -- 172.21.15.17:0/1826369850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8103b60 msgr2=0x7f32a819c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8103b60 0x7f32a819c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 -- 172.21.15.17:0/1826369850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a8109df0 msgr2=0x7f32a81a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a8109df0 0x7f32a81a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 -- 172.21.15.17:0/1826369850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a81a2490 con 0x7f32a81094a0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a6ffd640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 0x7f32a819cb80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f329c00e9f0 tx=0x7f329c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.736+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c00ccc0 con 0x7f32a81094a0 2024-09-21T06:12:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.737+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f329c0108c0 con 0x7f32a81094a0 2024-09-21T06:12:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.737+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a81a2780 con 0x7f32a81094a0 2024-09-21T06:12:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.737+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c018750 con 0x7f32a81094a0 2024-09-21T06:12:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.737+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a81a8fa0 con 0x7f32a81094a0 2024-09-21T06:12:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.738+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a8103f70 con 0x7f32a81094a0 2024-09-21T06:12:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.739+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f329c010430 con 0x7f32a81094a0 2024-09-21T06:12:48.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.740+0000 7f32a4ff9640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f32900b6540 0x7f32900b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:48.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.740+0000 7f32a77fe640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f32900b6540 0x7f32900b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:48.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.740+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f329c0e7e40 con 0x7f32a81094a0 2024-09-21T06:12:48.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.741+0000 7f32a77fe640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f32900b6540 0x7f32900b8a50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3298006010 tx=0x7f3298000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:48.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.743+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f329c0b2720 con 0x7f32a81094a0 2024-09-21T06:12:48.975 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:48 smithi017 ceph-mon[31080]: pgmap v375: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:12:48.975 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:48 smithi017 ceph-mon[31080]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:48.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.972+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32a81a9170 con 0x7f32a81094a0 2024-09-21T06:12:48.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.973+0000 7f32a4ff9640 1 -- 172.21.15.17:0/1826369850 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11885 (secure 0 0 0) 0x7f329c0b7660 con 0x7f32a81094a0 2024-09-21T06:12:48.976 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:48.976 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-21T06:12:42:786101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:12:42.111135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:12:48.976 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-21T06:12:48.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f32900b6540 msgr2=0x7f32900b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:48.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f32900b6540 0x7f32900b8a50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3298006010 tx=0x7f3298000bc0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 msgr2=0x7f32a819cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:48.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 0x7f32a819cb80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f329c00e9f0 tx=0x7f329c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 shutdown_connections 2024-09-21T06:12:48.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f32900b6540 0x7f32900b8a50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32a81094a0 0x7f32a819cb80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a8109df0 0x7f32a81a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 --2- 172.21.15.17:0/1826369850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8103b60 0x7f32a819c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.975+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 >> 172.21.15.17:0/1826369850 conn(0x7f32a807b850 msgr2=0x7f32a8107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.976+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 shutdown_connections 2024-09-21T06:12:48.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:48.976+0000 7f32ade45640 1 -- 172.21.15.17:0/1826369850 wait complete. 2024-09-21T06:12:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:48 smithi089 ceph-mon[33879]: pgmap v375: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:12:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:48 smithi089 ceph-mon[33879]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:49.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:48 smithi081 ceph-mon[33870]: pgmap v375: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:12:49.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:48 smithi081 ceph-mon[33870]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:12:49.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:49.904 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:50.026 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:49 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1826369850' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:50.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:49 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1826369850' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:50.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:49 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1826369850' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 -- 172.21.15.17:0/3965801217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 msgr2=0x7f54a8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 --2- 172.21.15.17:0/3965801217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a8075b40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009900 tx=0x7f54a402a410 comp rx=0 tx=0).stop 2024-09-21T06:12:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 -- 172.21.15.17:0/3965801217 shutdown_connections 2024-09-21T06:12:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 --2- 172.21.15.17:0/3965801217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8110140 0x7f54a8112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 --2- 172.21.15.17:0/3965801217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8076080 0x7f54a810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 --2- 172.21.15.17:0/3965801217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a8075b40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 -- 172.21.15.17:0/3965801217 >> 172.21.15.17:0/3965801217 conn(0x7f54a807b850 msgr2=0x7f54a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 -- 172.21.15.17:0/3965801217 shutdown_connections 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.402+0000 7f54b0309640 1 -- 172.21.15.17:0/3965801217 wait complete. 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 Processor -- start 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 -- start start 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8076080 0x7f54a819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8110140 0x7f54a81a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f54a8115b80 con 0x7f54a8075730 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f54a8115a00 con 0x7f54a8110140 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54b0309640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f54a8115d00 con 0x7f54a8076080 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54ae0a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54ae0a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a819c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39336/0 (socket says 172.21.15.17:39336) 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.403+0000 7f54ae0a5640 1 -- 172.21.15.17:0/666404113 learned_addr learned my addr 172.21.15.17:0/666404113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae8a6640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8110140 0x7f54a81a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ad8a4640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8076080 0x7f54a819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae0a5640 1 -- 172.21.15.17:0/666404113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8076080 msgr2=0x7f54a819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae0a5640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8076080 0x7f54a819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae0a5640 1 -- 172.21.15.17:0/666404113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8110140 msgr2=0x7f54a81a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae0a5640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8110140 0x7f54a81a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae0a5640 1 -- 172.21.15.17:0/666404113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a81a2500 con 0x7f54a8075730 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ad8a4640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8076080 0x7f54a819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54ae0a5640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a819c650 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f54a402a930 tx=0x7f54a4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a403f070 con 0x7f54a8075730 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54a4003e40 con 0x7f54a8075730 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a81a2790 con 0x7f54a8075730 2024-09-21T06:12:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4035030 con 0x7f54a8075730 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.404+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a81a2cc0 con 0x7f54a8075730 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.405+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a8075b40 con 0x7f54a8075730 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.407+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f54a4042070 con 0x7f54a8075730 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.408+0000 7f549f7fe640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f54940b65c0 0x7f54940b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.408+0000 7f54ad8a4640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f54940b65c0 0x7f54940b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.408+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f54a41081e0 con 0x7f54a8075730 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.408+0000 7f54ad8a4640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f54940b65c0 0x7f54940b8ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f54980058c0 tx=0x7f5498005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.411+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54a81a2cc0 con 0x7f54a8075730 2024-09-21T06:12:50.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.640+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54a819d780 con 0x7f54a8075730 2024-09-21T06:12:50.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.641+0000 7f549f7fe640 1 -- 172.21.15.17:0/666404113 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11885 (secure 0 0 0) 0x7f54a40ce6e0 con 0x7f54a8075730 2024-09-21T06:12:50.644 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:50.644 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-21T06:12:42:786101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:12:42.111135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:12:50.644 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f54940b65c0 msgr2=0x7f54940b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f54940b65c0 0x7f54940b8ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f54980058c0 tx=0x7f5498005850 comp rx=0 tx=0).stop 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 msgr2=0x7f54a819c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a819c650 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f54a402a930 tx=0x7f54a4003c20 comp rx=0 tx=0).stop 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 shutdown_connections 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f54940b65c0 0x7f54940b8ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a8110140 0x7f54a81a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a8076080 0x7f54a819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 --2- 172.21.15.17:0/666404113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54a8075730 0x7f54a819c650 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.643+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 >> 172.21.15.17:0/666404113 conn(0x7f54a807b850 msgr2=0x7f54a8100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.644+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 shutdown_connections 2024-09-21T06:12:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:50.644+0000 7f54b0309640 1 -- 172.21.15.17:0/666404113 wait complete. 2024-09-21T06:12:51.067 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:50 smithi017 ceph-mon[31080]: pgmap v376: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:12:51.067 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:50 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/666404113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:50 smithi089 ceph-mon[33879]: pgmap v376: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:12:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:50 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/666404113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:51.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:50 smithi081 ceph-mon[33870]: pgmap v376: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:12:51.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:50 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/666404113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:51.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:12:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.169+0000 7f0993f06640 1 -- 172.21.15.17:0/1233381531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c105300 msgr2=0x7f098c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.169+0000 7f0993f06640 1 --2- 172.21.15.17:0/1233381531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c105300 0x7f098c10d850 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0980009900 tx=0x7f098002a410 comp rx=0 tx=0).stop 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 -- 172.21.15.17:0/1233381531 shutdown_connections 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 --2- 172.21.15.17:0/1233381531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c105300 0x7f098c10d850 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 --2- 172.21.15.17:0/1233381531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c10de10 0x7f098c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 --2- 172.21.15.17:0/1233381531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f098c1049b0 0x7f098c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 -- 172.21.15.17:0/1233381531 >> 172.21.15.17:0/1233381531 conn(0x7f098c079730 msgr2=0x7f098c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 -- 172.21.15.17:0/1233381531 shutdown_connections 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 -- 172.21.15.17:0/1233381531 wait complete. 2024-09-21T06:12:52.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 Processor -- start 2024-09-21T06:12:52.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.170+0000 7f0993f06640 1 -- start start 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0993f06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c1049b0 0x7f098c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0993f06640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f098c105300 0x7f098c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0993f06640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 0x7f098c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0993f06640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f098c113920 con 0x7f098c10de10 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0993f06640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f098c1137a0 con 0x7f098c1049b0 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0993f06640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f098c113aa0 con 0x7f098c105300 2024-09-21T06:12:52.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 0x7f098c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 0x7f098c103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39358/0 (socket says 172.21.15.17:39358) 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09914a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f098c105300 0x7f098c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 -- 172.21.15.17:0/3408113311 learned_addr learned my addr 172.21.15.17:0/3408113311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f0991ca2640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c1049b0 0x7f098c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 -- 172.21.15.17:0/3408113311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f098c105300 msgr2=0x7f098c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f098c105300 0x7f098c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 -- 172.21.15.17:0/3408113311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c1049b0 msgr2=0x7f098c1026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c1049b0 0x7f098c1026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.171+0000 7f09924a3640 1 -- 172.21.15.17:0/3408113311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c1a8710 con 0x7f098c10de10 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.172+0000 7f09924a3640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 0x7f098c103170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f097c00cad0 tx=0x7f097c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.172+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c00ae20 con 0x7f098c10de10 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.172+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f097c005020 con 0x7f098c10de10 2024-09-21T06:12:52.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.172+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098c1a8a00 con 0x7f098c10de10 2024-09-21T06:12:52.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.172+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c00f6b0 con 0x7f098c10de10 2024-09-21T06:12:52.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.172+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098c1a8f10 con 0x7f098c10de10 2024-09-21T06:12:52.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.173+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f098c104dc0 con 0x7f098c10de10 2024-09-21T06:12:52.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.175+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f097c0051d0 con 0x7f098c10de10 2024-09-21T06:12:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.175+0000 7f098affd640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f09740b6590 0x7f09740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.176+0000 7f0991ca2640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f09740b6590 0x7f09740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.176+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f097c0e7840 con 0x7f098c10de10 2024-09-21T06:12:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.176+0000 7f0991ca2640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f09740b6590 0x7f09740b8aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f098c104140 tx=0x7f098400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:52.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.179+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f097c014030 con 0x7f098c10de10 2024-09-21T06:12:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.367+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f098c1039f0 con 0x7f098c10de10 2024-09-21T06:12:52.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.369+0000 7f098affd640 1 -- 172.21.15.17:0/3408113311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24775 (secure 0 0 0) 0x7f098c1039f0 con 0x7f098c10de10 2024-09-21T06:12:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:52.372 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:11:47.669754+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f09740b6590 msgr2=0x7f09740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f09740b6590 0x7f09740b8aa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f098c104140 tx=0x7f098400b390 comp rx=0 tx=0).stop 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 msgr2=0x7f098c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 0x7f098c103170 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f097c00cad0 tx=0x7f097c00cf90 comp rx=0 tx=0).stop 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 shutdown_connections 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f09740b6590 0x7f09740b8aa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c10de10 0x7f098c103170 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f098c105300 0x7f098c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 --2- 172.21.15.17:0/3408113311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f098c1049b0 0x7f098c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 >> 172.21.15.17:0/3408113311 conn(0x7f098c079730 msgr2=0x7f098c0ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 shutdown_connections 2024-09-21T06:12:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:52.371+0000 7f0993f06640 1 -- 172.21.15.17:0/3408113311 wait complete. 2024-09-21T06:12:53.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:52 smithi017 ceph-mon[31080]: pgmap v377: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:12:53.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:52 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3408113311' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:53.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T06:12:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:52 smithi089 ceph-mon[33879]: pgmap v377: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:12:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:52 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3408113311' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:53.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:52 smithi081 ceph-mon[33870]: pgmap v377: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:12:53.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:52 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3408113311' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:12:53.381 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:54.751 INFO:teuthology.orchestra.run.smithi017.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T06:12:54.752 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T06:12:54.752 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T06:12:54.752 DEBUG:tasks.quiescer:Yielding 2024-09-21T06:12:54.752 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T06:12:54.766 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:12:54.766 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T06:12:54.766 INFO:tasks.workunit:timeout=3h 2024-09-21T06:12:54.766 INFO:tasks.workunit:cleanup=True 2024-09-21T06:12:54.767 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:54.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:12:54.787 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-21 06:11:05.020083334 +0000 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-21 06:11:05.020083334 +0000 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-21 06:12:41.715445652 +0000 2024-09-21T06:12:54.788 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-21T06:12:54.788 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T06:12:54.788 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T06:12:54.862 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:12:54.919 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T06:12:55.047 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:55.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:54 smithi089 ceph-mon[33879]: pgmap v378: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T06:12:55.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:54 smithi017 ceph-mon[31080]: pgmap v378: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T06:12:55.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:54 smithi081 ceph-mon[33870]: pgmap v378: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T06:12:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/4113225024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58102fa0 msgr2=0x7f6d5810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/4113225024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58102fa0 0x7f6d5810fcc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009900 tx=0x7f6d4802a480 comp rx=0 tx=0).stop 2024-09-21T06:12:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/4113225024 shutdown_connections 2024-09-21T06:12:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/4113225024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58102fa0 0x7f6d5810fcc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/4113225024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58110200 0x7f6d58112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/4113225024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58102650 0x7f6d58102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/4113225024 >> 172.21.15.17:0/4113225024 conn(0x7f6d58079760 msgr2=0x7f6d58079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/4113225024 shutdown_connections 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.522+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/4113225024 wait complete. 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 Processor -- start 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 -- start start 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58102650 0x7f6d5819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58102fa0 0x7f6d5819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 0x7f6d581a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58115b20 con 0x7f6d58110200 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581159a0 con 0x7f6d58102650 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5f8ae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58115ca0 con 0x7f6d58102fa0 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 0x7f6d581a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 0x7f6d581a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39370/0 (socket says 172.21.15.17:39370) 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 -- 172.21.15.17:0/447824946 learned_addr learned my addr 172.21.15.17:0/447824946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5d64a640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58102650 0x7f6d5819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5ce49640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58102fa0 0x7f6d5819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 -- 172.21.15.17:0/447824946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58102fa0 msgr2=0x7f6d5819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58102fa0 0x7f6d5819cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 -- 172.21.15.17:0/447824946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58102650 msgr2=0x7f6d5819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58102650 0x7f6d5819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5de4b640 1 -- 172.21.15.17:0/447824946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d581a2520 con 0x7f6d58110200 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.523+0000 7f6d5ce49640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58102fa0 0x7f6d5819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.524+0000 7f6d5de4b640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 0x7f6d581a1df0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009fd0 tx=0x7f6d5000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.524+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50017070 con 0x7f6d58110200 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.524+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d581a2810 con 0x7f6d58110200 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.524+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d50003e00 con 0x7f6d58110200 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.524+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50010460 con 0x7f6d58110200 2024-09-21T06:12:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.524+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d581a8f70 con 0x7f6d58110200 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.525+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5806c1f0 con 0x7f6d58110200 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.527+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6d50003970 con 0x7f6d58110200 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.527+0000 7f6d4e7fc640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d440b6510 0x7f6d440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.528+0000 7f6d5d64a640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d440b6510 0x7f6d440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.528+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f6d500e7800 con 0x7f6d58110200 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.528+0000 7f6d5d64a640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d440b6510 0x7f6d440b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400bbe0 tx=0x7f6d5400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.532+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d500add00 con 0x7f6d58110200 2024-09-21T06:12:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.761+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d58102a60 con 0x7f6d58110200 2024-09-21T06:12:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.762+0000 7f6d4e7fc640 1 -- 172.21.15.17:0/447824946 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11885 (secure 0 0 0) 0x7f6d500b20e0 con 0x7f6d58110200 2024-09-21T06:12:55.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:12:55.765 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-21T06:12:42:786101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:12:42.111135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:12:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-21T06:12:55.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.764+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d440b6510 msgr2=0x7f6d440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:55.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d440b6510 0x7f6d440b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400bbe0 tx=0x7f6d5400b390 comp rx=0 tx=0).stop 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 msgr2=0x7f6d581a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 0x7f6d581a1df0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009fd0 tx=0x7f6d5000b260 comp rx=0 tx=0).stop 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 shutdown_connections 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f6d440b6510 0x7f6d440b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d58110200 0x7f6d581a1df0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d58102fa0 0x7f6d5819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 --2- 172.21.15.17:0/447824946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d58102650 0x7f6d5819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 >> 172.21.15.17:0/447824946 conn(0x7f6d58079760 msgr2=0x7f6d581116b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 shutdown_connections 2024-09-21T06:12:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:55.765+0000 7f6d5f8ae640 1 -- 172.21.15.17:0/447824946 wait complete. 2024-09-21T06:12:56.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:55 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/447824946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:56.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:55 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/447824946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:56.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:55 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/447824946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:12:56.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:10:17.202602+0000', 'modified': '2024-09-21T06:12:42.111135+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24656, 'mds_1': 24649, 'mds_2': 24631}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/1978692137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1978692137}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1978692137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/3289455904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3289455904}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3289455904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.89:6835/1688371803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 1688371803}, {'type': 'v1', 'addr': '172.21.15.89:6835', 'nonce': 1688371803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.89:6837/857098251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 857098251}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 857098251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.89:6839/326704663', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6838', 'nonce': 326704663}, {'type': 'v1', 'addr': '172.21.15.89:6839', 'nonce': 326704663}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6839/84773565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 84773565}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 84773565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24656, 'qdb_cluster': [24656, 24649, 24631]} 2024-09-21T06:12:56.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:12:56.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:12:56.778 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:56 smithi089 ceph-mon[33879]: pgmap v379: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:12:57.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:56 smithi017 ceph-mon[31080]: pgmap v379: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:12:57.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:56 smithi081 ceph-mon[33870]: pgmap v379: 129 pgs: 129 active+clean; 651 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:12:57.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 -- 172.21.15.17:0/2117131535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4698108d20 msgr2=0x7f469810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 --2- 172.21.15.17:0/2117131535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4698108d20 0x7f469810f550 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4690009ca0 tx=0x7f469002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 -- 172.21.15.17:0/2117131535 shutdown_connections 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 --2- 172.21.15.17:0/2117131535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4698108d20 0x7f469810f550 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 --2- 172.21.15.17:0/2117131535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46981083d0 0x7f46981087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 --2- 172.21.15.17:0/2117131535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698102ae0 0x7f4698102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 -- 172.21.15.17:0/2117131535 >> 172.21.15.17:0/2117131535 conn(0x7f46980797b0 msgr2=0x7f4698079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 -- 172.21.15.17:0/2117131535 shutdown_connections 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.262+0000 7f469e6f6640 1 -- 172.21.15.17:0/2117131535 wait complete. 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 Processor -- start 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 -- start start 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4698102ae0 0x7f46980ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 0x7f46980ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698108d20 0x7f46981000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46981128e0 con 0x7f46981083d0 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4698112760 con 0x7f4698108d20 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469e6f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4698112a60 con 0x7f4698102ae0 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 0x7f46980ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 0x7f46980ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39382/0 (socket says 172.21.15.17:39382) 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 -- 172.21.15.17:0/689947249 learned_addr learned my addr 172.21.15.17:0/689947249 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f4697fff640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4698102ae0 0x7f46980ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469cc93640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698108d20 0x7f46981000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 -- 172.21.15.17:0/689947249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4698102ae0 msgr2=0x7f46980ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4698102ae0 0x7f46980ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 -- 172.21.15.17:0/689947249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698108d20 msgr2=0x7f46981000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698108d20 0x7f46981000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f468ffff640 1 -- 172.21.15.17:0/689947249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46981a86a0 con 0x7f46981083d0 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.263+0000 7f469cc93640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698108d20 0x7f46981000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.264+0000 7f468ffff640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 0x7f46980ffbb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f468000c970 tx=0x7f468000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.264+0000 7f4695ffb640 1 -- 172.21.15.17:0/689947249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680007bb0 con 0x7f46981083d0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.264+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46981a8990 con 0x7f46981083d0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.264+0000 7f4695ffb640 1 -- 172.21.15.17:0/689947249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4680007d50 con 0x7f46981083d0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.264+0000 7f4695ffb640 1 -- 172.21.15.17:0/689947249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680004d40 con 0x7f46981083d0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.264+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46981a8ed0 con 0x7f46981083d0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.266+0000 7f46a4c6a740 1 Processor -- start 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 -- start start 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x56347321af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347321b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e54280 0x56347321b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563473192c10 con 0x563472e74f60 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563473182040 con 0x563472e54280 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563473185e50 con 0x563472e4c0a0 2024-09-21T06:12:57.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x56347321af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x56347321af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39396/0 (socket says 172.21.15.17:39396) 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 -- 172.21.15.17:0/3793536220 learned_addr learned my addr 172.21.15.17:0/3793536220 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f4697fff640 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347321b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 -- 172.21.15.17:0/3793536220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 msgr2=0x56347321b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347321b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 -- 172.21.15.17:0/3793536220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e54280 msgr2=0x56347321b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e54280 0x56347321b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.267+0000 7f469cc93640 1 -- 172.21.15.17:0/3793536220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563472ee0540 con 0x563472e74f60 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.268+0000 7f469cc93640 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x56347321af00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4690009a60 tx=0x7f4690031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90ef13b83c62a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.268+0000 7f468e7fc640 1 -- 172.21.15.17:0/3793536220 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690031b80 con 0x563472e74f60 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.268+0000 7f468e7fc640 1 -- 172.21.15.17:0/3793536220 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4690036040 con 0x563472e74f60 2024-09-21T06:12:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.268+0000 7f468e7fc640 1 -- 172.21.15.17:0/3793536220 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690004570 con 0x563472e74f60 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.268+0000 7f4695ffb640 1 -- 172.21.15.17:0/689947249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4680005020 con 0x7f46981083d0 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3793536220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 msgr2=0x56347321af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x56347321af00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4690009a60 tx=0x7f4690031610 comp rx=0 tx=0).stop 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3793536220 shutdown_connections 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e54280 0x56347321b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347321b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3793536220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x56347321af00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3793536220 >> 172.21.15.17:0/3793536220 conn(0x563472e69350 msgr2=0x563473218df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3793536220 shutdown_connections 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3793536220 wait complete. 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f4695ffb640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46840b6420 0x7f46840b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f4697fff640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46840b6420 0x7f46840b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f46a4c6a740 1 -- start start 2024-09-21T06:12:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.269+0000 7f4695ffb640 1 -- 172.21.15.17:0/689947249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f46800e7350 con 0x7f46981083d0 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 Processor -- start 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f4697fff640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46840b6420 0x7f46840b8930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x563473219b80 tx=0x7f468800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473226a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x563473226f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e74f60 0x563473232970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563472fe35f0 con 0x563472e54280 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56347311d010 con 0x563472e4c0a0 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563473229680 con 0x563472e74f60 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f46a4c6a740 10 client.0 _ll_register_callbacks cb 0x56347317c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f468ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x563473226f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f468ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x563473226f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39402/0 (socket says 172.21.15.17:39402) 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f468ffff640 1 -- 172.21.15.17:0/3611945740 learned_addr learned my addr 172.21.15.17:0/3611945740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:57.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.270+0000 7f4697fff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473226a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f468ffff640 1 -- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e74f60 msgr2=0x563473232970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f468ffff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e74f60 0x563473232970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f468ffff640 1 -- 172.21.15.17:0/3611945740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 msgr2=0x563473226a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f468ffff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473226a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f468ffff640 1 -- 172.21.15.17:0/3611945740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56347314aa00 con 0x563472e54280 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f4697fff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473226a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f468ffff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x563473226f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f46800ad0e0 tx=0x7f46800056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473ce54940eff1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46777fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46777fe640 1 -- 172.21.15.17:0/3611945740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468001d040 con 0x563472e54280 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46777fe640 1 -- 172.21.15.17:0/3611945740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f46800a8cb0 con 0x563472e54280 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4690036040 con 0x563472e54280 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46777fe640 1 -- 172.21.15.17:0/3611945740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f46800acaa0 con 0x563472e54280 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46a4c6a740 10 client.15453 fetch_fsmap learned FSMap version 26 2024-09-21T06:12:57.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563473235640 con 0x563472e54280 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.271+0000 7f46777fe640 1 -- 172.21.15.17:0/3611945740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4690036040 con 0x563472e54280 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46777fe640 1 -- 172.21.15.17:0/3611945740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f46800abe20 con 0x563472e54280 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46a4c6a740 10 client.15453 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46a4c6a740 10 client.15453 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46a4c6a740 20 client.15453 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e338e0 0x563473239050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46a4c6a740 4 client.15453 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 --> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563473194b60 con 0x563472e338e0 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f4697fff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e338e0 0x563473239050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f46777fe640 10 client.15453 ms_handle_connect on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.272+0000 7f4697fff640 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e338e0 0x563473239050 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57f37103ff3517f8 server_cookie=57cbf44b3ef8a0fb in_seq=0 out_seq=0 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.273+0000 7f46777fe640 1 -- 172.21.15.17:0/3611945740 <== mds.2 v2:172.21.15.89:6836/857098251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563473194b60 con 0x563472e338e0 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.273+0000 7f46777fe640 10 client.15453 handle_command_reply: tid=0 2024-09-21T06:12:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.273+0000 7f46a4c6a740 1 client.15453 shutdown 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 msgr2=0x563473226f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x563473226f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f46800ad0e0 tx=0x7f46800056e0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 shutdown_connections 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e338e0 0x563473239050 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x563473226f40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e74f60 0x563473232970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3611945740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473226a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46777fe640 0 client.15453 ms_handle_reset on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 >> 172.21.15.17:0/3611945740 conn(0x563472e69350 msgr2=0x56347321e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 shutdown_connections 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3611945740 wait complete. 2024-09-21T06:12:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.274+0000 7f46a4c6a740 20 client.15453 trim_cache size 0 max 16384 2024-09-21T06:12:57.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.292+0000 7f46a4c6a740 1 Processor -- start 2024-09-21T06:12:57.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.292+0000 7f46a4c6a740 1 -- start start 2024-09-21T06:12:57.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.292+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473213ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.292+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e54280 0x563473221020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x5634732328e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563473237390 con 0x563472e74f60 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563473237a60 con 0x563472e4c0a0 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563473238130 con 0x563472e54280 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x5634732328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x5634732328e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39414/0 (socket says 172.21.15.17:39414) 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 -- 172.21.15.17:0/3294223938 learned_addr learned my addr 172.21.15.17:0/3294223938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f4697fff640 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473213ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f468ffff640 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e54280 0x563473221020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 -- 172.21.15.17:0/3294223938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e54280 msgr2=0x563473221020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e54280 0x563473221020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 -- 172.21.15.17:0/3294223938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 msgr2=0x563473213ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473213ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 -- 172.21.15.17:0/3294223938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563473213080 con 0x563472e74f60 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f4697fff640 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473213ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.293+0000 7f469cc93640 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x5634732328e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f469002ade0 tx=0x7f469002af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799a14c37f2bcffd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.294+0000 7f468dffb640 1 -- 172.21.15.17:0/3294223938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690052070 con 0x563472e74f60 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.294+0000 7f468dffb640 1 -- 172.21.15.17:0/3294223938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4690036040 con 0x563472e74f60 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.294+0000 7f468dffb640 1 -- 172.21.15.17:0/3294223938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690004040 con 0x563472e74f60 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.294+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3294223938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 msgr2=0x5634732328e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x5634732328e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f469002ade0 tx=0x7f469002af40 comp rx=0 tx=0).stop 2024-09-21T06:12:57.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3294223938 shutdown_connections 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e74f60 0x5634732328e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e54280 0x563473221020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3294223938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e4c0a0 0x563473213ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3294223938 >> 172.21.15.17:0/3294223938 conn(0x563472e69350 msgr2=0x5634732269e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3294223938 shutdown_connections 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3294223938 wait complete. 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 -- start start 2024-09-21T06:12:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.295+0000 7f46a4c6a740 1 Processor -- start 2024-09-21T06:12:57.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347323b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x56347323b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e74f60 0x56347323bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563473238ed0 con 0x563472e54280 2024-09-21T06:12:57.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563473238800 con 0x563472e74f60 2024-09-21T06:12:57.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5634732395a0 con 0x563472e4c0a0 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46a4c6a740 10 client.0 _ll_register_callbacks cb 0x7f468000c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x56347323b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f4697fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347323b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x56347323b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39424/0 (socket says 172.21.15.17:39424) 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 -- 172.21.15.17:0/3840270266 learned_addr learned my addr 172.21.15.17:0/3840270266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f469cc93640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e74f60 0x56347323bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 -- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 msgr2=0x56347323b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347323b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 -- 172.21.15.17:0/3840270266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e74f60 msgr2=0x56347323bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e74f60 0x56347323bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 -- 172.21.15.17:0/3840270266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563473240ba0 con 0x563472e54280 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f4697fff640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347323b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f468ffff640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x56347323b8a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4680007770 tx=0x7f46800a90c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9e0995da97ebef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:57.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.296+0000 7f46777fe640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46777fe640 1 -- 172.21.15.17:0/3840270266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468001d040 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4690036040 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46777fe640 1 -- 172.21.15.17:0/3840270266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f46800b2e60 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46777fe640 1 -- 172.21.15.17:0/3840270266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f46800ac8c0 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 10 client.15459 fetch_fsmap learned FSMap version 26 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5634732a4860 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46777fe640 1 -- 172.21.15.17:0/3840270266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4690036040 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46777fe640 1 -- 172.21.15.17:0/3840270266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4680098110 con 0x563472e54280 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 10 client.15459 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 10 client.15459 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 20 client.15459 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e08c90 0x5634732a8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 4 client.15459 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.297+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 --> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] -- command(tid 0: {"prefix": "status"}) -- 0x563473190610 con 0x563472e08c90 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f4697fff640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e08c90 0x5634732a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46777fe640 10 client.15459 ms_handle_connect on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f4697fff640 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e08c90 0x5634732a8110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fee7571c9076dcfd server_cookie=e8d1698f7590b2ee in_seq=0 out_seq=0 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46777fe640 1 -- 172.21.15.17:0/3840270266 <== mds.2 v2:172.21.15.89:6836/857098251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x563473190610 con 0x563472e08c90 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46777fe640 10 client.15459 handle_command_reply: tid=0 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 client.15459 shutdown 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 msgr2=0x56347323b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x56347323b8a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4680007770 tx=0x7f46800a90c0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 shutdown_connections 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:6836/857098251,v1:172.21.15.89:6837/857098251] conn(0x563472e08c90 0x5634732a8110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563472e54280 0x56347323b8a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563472e74f60 0x56347323bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46777fe640 0 client.15459 ms_handle_reset on v2:172.21.15.89:6836/857098251 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 --2- 172.21.15.17:0/3840270266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563472e4c0a0 0x56347323b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.298+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 >> 172.21.15.17:0/3840270266 conn(0x563472e69350 msgr2=0x563473224c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 shutdown_connections 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f46a4c6a740 1 -- 172.21.15.17:0/3840270266 wait complete. 2024-09-21T06:12:57.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f46a4c6a740 20 client.15459 trim_cache size 0 max 16384 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24631, 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 118.5815384, 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T06:12:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 184.87137403599999 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46840b6420 msgr2=0x7f46840b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46840b6420 0x7f46840b8930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x563473219b80 tx=0x7f468800b390 comp rx=0 tx=0).stop 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 msgr2=0x7f46980ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 0x7f46980ffbb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f468000c970 tx=0x7f468000ce30 comp rx=0 tx=0).stop 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 shutdown_connections 2024-09-21T06:12:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f46840b6420 0x7f46840b8930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46981083d0 0x7f46980ffbb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4698108d20 0x7f46981000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 --2- 172.21.15.17:0/689947249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4698102ae0 0x7f46980ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 >> 172.21.15.17:0/689947249 conn(0x7f46980797b0 msgr2=0x7f4698101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 shutdown_connections 2024-09-21T06:12:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:57.299+0000 7f469e6f6640 1 -- 172.21.15.17:0/689947249 wait complete. 2024-09-21T06:12:58.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:12:58.366 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:12:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 -- 172.21.15.17:0/1121065030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 msgr2=0x7fdbec103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 --2- 172.21.15.17:0/1121065030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec103f70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009900 tx=0x7fdbdc02a410 comp rx=0 tx=0).stop 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 -- 172.21.15.17:0/1121065030 shutdown_connections 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 --2- 172.21.15.17:0/1121065030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec109df0 0x7fdbec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 --2- 172.21.15.17:0/1121065030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1094a0 0x7fdbec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 --2- 172.21.15.17:0/1121065030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec103f70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 -- 172.21.15.17:0/1121065030 >> 172.21.15.17:0/1121065030 conn(0x7fdbec07b850 msgr2=0x7fdbec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 -- 172.21.15.17:0/1121065030 shutdown_connections 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.844+0000 7fdbf225b640 1 -- 172.21.15.17:0/1121065030 wait complete. 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 Processor -- start 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 -- start start 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1094a0 0x7fdbec19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec109df0 0x7fdbec19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec1139a0 con 0x7fdbec103b60 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec113820 con 0x7fdbec109df0 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbf225b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec113b20 con 0x7fdbec1094a0 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43780/0 (socket says 172.21.15.17:43780) 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/283577364 learned_addr learned my addr 172.21.15.17:0/283577364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbebfff640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec109df0 0x7fdbec19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.845+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1094a0 0x7fdbec19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/283577364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1094a0 msgr2=0x7fdbec19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1094a0 0x7fdbec19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/283577364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec109df0 msgr2=0x7fdbec19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec109df0 0x7fdbec19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/283577364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec1a03c0 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec19a450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009a20 tx=0x7fdbdc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbe8ff9640 1 -- 172.21.15.17:0/283577364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc03f030 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbe8ff9640 1 -- 172.21.15.17:0/283577364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbdc0035f0 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbec1a0650 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbe8ff9640 1 -- 172.21.15.17:0/283577364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc035070 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.846+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbec1a6e10 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 Processor -- start 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 -- start start 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbe8ff9640 1 -- 172.21.15.17:0/283577364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdbdc003a60 con 0x7fdbec103b60 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cc2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cc3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cc3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ae2c3ac10 con 0x564ae28f40a0 2024-09-21T06:12:58.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ae2c2a040 con 0x564ae291cf60 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ae2c2de50 con 0x564ae28fc280 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cc3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cc3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43792/0 (socket says 172.21.15.17:43792) 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/177852672 learned_addr learned my addr 172.21.15.17:0/177852672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbebfff640 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cc2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.849+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cc3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/177852672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 msgr2=0x564ae2cc3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cc3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/177852672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 msgr2=0x564ae2cc2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cc2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/177852672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae2988540 con 0x564ae28f40a0 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cc3440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc1103f0 tx=0x7fdbdc1104e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80dbf3ffcda769b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbe8ff9640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbd40b6510 0x7fdbd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbd1ffb640 1 -- 172.21.15.17:0/177852672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0ca650 con 0x564ae28f40a0 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbebfff640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbd40b6510 0x7fdbd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbd1ffb640 1 -- 172.21.15.17:0/177852672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbdc115030 con 0x564ae28f40a0 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbd1ffb640 1 -- 172.21.15.17:0/177852672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0cd770 con 0x564ae28f40a0 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.850+0000 7fdbe8ff9640 1 -- 172.21.15.17:0/283577364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fdbdc108200 con 0x7fdbec103b60 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 -- 172.21.15.17:0/177852672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 msgr2=0x564ae2cc3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbebfff640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbd40b6510 0x7fdbd40b8a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400af10 tx=0x7fdbe400a4d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cc3440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc1103f0 tx=0x7fdbdc1104e0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 -- 172.21.15.17:0/177852672 shutdown_connections 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cc3440 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cc3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/177852672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cc2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 -- 172.21.15.17:0/177852672 >> 172.21.15.17:0/177852672 conn(0x564ae2911350 msgr2=0x564ae2cc0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:58.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 -- 172.21.15.17:0/177852672 shutdown_connections 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.851+0000 7fdbf87cf740 1 -- 172.21.15.17:0/177852672 wait complete. 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 -- start start 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 Processor -- start 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cda700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ae2a8b5f0 con 0x564ae28f40a0 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ae2bc5010 con 0x564ae291cf60 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ae2cd14a0 con 0x564ae28fc280 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbf87cf740 10 client.0 _ll_register_callbacks cb 0x564ae2c24340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43800/0 (socket says 172.21.15.17:43800) 2024-09-21T06:12:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/1140763160 learned_addr learned my addr 172.21.15.17:0/1140763160 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.852+0000 7fdbebfff640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cda700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 msgr2=0x564ae2cceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/1140763160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 msgr2=0x564ae2cda700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cda700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeb7fe640 1 -- 172.21.15.17:0/1140763160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae2bf2a00 con 0x564ae28f40a0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cce720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0cdb10 tx=0x7fdbdc10bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68ac3a5c63e4f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbcaffd640 1 -- 172.21.15.17:0/1140763160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0d5e60 con 0x564ae28f40a0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbcaffd640 1 -- 172.21.15.17:0/1140763160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fdbdc0ca270 con 0x564ae28f40a0 2024-09-21T06:12:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbdc115030 con 0x564ae28f40a0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbcaffd640 1 -- 172.21.15.17:0/1140763160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbdc0cd950 con 0x564ae28f40a0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbf87cf740 10 client.15471 fetch_fsmap learned FSMap version 26 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564ae2cdd270 con 0x564ae28f40a0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.853+0000 7fdbcaffd640 1 -- 172.21.15.17:0/1140763160 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbdc115030 con 0x564ae28f40a0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbcaffd640 1 -- 172.21.15.17:0/1140763160 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdbdc10b380 con 0x564ae28f40a0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbf87cf740 10 client.15471 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbf87cf740 10 client.15471 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbf87cf740 20 client.15471 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28db8e0 0x564ae2ce08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbf87cf740 4 client.15471 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 --> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ae2c3cb60 con 0x564ae28db8e0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28db8e0 0x564ae2ce08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28db8e0 0x564ae2ce08b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91a93a54b3c67ae1 server_cookie=52559f7d1d5e6c2f in_seq=0 out_seq=0 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.854+0000 7fdbcaffd640 10 client.15471 ms_handle_connect on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbcaffd640 1 -- 172.21.15.17:0/1140763160 <== mds.1 v2:172.21.15.89:6838/326704663 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ae2c3cb60 con 0x564ae28db8e0 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbcaffd640 10 client.15471 handle_command_reply: tid=0 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 client.15471 shutdown 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 msgr2=0x564ae2cce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cce720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0cdb10 tx=0x7fdbdc10bb40 comp rx=0 tx=0).stop 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 shutdown_connections 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28db8e0 0x564ae2ce08b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2cda700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28fc280 0x564ae2cceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbcaffd640 0 client.15471 ms_handle_reset on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/1140763160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28f40a0 0x564ae2cce720 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.855+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 >> 172.21.15.17:0/1140763160 conn(0x564ae2911350 msgr2=0x564ae2cc6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.856+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 shutdown_connections 2024-09-21T06:12:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.856+0000 7fdbf87cf740 1 -- 172.21.15.17:0/1140763160 wait complete. 2024-09-21T06:12:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.856+0000 7fdbf87cf740 20 client.15471 trim_cache size 0 max 16384 2024-09-21T06:12:58.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 Processor -- start 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 -- start start 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2cc9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae28fc280 0x564ae2ccebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 0x564ae2cda490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ae2cdebf0 con 0x564ae291cf60 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ae2cdf2c0 con 0x564ae28fc280 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ae2cdf990 con 0x564ae28f40a0 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 0x564ae2cda490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 0x564ae2cda490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43814/0 (socket says 172.21.15.17:43814) 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbebfff640 1 -- 172.21.15.17:0/3754586746 learned_addr learned my addr 172.21.15.17:0/3754586746 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.874+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae28fc280 0x564ae2ccebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2cc9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbebfff640 1 -- 172.21.15.17:0/3754586746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 msgr2=0x564ae2cc9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbebfff640 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2cc9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbebfff640 1 -- 172.21.15.17:0/3754586746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae28fc280 msgr2=0x564ae2ccebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbebfff640 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae28fc280 0x564ae2ccebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbebfff640 1 -- 172.21.15.17:0/3754586746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae2ccf9e0 con 0x564ae291cf60 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae28fc280 0x564ae2ccebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbebfff640 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 0x564ae2cda490 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4005e50 tx=0x7fdbe4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210e9afd87892afc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbd17fa640 1 -- 172.21.15.17:0/3754586746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe401be30 con 0x564ae291cf60 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbd17fa640 1 -- 172.21.15.17:0/3754586746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe40278f0 con 0x564ae291cf60 2024-09-21T06:12:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.875+0000 7fdbd17fa640 1 -- 172.21.15.17:0/3754586746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400f7f0 con 0x564ae291cf60 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 -- 172.21.15.17:0/3754586746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 msgr2=0x564ae2cda490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 0x564ae2cda490 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4005e50 tx=0x7fdbe4015000 comp rx=0 tx=0).stop 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 -- 172.21.15.17:0/3754586746 shutdown_connections 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae291cf60 0x564ae2cda490 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae28fc280 0x564ae2ccebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/3754586746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2cc9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 -- 172.21.15.17:0/3754586746 >> 172.21.15.17:0/3754586746 conn(0x564ae2911350 msgr2=0x564ae2cce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 -- 172.21.15.17:0/3754586746 shutdown_connections 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.876+0000 7fdbf87cf740 1 -- 172.21.15.17:0/3754586746 wait complete. 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 -- start start 2024-09-21T06:12:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 Processor -- start 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2ce2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 0x564ae2ce32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2ce8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ae2ce0730 con 0x564ae28fc280 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ae2ce0060 con 0x564ae291cf60 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ae2ce0e00 con 0x564ae28f40a0 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbf87cf740 10 client.0 _ll_register_callbacks cb 0x7fdbe400a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbeaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 0x564ae2ce32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbeaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 0x564ae2ce32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43824/0 (socket says 172.21.15.17:43824) 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbeaffd640 1 -- 172.21.15.17:0/2490430240 learned_addr learned my addr 172.21.15.17:0/2490430240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.877+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2ce2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbebfff640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2ce8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeaffd640 1 -- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 msgr2=0x564ae2ce2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2ce2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeaffd640 1 -- 172.21.15.17:0/2490430240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 msgr2=0x564ae2ce8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2ce8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeaffd640 1 -- 172.21.15.17:0/2490430240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae2ce3ac0 con 0x564ae28fc280 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2ce2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbeaffd640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 0x564ae2ce32d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000b9c0 tx=0x7fdbe0016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857add4474c057c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbcaffd640 1 -- 172.21.15.17:0/2490430240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0021020 con 0x564ae28fc280 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbcaffd640 1 -- 172.21.15.17:0/2490430240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fdbe001d690 con 0x564ae28fc280 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe40278f0 con 0x564ae28fc280 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbcaffd640 1 -- 172.21.15.17:0/2490430240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbe002c050 con 0x564ae28fc280 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbf87cf740 10 client.15477 fetch_fsmap learned FSMap version 26 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.878+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564ae2d4c2f0 con 0x564ae28fc280 2024-09-21T06:12:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbcaffd640 1 -- 172.21.15.17:0/2490430240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe40278f0 con 0x564ae28fc280 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbcaffd640 1 -- 172.21.15.17:0/2490430240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdbe0015770 con 0x564ae28fc280 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbf87cf740 10 client.15477 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbf87cf740 10 client.15477 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbf87cf740 20 client.15477 populate_metadata read hostname 'smithi017' 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28b0c90 0x564ae2d4fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbf87cf740 4 client.15477 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 --> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] -- command(tid 0: {"prefix": "status"}) -- 0x564ae2c38610 con 0x564ae28b0c90 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28b0c90 0x564ae2d4fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbeb7fe640 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28b0c90 0x564ae2d4fc40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d50977a9ecfc0027 server_cookie=d2119bd53bd8b42f in_seq=0 out_seq=0 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.879+0000 7fdbcaffd640 10 client.15477 ms_handle_connect on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbcaffd640 1 -- 172.21.15.17:0/2490430240 <== mds.1 v2:172.21.15.89:6838/326704663 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564ae2c38610 con 0x564ae28b0c90 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbcaffd640 10 client.15477 handle_command_reply: tid=0 2024-09-21T06:12:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 client.15477 shutdown 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 msgr2=0x564ae2ce32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 0x564ae2ce32d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000b9c0 tx=0x7fdbe0016800 comp rx=0 tx=0).stop 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 shutdown_connections 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:6838/326704663,v1:172.21.15.89:6839/326704663] conn(0x564ae28b0c90 0x564ae2d4fc40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ae28fc280 0x564ae2ce32d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ae291cf60 0x564ae2ce8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 --2- 172.21.15.17:0/2490430240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ae28f40a0 0x564ae2ce2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 >> 172.21.15.17:0/2490430240 conn(0x564ae2911350 msgr2=0x564ae2ccec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbcaffd640 0 client.15477 ms_handle_reset on v2:172.21.15.89:6838/326704663 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 shutdown_connections 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 1 -- 172.21.15.17:0/2490430240 wait complete. 2024-09-21T06:12:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.880+0000 7fdbf87cf740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24649, 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 121.171734273, 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 181.14447048700001 2024-09-21T06:12:58.888 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbd40b6510 msgr2=0x7fdbd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbd40b6510 0x7fdbd40b8a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400af10 tx=0x7fdbe400a4d0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 msgr2=0x7fdbec19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec19a450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009a20 tx=0x7fdbdc004270 comp rx=0 tx=0).stop 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 shutdown_connections 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbd40b6510 0x7fdbd40b8a20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbec109df0 0x7fdbec19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbec1094a0 0x7fdbec19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 --2- 172.21.15.17:0/283577364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbec103b60 0x7fdbec19a450 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 >> 172.21.15.17:0/283577364 conn(0x7fdbec07b850 msgr2=0x7fdbec1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 shutdown_connections 2024-09-21T06:12:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:12:58.881+0000 7fdbf225b640 1 -- 172.21.15.17:0/283577364 wait complete. 2024-09-21T06:12:59.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:12:58 smithi089 ceph-mon[33879]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:12:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:12:58 smithi017 ceph-mon[31080]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:12:59.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:12:58 smithi081 ceph-mon[33870]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:12:59.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:12:59.905 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 -- 172.21.15.17:0/3838130733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 msgr2=0x7f750c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 --2- 172.21.15.17:0/3838130733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c10d8d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7500009900 tx=0x7f750002a410 comp rx=0 tx=0).stop 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 -- 172.21.15.17:0/3838130733 shutdown_connections 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 --2- 172.21.15.17:0/3838130733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c10d8d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 --2- 172.21.15.17:0/3838130733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f750c10de60 0x7f750c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 --2- 172.21.15.17:0/3838130733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c104a30 0x7f750c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 -- 172.21.15.17:0/3838130733 >> 172.21.15.17:0/3838130733 conn(0x7f750c079760 msgr2=0x7f750c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 -- 172.21.15.17:0/3838130733 shutdown_connections 2024-09-21T06:13:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.384+0000 7f7511e86640 1 -- 172.21.15.17:0/3838130733 wait complete. 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 Processor -- start 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 -- start start 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f750c104a30 0x7f750c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c10de60 0x7f750c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f750c113950 con 0x7f750c105380 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f750c1137d0 con 0x7f750c10de60 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f7511e86640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f750c113ad0 con 0x7f750c104a30 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.385+0000 7f750affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43840/0 (socket says 172.21.15.17:43840) 2024-09-21T06:13:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 -- 172.21.15.17:0/3342879439 learned_addr learned my addr 172.21.15.17:0/3342879439 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750b7fe640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f750c104a30 0x7f750c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750bfff640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c10de60 0x7f750c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 -- 172.21.15.17:0/3342879439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f750c104a30 msgr2=0x7f750c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f750c104a30 0x7f750c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 -- 172.21.15.17:0/3342879439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c10de60 msgr2=0x7f750c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c10de60 0x7f750c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 -- 172.21.15.17:0/3342879439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c1a0330 con 0x7f750c105380 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f750affd640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c19a960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7500004770 tx=0x7f7500004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f7508ff9640 1 -- 172.21.15.17:0/3342879439 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750003f030 con 0x7f750c105380 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f7508ff9640 1 -- 172.21.15.17:0/3342879439 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7500004440 con 0x7f750c105380 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750c1a05c0 con 0x7f750c105380 2024-09-21T06:13:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f7508ff9640 1 -- 172.21.15.17:0/3342879439 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500035070 con 0x7f750c105380 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.386+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750c1a6d80 con 0x7f750c105380 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.389+0000 7f75183fa740 1 Processor -- start 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.389+0000 7f75183fa740 1 -- start start 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f75183fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b334f60 0x55ec5b6daf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f75183fa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6db440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f75183fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 0x55ec5b6db980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f75183fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b652c10 con 0x55ec5b314280 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f75183fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b642040 con 0x55ec5b334f60 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f75183fa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b645e50 con 0x55ec5b30c0a0 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f7508ff9640 1 -- 172.21.15.17:0/3342879439 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7500042030 con 0x7f750c105380 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 0x55ec5b6db980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 0x55ec5b6db980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43852/0 (socket says 172.21.15.17:43852) 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750affd640 1 -- 172.21.15.17:0/4275428616 learned_addr learned my addr 172.21.15.17:0/4275428616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750bfff640 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b334f60 0x55ec5b6daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750b7fe640 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750affd640 1 -- 172.21.15.17:0/4275428616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b30c0a0 msgr2=0x55ec5b6db440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.390+0000 7f750affd640 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6db440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f750affd640 1 -- 172.21.15.17:0/4275428616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b334f60 msgr2=0x55ec5b6daf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f750affd640 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b334f60 0x55ec5b6daf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f750affd640 1 -- 172.21.15.17:0/4275428616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5b3a0540 con 0x55ec5b314280 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f750bfff640 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b334f60 0x55ec5b6daf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f750affd640 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 0x55ec5b6db980 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f750010db70 tx=0x7f750010dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2921642dfc93c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f7508ff9640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f74f40b6590 0x7f74f40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f74f1ffb640 1 -- 172.21.15.17:0/4275428616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500111650 con 0x55ec5b314280 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f74f1ffb640 1 -- 172.21.15.17:0/4275428616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7500117020 con 0x55ec5b314280 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f74f1ffb640 1 -- 172.21.15.17:0/4275428616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75000ccfa0 con 0x55ec5b314280 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f750bfff640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f74f40b6590 0x7f74f40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.391+0000 7f7508ff9640 1 -- 172.21.15.17:0/3342879439 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f75001079e0 con 0x7f750c105380 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 -- 172.21.15.17:0/4275428616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 msgr2=0x55ec5b6db980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f750bfff640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f74f40b6590 0x7f74f40b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7504009fd0 tx=0x7f7504009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 0x55ec5b6db980 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f750010db70 tx=0x7f750010dc60 comp rx=0 tx=0).stop 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 -- 172.21.15.17:0/4275428616 shutdown_connections 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b314280 0x55ec5b6db980 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6db440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 --2- 172.21.15.17:0/4275428616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b334f60 0x55ec5b6daf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 -- 172.21.15.17:0/4275428616 >> 172.21.15.17:0/4275428616 conn(0x55ec5b329350 msgr2=0x55ec5b6d8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 -- 172.21.15.17:0/4275428616 shutdown_connections 2024-09-21T06:13:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.392+0000 7f75183fa740 1 -- 172.21.15.17:0/4275428616 wait complete. 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 -- start start 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 Processor -- start 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6eab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b334f60 0x55ec5b6f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b4a35f0 con 0x55ec5b30c0a0 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b5dd010 con 0x55ec5b314280 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6ed800 con 0x55ec5b334f60 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f75183fa740 10 client.0 _ll_register_callbacks cb 0x55ec5b63c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6eab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43856/0 (socket says 172.21.15.17:43856) 2024-09-21T06:13:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.393+0000 7f750b7fe640 1 -- 172.21.15.17:0/3490321799 learned_addr learned my addr 172.21.15.17:0/3490321799 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750affd640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750bfff640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b334f60 0x55ec5b6f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750b7fe640 1 -- 172.21.15.17:0/3490321799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b334f60 msgr2=0x55ec5b6f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750b7fe640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b334f60 0x55ec5b6f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750b7fe640 1 -- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 msgr2=0x55ec5b6eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750b7fe640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750b7fe640 1 -- 172.21.15.17:0/3490321799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5b60aa00 con 0x55ec5b30c0a0 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750bfff640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b334f60 0x55ec5b6f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750affd640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f750b7fe640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6eab40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00bad0 tx=0x7f74fc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbaf62ba203b192f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f74eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:13:00.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f74eaffd640 1 -- 172.21.15.17:0/3490321799 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011440 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f74eaffd640 1 -- 172.21.15.17:0/3490321799 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f74fc0115e0 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7500117020 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f74eaffd640 1 -- 172.21.15.17:0/3490321799 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74fc0117e0 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f75183fa740 10 client.15489 fetch_fsmap learned FSMap version 26 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.394+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ec5b6f9680 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f74eaffd640 1 -- 172.21.15.17:0/3490321799 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7500117020 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f74eaffd640 1 -- 172.21.15.17:0/3490321799 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f74fc01b9d0 con 0x55ec5b30c0a0 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f75183fa740 10 client.15489 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f75183fa740 10 client.15489 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f75183fa740 20 client.15489 populate_metadata read hostname 'smithi017' 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f75183fa740 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b2f38e0 0x55ec5b6fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f75183fa740 4 client.15489 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:13:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec5b654b60 con 0x55ec5b2f38e0 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.395+0000 7f750affd640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b2f38e0 0x55ec5b6fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.396+0000 7f74eaffd640 10 client.15489 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.396+0000 7f750affd640 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b2f38e0 0x55ec5b6fd1d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363d5bec13c71127 server_cookie=c5464d76fff9a43e in_seq=0 out_seq=0 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.396+0000 7f74eaffd640 1 -- 172.21.15.17:0/3490321799 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec5b654b60 con 0x55ec5b2f38e0 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.396+0000 7f74eaffd640 10 client.15489 handle_command_reply: tid=0 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.396+0000 7f75183fa740 1 client.15489 shutdown 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 msgr2=0x55ec5b6eab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6eab40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00bad0 tx=0x7f74fc00bf90 comp rx=0 tx=0).stop 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 shutdown_connections 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b2f38e0 0x55ec5b6fd1d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b334f60 0x55ec5b6f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 --2- 172.21.15.17:0/3490321799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6eab40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f74eaffd640 0 client.15489 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 >> 172.21.15.17:0/3490321799 conn(0x55ec5b329350 msgr2=0x55ec5b6dc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 shutdown_connections 2024-09-21T06:13:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 1 -- 172.21.15.17:0/3490321799 wait complete. 2024-09-21T06:13:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.397+0000 7f75183fa740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T06:13:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 Processor -- start 2024-09-21T06:13:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 -- start start 2024-09-21T06:13:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b6e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6fb510 con 0x55ec5b30c0a0 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6fbbe0 con 0x55ec5b314280 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f75183fa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6fc2b0 con 0x55ec5b329350 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f750affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f750affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6e5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43864/0 (socket says 172.21.15.17:43864) 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f750affd640 1 -- 172.21.15.17:0/2447048457 learned_addr learned my addr 172.21.15.17:0/2447048457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f750bfff640 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.416+0000 7f750b7fe640 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b6e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750affd640 1 -- 172.21.15.17:0/2447048457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 msgr2=0x55ec5b6e0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750affd640 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b6e0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750affd640 1 -- 172.21.15.17:0/2447048457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 msgr2=0x55ec5b6e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750affd640 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750affd640 1 -- 172.21.15.17:0/2447048457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5b6e9040 con 0x55ec5b30c0a0 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750bfff640 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f750affd640 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6e5c80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f75000f2850 tx=0x7f7500009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa5f6d5d34aa70a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f74f17fa640 1 -- 172.21.15.17:0/2447048457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75000f2690 con 0x55ec5b30c0a0 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f74f17fa640 1 -- 172.21.15.17:0/2447048457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75000f3ba0 con 0x55ec5b30c0a0 2024-09-21T06:13:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.417+0000 7f74f17fa640 1 -- 172.21.15.17:0/2447048457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75000f2880 con 0x55ec5b30c0a0 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 -- 172.21.15.17:0/2447048457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 msgr2=0x55ec5b6e5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6e5c80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f75000f2850 tx=0x7f7500009260 comp rx=0 tx=0).stop 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 -- 172.21.15.17:0/2447048457 shutdown_connections 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6e5c80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b6e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 --2- 172.21.15.17:0/2447048457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b6e0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 -- 172.21.15.17:0/2447048457 >> 172.21.15.17:0/2447048457 conn(0x55ec5b6e0d00 msgr2=0x55ec5b6d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 -- 172.21.15.17:0/2447048457 shutdown_connections 2024-09-21T06:13:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 -- 172.21.15.17:0/2447048457 wait complete. 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.418+0000 7f75183fa740 1 -- start start 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 Processor -- start 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b7000f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b704a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6fd050 con 0x55ec5b30c0a0 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6fc980 con 0x55ec5b314280 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55ec5b6fd720 con 0x55ec5b329350 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f75183fa740 10 client.0 _ll_register_callbacks cb 0x7f74fc004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43872/0 (socket says 172.21.15.17:43872) 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f750b7fe640 1 -- 172.21.15.17:0/1527032783 learned_addr learned my addr 172.21.15.17:0/1527032783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f750affd640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b7000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.419+0000 7f750bfff640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b704a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750b7fe640 1 -- 172.21.15.17:0/1527032783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 msgr2=0x55ec5b704a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750b7fe640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b704a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750b7fe640 1 -- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 msgr2=0x55ec5b7000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750b7fe640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b7000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750b7fe640 1 -- 172.21.15.17:0/1527032783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5b704fc0 con 0x55ec5b30c0a0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750bfff640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b704a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750affd640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b7000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f750b7fe640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6ffbb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55ec5b6ed390 tx=0x7f74fc00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2f112abb66632e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f74eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f74eaffd640 1 -- 172.21.15.17:0/1527032783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc02d020 con 0x55ec5b30c0a0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f74eaffd640 1 -- 172.21.15.17:0/1527032783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f74fc011c90 con 0x55ec5b30c0a0 2024-09-21T06:13:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ec5b650610 con 0x55ec5b30c0a0 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f74eaffd640 1 -- 172.21.15.17:0/1527032783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74fc038050 con 0x55ec5b30c0a0 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f75183fa740 10 client.15495 fetch_fsmap learned FSMap version 26 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.420+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ec5b706240 con 0x55ec5b30c0a0 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f74eaffd640 1 -- 172.21.15.17:0/1527032783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ec5b650610 con 0x55ec5b30c0a0 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f74eaffd640 1 -- 172.21.15.17:0/1527032783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f74fc01b790 con 0x55ec5b30c0a0 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f75183fa740 10 client.15495 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f75183fa740 10 client.15495 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f75183fa740 20 client.15495 populate_metadata read hostname 'smithi017' 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f75183fa740 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b334f60 0x55ec5b76be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f75183fa740 4 client.15495 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "status"}) -- 0x55ec5b64da40 con 0x55ec5b334f60 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f750affd640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b334f60 0x55ec5b76be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f74eaffd640 10 client.15495 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.421+0000 7f750affd640 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b334f60 0x55ec5b76be50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddaaf2048d45f850 server_cookie=2d5acd2093379eb7 in_seq=0 out_seq=0 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f74eaffd640 1 -- 172.21.15.17:0/1527032783 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ec5b64da40 con 0x55ec5b334f60 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f74eaffd640 10 client.15495 handle_command_reply: tid=0 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 client.15495 shutdown 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 msgr2=0x55ec5b6ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6ffbb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55ec5b6ed390 tx=0x7f74fc00b540 comp rx=0 tx=0).stop 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 shutdown_connections 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55ec5b334f60 0x55ec5b76be50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ec5b329350 0x55ec5b704a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ec5b314280 0x55ec5b7000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 --2- 172.21.15.17:0/1527032783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ec5b30c0a0 0x55ec5b6ffbb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 >> 172.21.15.17:0/1527032783 conn(0x55ec5b6e0d00 msgr2=0x55ec5b6e5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f74eaffd640 0 client.15495 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 shutdown_connections 2024-09-21T06:13:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 1 -- 172.21.15.17:0/1527032783 wait complete. 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.422+0000 7f75183fa740 20 client.15495 trim_cache size 0 max 16384 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "dc6785ee-77de-11ef-baf5-efdc52797490", 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24656, 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-21T06:13:00.430 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-21T06:13:00.431 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 162.87737160500001, 2024-09-21T06:13:00.431 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 26, 2024-09-21T06:13:00.431 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 84, 2024-09-21T06:13:00.431 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T06:13:00.431 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 173.64346397200001 2024-09-21T06:13:00.431 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f74f40b6590 msgr2=0x7f74f40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f74f40b6590 0x7f74f40b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7504009fd0 tx=0x7f7504009500 comp rx=0 tx=0).stop 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 msgr2=0x7f750c19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c19a960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7500004770 tx=0x7f7500004040 comp rx=0 tx=0).stop 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 shutdown_connections 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f74f40b6590 0x7f74f40b8aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f750c105380 0x7f750c19a960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c10de60 0x7f750c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 --2- 172.21.15.17:0/3342879439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f750c104a30 0x7f750c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 >> 172.21.15.17:0/3342879439 conn(0x7f750c079760 msgr2=0x7f750c1009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 shutdown_connections 2024-09-21T06:13:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:00.423+0000 7f7511e86640 1 -- 172.21.15.17:0/3342879439 wait complete. 2024-09-21T06:13:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:00 smithi089 ceph-mon[33879]: pgmap v381: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:13:01.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:00 smithi017 ceph-mon[31080]: pgmap v381: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:13:01.154 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T06:13:01.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:00 smithi081 ceph-mon[33870]: pgmap v381: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:13:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:02 smithi089 ceph-mon[33879]: pgmap v382: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:13:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:02 smithi017 ceph-mon[31080]: pgmap v382: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:13:03.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:02 smithi081 ceph-mon[33870]: pgmap v382: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:13:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:04 smithi089 ceph-mon[33879]: pgmap v383: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:13:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:04 smithi017 ceph-mon[31080]: pgmap v383: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:13:05.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:04 smithi081 ceph-mon[33870]: pgmap v383: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:13:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:06 smithi089 ceph-mon[33879]: pgmap v384: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:13:07.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:06 smithi017 ceph-mon[31080]: pgmap v384: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:13:07.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:06 smithi081 ceph-mon[33870]: pgmap v384: 129 pgs: 129 active+clean; 656 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:13:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:08 smithi089 ceph-mon[33879]: pgmap v385: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T06:13:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:08 smithi017 ceph-mon[31080]: pgmap v385: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T06:13:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:08 smithi081 ceph-mon[33870]: pgmap v385: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T06:13:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:10 smithi089 ceph-mon[33879]: pgmap v386: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T06:13:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:10 smithi017 ceph-mon[31080]: pgmap v386: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T06:13:11.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:10 smithi081 ceph-mon[33870]: pgmap v386: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T06:13:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:12 smithi089 ceph-mon[33879]: pgmap v387: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:13:13.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:12 smithi017 ceph-mon[31080]: pgmap v387: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:13:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:12 smithi081 ceph-mon[33870]: pgmap v387: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:13:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:14 smithi089 ceph-mon[33879]: pgmap v388: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T06:13:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:14 smithi017 ceph-mon[31080]: pgmap v388: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T06:13:15.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:14 smithi081 ceph-mon[33870]: pgmap v388: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T06:13:16.155 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T06:13:16.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:13:16.422 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.916+0000 7f24947dc640 1 -- 172.21.15.17:0/4183324878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c108cf0 msgr2=0x7f248c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:16.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.916+0000 7f24947dc640 1 --2- 172.21.15.17:0/4183324878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c108cf0 0x7f248c10f520 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2484009ca0 tx=0x7f248402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 -- 172.21.15.17:0/4183324878 shutdown_connections 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 --2- 172.21.15.17:0/4183324878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c108cf0 0x7f248c10f520 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 --2- 172.21.15.17:0/4183324878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c1083a0 0x7f248c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 --2- 172.21.15.17:0/4183324878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c102a60 0x7f248c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 -- 172.21.15.17:0/4183324878 >> 172.21.15.17:0/4183324878 conn(0x7f248c079730 msgr2=0x7f248c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 -- 172.21.15.17:0/4183324878 shutdown_connections 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.917+0000 7f24947dc640 1 -- 172.21.15.17:0/4183324878 wait complete. 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 Processor -- start 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 -- start start 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 0x7f248c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:16.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c1083a0 0x7f248c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c108cf0 0x7f248c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f248c113960 con 0x7f248c102a60 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1137e0 con 0x7f248c108cf0 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f24947dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f248c113ae0 con 0x7f248c1083a0 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f2492578640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 0x7f248c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f2492578640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 0x7f248c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38280/0 (socket says 172.21.15.17:38280) 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f2492578640 1 -- 172.21.15.17:0/4195341740 learned_addr learned my addr 172.21.15.17:0/4195341740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.918+0000 7f2491d77640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c1083a0 0x7f248c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:16.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492578640 1 -- 172.21.15.17:0/4195341740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c1083a0 msgr2=0x7f248c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492d79640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c108cf0 0x7f248c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492578640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c1083a0 0x7f248c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492578640 1 -- 172.21.15.17:0/4195341740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c108cf0 msgr2=0x7f248c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492578640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c108cf0 0x7f248c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492578640 1 -- 172.21.15.17:0/4195341740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1a02a0 con 0x7f248c102a60 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492d79640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c108cf0 0x7f248c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f2492578640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 0x7f248c19a330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d950 tx=0x7f247c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c017070 con 0x7f248c102a60 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c009c30 con 0x7f248c102a60 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c1a0590 con 0x7f248c102a60 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c00f620 con 0x7f248c102a60 2024-09-21T06:13:16.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.919+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c1a6cf0 con 0x7f248c102a60 2024-09-21T06:13:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.920+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c102e70 con 0x7f248c102a60 2024-09-21T06:13:16.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.924+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f247c005030 con 0x7f248c102a60 2024-09-21T06:13:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.924+0000 7f248b7fe640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24740b6590 0x7f24740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.924+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f247c0e7290 con 0x7f248c102a60 2024-09-21T06:13:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.924+0000 7f2491d77640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24740b6590 0x7f24740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:16.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.925+0000 7f2491d77640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24740b6590 0x7f24740b8aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2480005fd0 tx=0x7f2480005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:16.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:16.927+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f247c0ad810 con 0x7f248c102a60 2024-09-21T06:13:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:16 smithi089 ceph-mon[33879]: pgmap v389: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T06:13:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:16 smithi017 ceph-mon[31080]: pgmap v389: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T06:13:17.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.170+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f248c02e640 con 0x7f248c102a60 2024-09-21T06:13:17.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.171+0000 7f248b7fe640 1 -- 172.21.15.17:0/4195341740 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11885 (secure 0 0 0) 0x7f247c009de0 con 0x7f248c102a60 2024-09-21T06:13:17.173 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:13:17.173 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-21T06:12:42:786101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:12:42.111135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:13:17.174 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-21T06:13:17.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24740b6590 msgr2=0x7f24740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:17.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24740b6590 0x7f24740b8aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2480005fd0 tx=0x7f2480005e20 comp rx=0 tx=0).stop 2024-09-21T06:13:17.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 msgr2=0x7f248c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:17.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 0x7f248c19a330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d950 tx=0x7f247c00de10 comp rx=0 tx=0).stop 2024-09-21T06:13:17.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 shutdown_connections 2024-09-21T06:13:17.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24740b6590 0x7f24740b8aa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:17.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f248c108cf0 0x7f248c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:17.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c1083a0 0x7f248c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:17.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 --2- 172.21.15.17:0/4195341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f248c102a60 0x7f248c19a330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:17.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 >> 172.21.15.17:0/4195341740 conn(0x7f248c079730 msgr2=0x7f248c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:17.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 shutdown_connections 2024-09-21T06:13:17.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:17.173+0000 7f24947dc640 1 -- 172.21.15.17:0/4195341740 wait complete. 2024-09-21T06:13:17.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:16 smithi081 ceph-mon[33870]: pgmap v389: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T06:13:18.006 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T06:13:18.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T06:13:18.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:17 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/4195341740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:13:18.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:17 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/4195341740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:13:18.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:17 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/4195341740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:13:18.279 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 -- 172.21.15.17:0/2089324488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8081083c0 msgr2=0x7fd8081087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 --2- 172.21.15.17:0/2089324488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8081083c0 0x7fd8081087d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009900 tx=0x7fd7f802a410 comp rx=0 tx=0).stop 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 -- 172.21.15.17:0/2089324488 shutdown_connections 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 --2- 172.21.15.17:0/2089324488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8081083c0 0x7fd8081087d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 --2- 172.21.15.17:0/2089324488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd808108d10 0x7fd80810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 --2- 172.21.15.17:0/2089324488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd808102a80 0x7fd808102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.830+0000 7fd80fb91640 1 -- 172.21.15.17:0/2089324488 >> 172.21.15.17:0/2089324488 conn(0x7fd808079870 msgr2=0x7fd808079c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.831+0000 7fd80fb91640 1 -- 172.21.15.17:0/2089324488 shutdown_connections 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.831+0000 7fd80fb91640 1 -- 172.21.15.17:0/2089324488 wait complete. 2024-09-21T06:13:18.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.831+0000 7fd80fb91640 1 Processor -- start 2024-09-21T06:13:18.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.831+0000 7fd80fb91640 1 -- start start 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80fb91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 0x7fd8081992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80fb91640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8081083c0 0x7fd808199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80fb91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd808108d10 0x7fd80819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80fb91640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081128d0 con 0x7fd808102a80 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80fb91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd808112750 con 0x7fd808108d10 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80fb91640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd808112a50 con 0x7fd8081083c0 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 0x7fd8081992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 0x7fd8081992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37450/0 (socket says 172.21.15.17:37450) 2024-09-21T06:13:18.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 -- 172.21.15.17:0/3513230813 learned_addr learned my addr 172.21.15.17:0/3513230813 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80e12e640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd808108d10 0x7fd80819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d12c640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8081083c0 0x7fd808199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 -- 172.21.15.17:0/3513230813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8081083c0 msgr2=0x7fd808199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8081083c0 0x7fd808199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 -- 172.21.15.17:0/3513230813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd808108d10 msgr2=0x7fd80819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd808108d10 0x7fd80819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.832+0000 7fd80d92d640 1 -- 172.21.15.17:0/3513230813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80819f250 con 0x7fd808102a80 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.833+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 0x7fd8081992e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd80400d950 tx=0x7fd80400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.833+0000 7fd7feffd640 1 -- 172.21.15.17:0/3513230813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804017030 con 0x7fd808102a80 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.833+0000 7fd7feffd640 1 -- 172.21.15.17:0/3513230813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd804004020 con 0x7fd808102a80 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.833+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80819f540 con 0x7fd808102a80 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.833+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8081a5ca0 con 0x7fd808102a80 2024-09-21T06:13:18.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.833+0000 7fd7feffd640 1 -- 172.21.15.17:0/3513230813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8040055d0 con 0x7fd808102a80 2024-09-21T06:13:18.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 Processor -- start 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 -- start start 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd7feffd640 1 -- 172.21.15.17:0/3513230813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd804009a30 con 0x7fd808102a80 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x562076570600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x562076570b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076571080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620764e6b90 con 0x5620761a0980 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5620764d5fc0 con 0x5620761a8b60 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd816105740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5620764d9dd0 con 0x5620761c9840 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.836+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x562076570b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x562076570b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37462/0 (socket says 172.21.15.17:37462) 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 -- 172.21.15.17:0/3636827678 learned_addr learned my addr 172.21.15.17:0/3636827678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80e12e640 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x562076570600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d12c640 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076571080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 -- 172.21.15.17:0/3636827678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 msgr2=0x562076570600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x562076570600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 -- 172.21.15.17:0/3636827678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 msgr2=0x562076571080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076571080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 -- 172.21.15.17:0/3636827678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56207645d060 con 0x5620761a0980 2024-09-21T06:13:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.837+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x562076570b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd8040ef210 tx=0x7fd8040ef6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1ef651b7003fd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.838+0000 7fd7feffd640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7f40b6510 0x7fd7f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.838+0000 7fd7f3fff640 1 -- 172.21.15.17:0/3636827678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8040fa070 con 0x5620761a0980 2024-09-21T06:13:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.838+0000 7fd7f3fff640 1 -- 172.21.15.17:0/3636827678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8040acac0 con 0x5620761a0980 2024-09-21T06:13:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.838+0000 7fd7f3fff640 1 -- 172.21.15.17:0/3636827678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8040acd80 con 0x5620761a0980 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.838+0000 7fd80e12e640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7f40b6510 0x7fd7f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.838+0000 7fd7feffd640 1 -- 172.21.15.17:0/3513230813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd8040e71b0 con 0x7fd808102a80 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 -- 172.21.15.17:0/3636827678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 msgr2=0x562076570b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x562076570b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd8040ef210 tx=0x7fd8040ef6d0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd80e12e640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7f40b6510 0x7fd7f40b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd800005fd0 tx=0x7fd8000096e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 -- 172.21.15.17:0/3636827678 shutdown_connections 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x562076570b40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076571080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 --2- 172.21.15.17:0/3636827678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x562076570600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 -- 172.21.15.17:0/3636827678 >> 172.21.15.17:0/3636827678 conn(0x5620761bd990 msgr2=0x56207656e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 -- 172.21.15.17:0/3636827678 shutdown_connections 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.839+0000 7fd816105740 1 -- 172.21.15.17:0/3636827678 wait complete. 2024-09-21T06:13:18.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 -- start start 2024-09-21T06:13:18.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 Processor -- start 2024-09-21T06:13:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x56207657e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x56207657e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x56207658a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620763377a0 con 0x5620761a0980 2024-09-21T06:13:18.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56207647b0a0 con 0x5620761a8b60 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562076580f40 con 0x5620761c9840 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd816105740 10 client.0 _ll_register_callbacks cb 0x5620764583c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x56207657e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x56207657e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37468/0 (socket says 172.21.15.17:37468) 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.840+0000 7fd80d92d640 1 -- 172.21.15.17:0/817296349 learned_addr learned my addr 172.21.15.17:0/817296349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d12c640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x56207657e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80e12e640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x56207658a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d92d640 1 -- 172.21.15.17:0/817296349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 msgr2=0x56207658a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d92d640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x56207658a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d92d640 1 -- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 msgr2=0x56207657e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d92d640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x56207657e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d92d640 1 -- 172.21.15.17:0/817296349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562076469880 con 0x5620761a0980 2024-09-21T06:13:18.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd80d92d640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x56207657e330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd8040aa220 tx=0x7fd804005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673b8ecb514ad9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd7f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd7f17fa640 1 -- 172.21.15.17:0/817296349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804081360 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd7f17fa640 1 -- 172.21.15.17:0/817296349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd804009d20 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8040acac0 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd7f17fa640 1 -- 172.21.15.17:0/817296349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd804081560 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.841+0000 7fd816105740 10 client.15513 fetch_fsmap learned FSMap version 26 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562076243b90 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd7f17fa640 1 -- 172.21.15.17:0/817296349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8040acac0 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd7f17fa640 1 -- 172.21.15.17:0/817296349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd8040a9220 con 0x5620761a0980 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 10 client.15513 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 10 client.15513 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 20 client.15513 populate_metadata read hostname 'smithi017' 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761881c0 0x562076590080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 4 client.15513 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:13:18.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620764e8ae0 con 0x5620761881c0 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.842+0000 7fd80d12c640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761881c0 0x562076590080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.843+0000 7fd7f17fa640 10 client.15513 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.843+0000 7fd80d12c640 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761881c0 0x562076590080 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53b71e4de7720904 server_cookie=8902124aa9f7c11d in_seq=0 out_seq=0 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd7f17fa640 1 -- 172.21.15.17:0/817296349 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620764e8ae0 con 0x5620761881c0 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd7f17fa640 10 client.15513 handle_command_reply: tid=0 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 client.15513 shutdown 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 msgr2=0x56207657e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x56207657e330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd8040aa220 tx=0x7fd804005770 comp rx=0 tx=0).stop 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 shutdown_connections 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761881c0 0x562076590080 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761c9840 0x56207658a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x56207657e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd7f17fa640 0 client.15513 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:18.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 --2- 172.21.15.17:0/817296349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761a0980 0x56207657e330 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.844+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 >> 172.21.15.17:0/817296349 conn(0x5620761bd990 msgr2=0x562076571ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.845+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 shutdown_connections 2024-09-21T06:13:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.845+0000 7fd816105740 1 -- 172.21.15.17:0/817296349 wait complete. 2024-09-21T06:13:18.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.845+0000 7fd816105740 20 client.15513 trim_cache size 0 max 16384 2024-09-21T06:13:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.862+0000 7fd816105740 1 Processor -- start 2024-09-21T06:13:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.862+0000 7fd816105740 1 -- start start 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd816105740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x56207657e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd816105740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a0980 0x56207656de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd816105740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a8b60 0x56207656e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd816105740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081b1200 con 0x5620761881c0 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd816105740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081aead0 con 0x5620761a0980 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd816105740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081ac920 con 0x5620761a8b60 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x56207657e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x56207657e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37482/0 (socket says 172.21.15.17:37482) 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 -- 172.21.15.17:0/2822913273 learned_addr learned my addr 172.21.15.17:0/2822913273 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80e12e640 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a8b60 0x56207656e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d12c640 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a0980 0x56207656de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 -- 172.21.15.17:0/2822913273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a8b60 msgr2=0x56207656e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a8b60 0x56207656e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 -- 172.21.15.17:0/2822913273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a0980 msgr2=0x56207656de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a0980 0x56207656de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.863+0000 7fd80d92d640 1 -- 172.21.15.17:0/2822913273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562076573440 con 0x5620761881c0 2024-09-21T06:13:18.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.864+0000 7fd80d92d640 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x56207657e540 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd8040accb0 tx=0x7fd804009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878e1e01e872092b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:18.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.865+0000 7fd7f37fe640 1 -- 172.21.15.17:0/2822913273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804082150 con 0x5620761881c0 2024-09-21T06:13:18.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.865+0000 7fd7f37fe640 1 -- 172.21.15.17:0/2822913273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8040efbd0 con 0x5620761881c0 2024-09-21T06:13:18.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.865+0000 7fd7f37fe640 1 -- 172.21.15.17:0/2822913273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804082320 con 0x5620761881c0 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 -- 172.21.15.17:0/2822913273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 msgr2=0x56207657e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x56207657e540 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd8040accb0 tx=0x7fd804009740 comp rx=0 tx=0).stop 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 -- 172.21.15.17:0/2822913273 shutdown_connections 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a8b60 0x56207656e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a0980 0x56207656de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 --2- 172.21.15.17:0/2822913273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x56207657e540 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 -- 172.21.15.17:0/2822913273 >> 172.21.15.17:0/2822913273 conn(0x5620761bd990 msgr2=0x56207657c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 -- 172.21.15.17:0/2822913273 shutdown_connections 2024-09-21T06:13:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.866+0000 7fd816105740 1 -- 172.21.15.17:0/2822913273 wait complete. 2024-09-21T06:13:18.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 -- start start 2024-09-21T06:13:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 Processor -- start 2024-09-21T06:13:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x562076593760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a0980 0x56207658fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076590160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081acf90 con 0x5620761881c0 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081ae400 con 0x5620761a8b60 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd8081ad660 con 0x5620761a0980 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.867+0000 7fd816105740 10 client.0 _ll_register_callbacks cb 0x7fd8040f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x562076593760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x562076593760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37488/0 (socket says 172.21.15.17:37488) 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 -- 172.21.15.17:0/3425937103 learned_addr learned my addr 172.21.15.17:0/3425937103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d12c640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a0980 0x56207658fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80e12e640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076590160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 -- 172.21.15.17:0/3425937103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a0980 msgr2=0x56207658fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a0980 0x56207658fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 -- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 msgr2=0x562076590160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076590160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 -- 172.21.15.17:0/3425937103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620765907d0 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd80d92d640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x562076593760 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd804005c60 tx=0x7fd80407e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8677c32027aeaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd7f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd7f17fa640 1 -- 172.21.15.17:0/3425937103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804082a60 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8040efbd0 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.868+0000 7fd7f17fa640 1 -- 172.21.15.17:0/3425937103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd804009d20 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd7f17fa640 1 -- 172.21.15.17:0/3425937103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd8040ac720 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 10 client.15519 fetch_fsmap learned FSMap version 26 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5620765907d0 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd7f17fa640 1 -- 172.21.15.17:0/3425937103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8040efbd0 con 0x5620761881c0 2024-09-21T06:13:18.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd7f17fa640 1 -- 172.21.15.17:0/3425937103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd8040a9220 con 0x5620761881c0 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 10 client.15519 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 10 client.15519 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 20 client.15519 populate_metadata read hostname 'smithi017' 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761c9840 0x5620765fd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 4 client.15519 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x5620764e4590 con 0x5620761c9840 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.869+0000 7fd80d12c640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761c9840 0x5620765fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.870+0000 7fd80d12c640 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761c9840 0x5620765fd970 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e6b80172dd5bb4 server_cookie=c45613cc4d0676d9 in_seq=0 out_seq=0 2024-09-21T06:13:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.870+0000 7fd7f17fa640 10 client.15519 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.878+0000 7fd7f17fa640 1 -- 172.21.15.17:0/3425937103 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5620764e4590 con 0x5620761c9840 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.878+0000 7fd7f17fa640 10 client.15519 handle_command_reply: tid=0 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.878+0000 7fd816105740 1 client.15519 shutdown 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 msgr2=0x562076593760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x562076593760 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd804005c60 tx=0x7fd80407e130 comp rx=0 tx=0).stop 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 shutdown_connections 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620761c9840 0x5620765fd970 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620761a8b60 0x562076590160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620761a0980 0x56207658fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd7f17fa640 0 client.15519 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 --2- 172.21.15.17:0/3425937103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620761881c0 0x562076593760 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 >> 172.21.15.17:0/3425937103 conn(0x5620761bd990 msgr2=0x56207656ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 shutdown_connections 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 1 -- 172.21.15.17:0/3425937103 wait complete. 2024-09-21T06:13:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.879+0000 7fd816105740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 26, 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 2, 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "99619cac": { 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 2, 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:13:18.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 134.5, 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:18.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7f40b6510 msgr2=0x7fd7f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7f40b6510 0x7fd7f40b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd800005fd0 tx=0x7fd8000096e0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 msgr2=0x7fd8081992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 0x7fd8081992e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd80400d950 tx=0x7fd80400de10 comp rx=0 tx=0).stop 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 shutdown_connections 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd7f40b6510 0x7fd7f40b8a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd808108d10 0x7fd80819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8081083c0 0x7fd808199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 --2- 172.21.15.17:0/3513230813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd808102a80 0x7fd8081992e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 >> 172.21.15.17:0/3513230813 conn(0x7fd808079870 msgr2=0x7fd8081064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 shutdown_connections 2024-09-21T06:13:18.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:18.880+0000 7fd80fb91640 1 -- 172.21.15.17:0/3513230813 wait complete. 2024-09-21T06:13:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:18 smithi089 ceph-mon[33879]: pgmap v390: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T06:13:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:18 smithi017 ceph-mon[31080]: pgmap v390: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T06:13:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:18 smithi081 ceph-mon[33870]: pgmap v390: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T06:13:19.737 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '99619cac', quiesce took 3.6 seconds. Will release after: 10.9 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:19 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:19 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:20.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:20.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:19 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:21.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:21.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:21.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:13:22.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:21 smithi017 ceph-mon[31080]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:13:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:21 smithi081 ceph-mon[33870]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:13:22.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:21 smithi089 ceph-mon[33879]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:13:24.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:24 smithi081 ceph-mon[33870]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:24 smithi089 ceph-mon[33879]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:24 smithi017 ceph-mon[31080]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:26.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:26 smithi081 ceph-mon[33870]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:26.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:26 smithi089 ceph-mon[33879]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:26.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:26 smithi017 ceph-mon[31080]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:28.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:28 smithi081 ceph-mon[33870]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:13:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:28 smithi089 ceph-mon[33879]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:13:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:28 smithi017 ceph-mon[31080]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:13:30.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:30 smithi081 ceph-mon[33870]: pgmap v396: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:30 smithi089 ceph-mon[33879]: pgmap v396: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:30.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:30 smithi017 ceph-mon[31080]: pgmap v396: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:13:30.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:13:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 -- 172.21.15.17:0/816857261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e4105300 msgr2=0x7fd1e410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 --2- 172.21.15.17:0/816857261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e4105300 0x7fd1e410d850 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009900 tx=0x7fd1d802a410 comp rx=0 tx=0).stop 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 -- 172.21.15.17:0/816857261 shutdown_connections 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 --2- 172.21.15.17:0/816857261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e4105300 0x7fd1e410d850 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 --2- 172.21.15.17:0/816857261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e410de10 0x7fd1e4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 --2- 172.21.15.17:0/816857261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e41049b0 0x7fd1e4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 -- 172.21.15.17:0/816857261 >> 172.21.15.17:0/816857261 conn(0x7fd1e4079730 msgr2=0x7fd1e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 -- 172.21.15.17:0/816857261 shutdown_connections 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.467+0000 7fd1e9907640 1 -- 172.21.15.17:0/816857261 wait complete. 2024-09-21T06:13:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 Processor -- start 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 -- start start 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 0x7fd1e419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e4105300 0x7fd1e419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e410de10 0x7fd1e419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e4113920 con 0x7fd1e41049b0 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e41137a0 con 0x7fd1e410de10 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.468+0000 7fd1e9907640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e4113aa0 con 0x7fd1e4105300 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 0x7fd1e419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 0x7fd1e419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42592/0 (socket says 172.21.15.17:42592) 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 -- 172.21.15.17:0/2950742845 learned_addr learned my addr 172.21.15.17:0/2950742845 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e37fe640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e410de10 0x7fd1e419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e27fc640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e4105300 0x7fd1e419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 -- 172.21.15.17:0/2950742845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e4105300 msgr2=0x7fd1e419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e4105300 0x7fd1e419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 -- 172.21.15.17:0/2950742845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e410de10 msgr2=0x7fd1e419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e410de10 0x7fd1e419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 -- 172.21.15.17:0/2950742845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e41a03e0 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.469+0000 7fd1e2ffd640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 0x7fd1e419a470 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400e9c0 tx=0x7fd1d400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.470+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400cd80 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.470+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e41a06d0 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.470+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e41a6e30 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.470+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1d40035f0 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.470+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40044c0 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.472+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e4104dc0 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.474+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd1d4010750 con 0x7fd1e41049b0 2024-09-21T06:13:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.475+0000 7fd1e8905640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd1cc0ba9a0 0x7fd1cc0bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.475+0000 7fd1e27fc640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd1cc0ba9a0 0x7fd1cc0bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.475+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd1d40e79d0 con 0x7fd1e41049b0 2024-09-21T06:13:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.476+0000 7fd1e27fc640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd1cc0ba9a0 0x7fd1cc0bceb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8005940 tx=0x7fd1d80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:31.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.484+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1d40ade70 con 0x7fd1e41049b0 2024-09-21T06:13:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.721+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1e4108f10 con 0x7fd1e41049b0 2024-09-21T06:13:31.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.722+0000 7fd1e8905640 1 -- 172.21.15.17:0/2950742845 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11885 (secure 0 0 0) 0x7fd1d40b2250 con 0x7fd1e41049b0 2024-09-21T06:13:31.724 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:13:31.724 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-21T06:12:42:786101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:12:42.111135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:13:31.725 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-21T06:13:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd1cc0ba9a0 msgr2=0x7fd1cc0bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd1cc0ba9a0 0x7fd1cc0bceb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8005940 tx=0x7fd1d80058d0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 msgr2=0x7fd1e419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 0x7fd1e419a470 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400e9c0 tx=0x7fd1d400ee80 comp rx=0 tx=0).stop 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 shutdown_connections 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd1cc0ba9a0 0x7fd1cc0bceb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e410de10 0x7fd1e419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1e4105300 0x7fd1e419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 --2- 172.21.15.17:0/2950742845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e41049b0 0x7fd1e419a470 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 >> 172.21.15.17:0/2950742845 conn(0x7fd1e4079730 msgr2=0x7fd1e40ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 shutdown_connections 2024-09-21T06:13:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:31.726+0000 7fd1e9907640 1 -- 172.21.15.17:0/2950742845 wait complete. 2024-09-21T06:13:32.303 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:32 smithi017 ceph-mon[31080]: pgmap v397: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:13:32.303 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:32 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2950742845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:13:32.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:32 smithi081 ceph-mon[33870]: pgmap v397: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:13:32.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:32 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2950742845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:13:32.583 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id 99619cac --release --await' 2024-09-21T06:13:32.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id 99619cac --release --await 2024-09-21T06:13:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:32 smithi089 ceph-mon[33879]: pgmap v397: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:13:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:32 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2950742845' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:13:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:33.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 -- 172.21.15.17:0/4278121898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4101f70 msgr2=0x7f34a4102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 --2- 172.21.15.17:0/4278121898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4101f70 0x7f34a4102380 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3494009900 tx=0x7f349402a410 comp rx=0 tx=0).stop 2024-09-21T06:13:33.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 -- 172.21.15.17:0/4278121898 shutdown_connections 2024-09-21T06:13:33.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 --2- 172.21.15.17:0/4278121898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4109e00 0x7f34a4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 --2- 172.21.15.17:0/4278121898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a41094b0 0x7f34a41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 --2- 172.21.15.17:0/4278121898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a4101f70 0x7f34a4102380 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 -- 172.21.15.17:0/4278121898 >> 172.21.15.17:0/4278121898 conn(0x7f34a4077c60 msgr2=0x7f34a40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 -- 172.21.15.17:0/4278121898 shutdown_connections 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.443+0000 7f34aa461640 1 -- 172.21.15.17:0/4278121898 wait complete. 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 Processor -- start 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 -- start start 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 0x7f34a419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a41094b0 0x7f34a419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a4109e00 0x7f34a419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4113970 con 0x7f34a41094b0 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41137f0 con 0x7f34a4101f70 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.444+0000 7f34aa461640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4113af0 con 0x7f34a4109e00 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 0x7f34a419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 0x7f34a419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:34336/0 (socket says 172.21.15.17:34336) 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 -- 172.21.15.17:0/3948534862 learned_addr learned my addr 172.21.15.17:0/3948534862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:33.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a37fe640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a41094b0 0x7f34a419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a89fe640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a4109e00 0x7f34a419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 -- 172.21.15.17:0/3948534862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a4109e00 msgr2=0x7f34a419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a4109e00 0x7f34a419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 -- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a41094b0 msgr2=0x7f34a419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a41094b0 0x7f34a419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.445+0000 7f34a3fff640 1 -- 172.21.15.17:0/3948534862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a41a0310 con 0x7f34a4101f70 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.446+0000 7f34a3fff640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 0x7f34a419a3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3494009230 tx=0x7f3494004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.446+0000 7f34a17fa640 1 -- 172.21.15.17:0/3948534862 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349403f030 con 0x7f34a4101f70 2024-09-21T06:13:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.446+0000 7f34a17fa640 1 -- 172.21.15.17:0/3948534862 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3494003a80 con 0x7f34a4101f70 2024-09-21T06:13:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.446+0000 7f34a17fa640 1 -- 172.21.15.17:0/3948534862 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494035070 con 0x7f34a4101f70 2024-09-21T06:13:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.447+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a41a05a0 con 0x7f34a4101f70 2024-09-21T06:13:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.447+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a41a0a00 con 0x7f34a4101f70 2024-09-21T06:13:33.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 Processor -- start 2024-09-21T06:13:33.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 -- start start 2024-09-21T06:13:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 0x55a09bfb9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbed660 0x55a09bfba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfcc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a09bea7dc0 con 0x55a09bbf5840 2024-09-21T06:13:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a09bf341f0 con 0x55a09bc16520 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.450+0000 7f34b09d5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a09bf23620 con 0x55a09bbed660 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 0x55a09bfb9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 0x55a09bfb9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:34350/0 (socket says 172.21.15.17:34350) 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 -- 172.21.15.17:0/2812785057 learned_addr learned my addr 172.21.15.17:0/2812785057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a37fe640 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfcc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 -- 172.21.15.17:0/2812785057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbed660 msgr2=0x55a09bfba4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbed660 0x55a09bfba4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 -- 172.21.15.17:0/2812785057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 msgr2=0x55a09bfcc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfcc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 -- 172.21.15.17:0/2812785057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09beebfd0 con 0x55a09bc16520 2024-09-21T06:13:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a17fa640 1 -- 172.21.15.17:0/3948534862 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3494042030 con 0x7f34a4101f70 2024-09-21T06:13:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.451+0000 7f34a89fe640 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 0x55a09bfb9f70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f349c009fd0 tx=0x7f349c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979d0e34b1ada162 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.452+0000 7f348a7fc640 1 -- 172.21.15.17:0/2812785057 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c004d20 con 0x55a09bc16520 2024-09-21T06:13:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.452+0000 7f348a7fc640 1 -- 172.21.15.17:0/2812785057 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349c004050 con 0x55a09bc16520 2024-09-21T06:13:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.452+0000 7f348a7fc640 1 -- 172.21.15.17:0/2812785057 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c005260 con 0x55a09bc16520 2024-09-21T06:13:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34a17fa640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f348c0b6590 0x7f348c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34a17fa640 1 -- 172.21.15.17:0/3948534862 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f3494107ff0 con 0x7f34a4101f70 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34a3fff640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f348c0b6590 0x7f348c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 -- 172.21.15.17:0/2812785057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 msgr2=0x55a09bfb9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 0x55a09bfb9f70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f349c009fd0 tx=0x7f349c0118d0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 -- 172.21.15.17:0/2812785057 shutdown_connections 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfcc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbed660 0x55a09bfba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 --2- 172.21.15.17:0/2812785057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bc16520 0x55a09bfb9f70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34b09d5740 1 -- 172.21.15.17:0/2812785057 >> 172.21.15.17:0/2812785057 conn(0x55a09bc0a910 msgr2=0x55a09bfbc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.453+0000 7f34a3fff640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f348c0b6590 0x7f348c0b8aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f34940cdd20 tx=0x7f349403b460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.454+0000 7f34b09d5740 1 -- 172.21.15.17:0/2812785057 shutdown_connections 2024-09-21T06:13:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.454+0000 7f34b09d5740 1 -- 172.21.15.17:0/2812785057 wait complete. 2024-09-21T06:13:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.454+0000 7f34b09d5740 1 -- start start 2024-09-21T06:13:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.455+0000 7f34b09d5740 1 Processor -- start 2024-09-21T06:13:33.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.455+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfd0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.455+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfd1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfd1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfd1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42622/0 (socket says 172.21.15.17:42622) 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34a37fe640 1 -- 172.21.15.17:0/4231879914 learned_addr learned my addr 172.21.15.17:0/4231879914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bc16520 0x55a09bfd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfd0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a09bebe300 con 0x55a09bbf5840 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a09bf27430 con 0x55a09bbed660 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.456+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55a09bd84bb0 con 0x55a09bc16520 2024-09-21T06:13:33.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a37fe640 1 -- 172.21.15.17:0/4231879914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bc16520 msgr2=0x55a09bfd6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a37fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bc16520 0x55a09bfd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a37fe640 1 -- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 msgr2=0x55a09bfd0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a37fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfd0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a37fe640 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09bead780 con 0x55a09bbf5840 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfd0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34b09d5740 10 client.0 _ll_register_callbacks cb 0x55a09bed8120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f349c004050 con 0x55a09bbf5840 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34a37fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfd1010 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f349800bc10 tx=0x7f34980039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ded885f339ec60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:33.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34837fe640 10 client.15537 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34837fe640 1 -- 172.21.15.17:0/4231879914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498011440 con 0x55a09bbf5840 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.457+0000 7f34837fe640 1 -- 172.21.15.17:0/4231879914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f34980115e0 con 0x55a09bbf5840 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34837fe640 1 -- 172.21.15.17:0/4231879914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3498011820 con 0x55a09bbf5840 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 10 client.15537 fetch_fsmap learned FSMap version 26 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a09bc81b00 con 0x55a09bbf5840 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34837fe640 1 -- 172.21.15.17:0/4231879914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f34980119c0 con 0x55a09bbf5840 2024-09-21T06:13:33.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 10 client.15537 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 10 client.15537 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 20 client.15537 populate_metadata read hostname 'smithi017' 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bbd4ea0 0x55a09bfc14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 4 client.15537 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.458+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a09bf36140 con 0x55a09bbd4ea0 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.459+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bbd4ea0 0x55a09bfc14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.459+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bbd4ea0 0x55a09bfc14b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5554b2bf01f4c656 server_cookie=61088334e79b7673 in_seq=0 out_seq=0 2024-09-21T06:13:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.459+0000 7f34837fe640 10 client.15537 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.460+0000 7f34837fe640 1 -- 172.21.15.17:0/4231879914 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a09bf36140 con 0x55a09bbd4ea0 2024-09-21T06:13:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.460+0000 7f34837fe640 10 client.15537 handle_command_reply: tid=0 2024-09-21T06:13:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.460+0000 7f34b09d5740 1 client.15537 shutdown 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.460+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 msgr2=0x55a09bfd1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.460+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfd1010 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f349800bc10 tx=0x7f34980039c0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 shutdown_connections 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bbd4ea0 0x55a09bfc14b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09bfd1010 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34837fe640 0 client.15537 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bc16520 0x55a09bfd6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4231879914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfd0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 >> 172.21.15.17:0/4231879914 conn(0x55a09bc0a910 msgr2=0x55a09bfbb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 shutdown_connections 2024-09-21T06:13:33.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 1 -- 172.21.15.17:0/4231879914 wait complete. 2024-09-21T06:13:33.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.461+0000 7f34b09d5740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 Processor -- start 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 -- start start 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 0x55a09bfbc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfcf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbf5840 0x55a09bff5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41b1080 con 0x55a09bbd4ea0 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ae950 con 0x55a09bbed660 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34b09d5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ac7a0 con 0x55a09bbf5840 2024-09-21T06:13:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34a89fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 0x55a09bfbc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34a89fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 0x55a09bfbc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42634/0 (socket says 172.21.15.17:42634) 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.493+0000 7f34a89fe640 1 -- 172.21.15.17:0/4002516383 learned_addr learned my addr 172.21.15.17:0/4002516383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a37fe640 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfcf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbf5840 0x55a09bff5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 -- 172.21.15.17:0/4002516383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbf5840 msgr2=0x55a09bff5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbf5840 0x55a09bff5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 -- 172.21.15.17:0/4002516383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 msgr2=0x55a09bfcf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfcf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 -- 172.21.15.17:0/4002516383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09bcf8960 con 0x55a09bbd4ea0 2024-09-21T06:13:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.494+0000 7f34a89fe640 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 0x55a09bfbc150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f349c009250 tx=0x7f349c004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f263de512bcc3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.495+0000 7f3489ffb640 1 -- 172.21.15.17:0/4002516383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c028020 con 0x55a09bbd4ea0 2024-09-21T06:13:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.495+0000 7f3489ffb640 1 -- 172.21.15.17:0/4002516383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349c02e040 con 0x55a09bbd4ea0 2024-09-21T06:13:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.495+0000 7f3489ffb640 1 -- 172.21.15.17:0/4002516383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c0057c0 con 0x55a09bbd4ea0 2024-09-21T06:13:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.495+0000 7f34b09d5740 1 -- 172.21.15.17:0/4002516383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 msgr2=0x55a09bfbc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.495+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 0x55a09bfbc150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f349c009250 tx=0x7f349c004950 comp rx=0 tx=0).stop 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 -- 172.21.15.17:0/4002516383 shutdown_connections 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbf5840 0x55a09bff5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfcf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 --2- 172.21.15.17:0/4002516383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbd4ea0 0x55a09bfbc150 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 -- 172.21.15.17:0/4002516383 >> 172.21.15.17:0/4002516383 conn(0x55a09bc0a910 msgr2=0x55a09bfcf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 -- 172.21.15.17:0/4002516383 shutdown_connections 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 -- 172.21.15.17:0/4002516383 wait complete. 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.496+0000 7f34b09d5740 1 -- start start 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 Processor -- start 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 0x55a09bfd9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfda260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09c04d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ace10 con 0x55a09bbf5840 2024-09-21T06:13:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ae280 con 0x55a09bbed660 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ad4e0 con 0x55a09bbd4ea0 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34b09d5740 10 client.0 _ll_register_callbacks cb 0x7f3498004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.497+0000 7f34a89fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 0x55a09bfd9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 0x55a09bfd9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54452/0 (socket says 172.21.15.17:54452) 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 -- 172.21.15.17:0/3985634026 learned_addr learned my addr 172.21.15.17:0/3985634026 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09c04d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a37fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfda260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 -- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 msgr2=0x55a09bfda260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfda260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 -- 172.21.15.17:0/3985634026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 msgr2=0x55a09c04d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09c04d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.498+0000 7f34a89fe640 1 -- 172.21.15.17:0/3985634026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09c04d9b0 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.499+0000 7f34a37fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfda260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.499+0000 7f34a89fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 0x55a09bfd9cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f349c01b040 tx=0x7f349c000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b85d657f15f5b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.499+0000 7f34837fe640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.499+0000 7f34837fe640 1 -- 172.21.15.17:0/3985634026 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c028070 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.499+0000 7f34837fe640 1 -- 172.21.15.17:0/3985634026 <== mon.1 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f349c0049c0 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.499+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f349c02e040 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.500+0000 7f34837fe640 1 -- 172.21.15.17:0/3985634026 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f349c0052e0 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.500+0000 7f34b09d5740 10 client.25291 fetch_fsmap learned FSMap version 26 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.500+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a09c055ef0 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.500+0000 7f34837fe640 1 -- 172.21.15.17:0/3985634026 <== mon.1 v2:172.21.15.89:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f349c02e040 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34837fe640 1 -- 172.21.15.17:0/3985634026 <== mon.1 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f349c00f600 con 0x55a09bbd4ea0 2024-09-21T06:13:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34b09d5740 10 client.25291 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34b09d5740 10 client.25291 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34b09d5740 20 client.25291 populate_metadata read hostname 'smithi017' 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34b09d5740 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bc16520 0x55a09c058320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34b09d5740 4 client.25291 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "99619cac", "release": true, "await": true}] 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "99619cac", "release": true, "await": true}) -- 0x55a09bf31bf0 con 0x55a09bc16520 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.501+0000 7f34a37fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bc16520 0x55a09c058320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.502+0000 7f34a37fe640 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bc16520 0x55a09c058320 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56e5aa54a48e1b4e server_cookie=fe7082839f531d49 in_seq=0 out_seq=0 2024-09-21T06:13:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.502+0000 7f34837fe640 10 client.25291 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:33.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34837fe640 1 -- 172.21.15.17:0/3985634026 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a09bf31bf0 con 0x55a09bc16520 2024-09-21T06:13:33.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34837fe640 10 client.25291 handle_command_reply: tid=0 2024-09-21T06:13:33.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 client.25291 shutdown 2024-09-21T06:13:33.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 msgr2=0x55a09bfd9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 0x55a09bfd9cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f349c01b040 tx=0x7f349c000f40 comp rx=0 tx=0).stop 2024-09-21T06:13:33.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 shutdown_connections 2024-09-21T06:13:33.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55a09bc16520 0x55a09c058320 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34837fe640 0 client.25291 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a09bbf5840 0x55a09c04d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a09bbed660 0x55a09bfda260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 --2- 172.21.15.17:0/3985634026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a09bbd4ea0 0x55a09bfd9cc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 >> 172.21.15.17:0/3985634026 conn(0x55a09bc0a910 msgr2=0x55a09bfcfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 shutdown_connections 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.504+0000 7f34b09d5740 1 -- 172.21.15.17:0/3985634026 wait complete. 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34b09d5740 20 client.25291 trim_cache size 0 max 16384 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 26, 2024-09-21T06:13:33.507 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 4, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "99619cac": { 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 4, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 134.5, 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:13:33.508 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f348c0b6590 msgr2=0x7f348c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f348c0b6590 0x7f348c0b8aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f34940cdd20 tx=0x7f349403b460 comp rx=0 tx=0).stop 2024-09-21T06:13:33.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 msgr2=0x7f34a419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 0x7f34a419a3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3494009230 tx=0x7f3494004270 comp rx=0 tx=0).stop 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 shutdown_connections 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f348c0b6590 0x7f348c0b8aa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34a41094b0 0x7f34a419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34a4109e00 0x7f34a419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 --2- 172.21.15.17:0/3948534862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34a4101f70 0x7f34a419a3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 >> 172.21.15.17:0/3948534862 conn(0x7f34a4077c60 msgr2=0x7f34a41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.505+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 shutdown_connections 2024-09-21T06:13:33.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:13:33.506+0000 7f34aa461640 1 -- 172.21.15.17:0/3948534862 wait complete. 2024-09-21T06:13:34.329 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '99619cac', total seconds elapsed: 18.2 2024-09-21T06:13:34.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:34 smithi081 ceph-mon[33870]: pgmap v398: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:34 smithi089 ceph-mon[33879]: pgmap v398: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:34 smithi017 ceph-mon[31080]: pgmap v398: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:36.509 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:36 smithi081 ceph-mon[33870]: pgmap v399: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:36.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:36 smithi089 ceph-mon[33879]: pgmap v399: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:36.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:36 smithi017 ceph-mon[31080]: pgmap v399: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:38.507 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:38 smithi081 ceph-mon[33870]: pgmap v400: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:38.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:38 smithi089 ceph-mon[33879]: pgmap v400: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:38.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:38 smithi017 ceph-mon[31080]: pgmap v400: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:40.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:40 smithi089 ceph-mon[33879]: pgmap v401: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:40.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:40 smithi017 ceph-mon[31080]: pgmap v401: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:40 smithi081 ceph-mon[33870]: pgmap v401: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:42.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:42 smithi089 ceph-mon[33879]: pgmap v402: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:13:42.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:42 smithi017 ceph-mon[31080]: pgmap v402: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:13:42.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:42 smithi081 ceph-mon[33870]: pgmap v402: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:13:44.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:44 smithi089 ceph-mon[33879]: pgmap v403: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:44.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:44 smithi017 ceph-mon[31080]: pgmap v403: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:44.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:44 smithi081 ceph-mon[33870]: pgmap v403: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:46.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:46 smithi089 ceph-mon[33879]: pgmap v404: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:46.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:46 smithi017 ceph-mon[31080]: pgmap v404: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:46.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:46 smithi081 ceph-mon[33870]: pgmap v404: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:48.617 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:48 smithi089 ceph-mon[33879]: pgmap v405: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:48 smithi017 ceph-mon[31080]: pgmap v405: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:48 smithi081 ceph-mon[33870]: pgmap v405: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:50.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:50 smithi089 ceph-mon[33879]: pgmap v406: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:50.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:50 smithi017 ceph-mon[31080]: pgmap v406: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:50 smithi081 ceph-mon[33870]: pgmap v406: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:52.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:52 smithi089 ceph-mon[33879]: pgmap v407: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:13:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:52 smithi017 ceph-mon[31080]: pgmap v407: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:13:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:52 smithi081 ceph-mon[33870]: pgmap v407: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:13:54.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:54 smithi089 ceph-mon[33879]: pgmap v408: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:54 smithi017 ceph-mon[31080]: pgmap v408: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:54.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:54 smithi081 ceph-mon[33870]: pgmap v408: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:13:56.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:56 smithi089 ceph-mon[33879]: pgmap v409: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:56 smithi017 ceph-mon[31080]: pgmap v409: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:56.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:56 smithi081 ceph-mon[33870]: pgmap v409: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:13:57.480 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 91% (11605/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T06:13:58.223 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.224 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-09-21T06:13:58.225 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.225 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-09-21T06:13:58.225 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.225 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T06:13:58.225 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:58.225 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:13:58.228 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T06:13:58.267 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T06:13:58.269 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:13:58.269 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T06:13:58.985 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T06:13:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:13:58 smithi081 ceph-mon[33870]: pgmap v410: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:59.058 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T06:13:59.099 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:13:59.100 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:13:59.101 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T06:13:59.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:13:58 smithi089 ceph-mon[33879]: pgmap v410: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:13:58 smithi017 ceph-mon[31080]: pgmap v410: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:13:59.140 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:13:59.144 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:13:59.144 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T06:13:59.202 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-21T06:13:59.203 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-21T06:13:59.203 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-21T06:13:59.273 INFO:tasks.workunit.client.0.smithi017.stdout:getting blogbench 2024-09-21T06:13:59.273 INFO:tasks.workunit.client.0.smithi017.stderr:+ echo 'getting blogbench' 2024-09-21T06:13:59.273 INFO:tasks.workunit.client.0.smithi017.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-21T06:13:59.298 INFO:tasks.workunit.client.0.smithi017.stderr:--2024-09-21 06:13:59-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-21T06:13:59.308 INFO:tasks.workunit.client.0.smithi017.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T06:13:59.330 INFO:tasks.workunit.client.0.smithi017.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T06:13:59.350 INFO:tasks.workunit.client.0.smithi017.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T06:13:59.351 INFO:tasks.workunit.client.0.smithi017.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-21T06:13:59.352 INFO:tasks.workunit.client.0.smithi017.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-21T06:13:59.355 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:59.392 INFO:tasks.workunit.client.0.smithi017.stderr: 0K .......... .......... .......... .......... .......... 49% 1.24M 0s 2024-09-21T06:13:59.413 INFO:tasks.workunit.client.0.smithi017.stderr: 50K .......... .......... .......... .......... .......... 99% 2.41M 0s 2024-09-21T06:13:59.413 INFO:tasks.workunit.client.0.smithi017.stderr: 100K 100% 1.74T=0.06s 2024-09-21T06:13:59.413 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:59.413 INFO:tasks.workunit.client.0.smithi017.stderr:2024-09-21 06:13:59 (1.65 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-21T06:13:59.413 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-21T06:13:59.413 INFO:tasks.workunit.client.0.smithi017.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-21T06:13:59.444 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/ 2024-09-21T06:13:59.445 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/m4/ 2024-09-21T06:13:59.447 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-21T06:13:59.449 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/man/ 2024-09-21T06:13:59.451 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/man/blogbench.8 2024-09-21T06:13:59.454 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/man/Makefile.am 2024-09-21T06:13:59.456 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/man/Makefile.in 2024-09-21T06:13:59.459 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/ 2024-09-21T06:13:59.461 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-21T06:13:59.463 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-21T06:13:59.465 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/blogbench.c 2024-09-21T06:13:59.468 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/blogbench.h 2024-09-21T06:13:59.471 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-21T06:13:59.474 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-21T06:13:59.476 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-21T06:13:59.478 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-21T06:13:59.481 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-21T06:13:59.484 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/Makefile.am 2024-09-21T06:13:59.486 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/Makefile.in 2024-09-21T06:13:59.489 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/process.c 2024-09-21T06:13:59.492 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/globals.h 2024-09-21T06:13:59.494 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/commenter.c 2024-09-21T06:13:59.497 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/rewriter.c 2024-09-21T06:13:59.499 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/reader.c 2024-09-21T06:13:59.502 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/writer.c 2024-09-21T06:13:59.504 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/src/helpers.c 2024-09-21T06:13:59.507 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/NEWS 2024-09-21T06:13:59.510 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/compile 2024-09-21T06:13:59.512 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/depcomp 2024-09-21T06:13:59.515 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/aclocal.m4 2024-09-21T06:13:59.518 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/README 2024-09-21T06:13:59.520 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/configure 2024-09-21T06:13:59.529 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/configure.ac 2024-09-21T06:13:59.532 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/config.guess 2024-09-21T06:13:59.535 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/install-sh 2024-09-21T06:13:59.538 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/config.sub 2024-09-21T06:13:59.541 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/missing 2024-09-21T06:13:59.543 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/mkinstalldirs 2024-09-21T06:13:59.546 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/Makefile.am 2024-09-21T06:13:59.548 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/Makefile.in 2024-09-21T06:13:59.551 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/config.h.in 2024-09-21T06:13:59.553 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/AUTHORS 2024-09-21T06:13:59.555 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/INSTALL 2024-09-21T06:13:59.558 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/ChangeLog 2024-09-21T06:13:59.560 INFO:tasks.workunit.client.0.smithi017.stdout:blogbench-1.0/COPYING 2024-09-21T06:13:59.563 INFO:tasks.workunit.client.0.smithi017.stderr:+ cd blogbench-1.0/ 2024-09-21T06:13:59.565 INFO:tasks.workunit.client.0.smithi017.stdout:making blogbench 2024-09-21T06:13:59.565 INFO:tasks.workunit.client.0.smithi017.stderr:+ echo 'making blogbench' 2024-09-21T06:13:59.565 INFO:tasks.workunit.client.0.smithi017.stderr:+ ./configure 2024-09-21T06:13:59.671 INFO:tasks.workunit.client.0.smithi017.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T06:14:00.681 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether build environment is sane... yes 2024-09-21T06:14:00.700 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gawk... gawk 2024-09-21T06:14:00.724 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether make sets $(MAKE)... yes 2024-09-21T06:14:00.741 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc... gcc 2024-09-21T06:14:00.820 INFO:tasks.workunit.client.0.smithi017.stdout:checking for C compiler default output file name... a.out 2024-09-21T06:14:00.823 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether the C compiler works... yes 2024-09-21T06:14:00.828 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are cross compiling... no 2024-09-21T06:14:00.882 INFO:tasks.workunit.client.0.smithi017.stdout:checking for suffix of executables... 2024-09-21T06:14:00.928 INFO:tasks.workunit.client.0.smithi017.stdout:checking for suffix of object files... o 2024-09-21T06:14:00.974 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T06:14:01.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:00 smithi081 ceph-mon[33870]: pgmap v411: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:14:01.021 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether gcc accepts -g... yes 2024-09-21T06:14:01.106 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-21T06:14:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:00 smithi089 ceph-mon[33879]: pgmap v411: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:14:01.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:00 smithi017 ceph-mon[31080]: pgmap v411: 129 pgs: 129 active+clean; 661 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:14:01.170 INFO:tasks.workunit.client.0.smithi017.stdout:checking for style of include used by make... GNU 2024-09-21T06:14:01.258 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T06:14:01.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:14:01.325 INFO:tasks.workunit.client.0.smithi017.stdout:checking dependency style of gcc... gcc3 2024-09-21T06:14:01.325 INFO:tasks.workunit.client.0.smithi017.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-21T06:14:01.402 INFO:tasks.workunit.client.0.smithi017.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T06:14:01.469 INFO:tasks.workunit.client.0.smithi017.stdout:checking for egrep... grep -E 2024-09-21T06:14:01.487 INFO:tasks.workunit.client.0.smithi017.stdout:checking for AIX... no 2024-09-21T06:14:01.548 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:01.590 INFO:tasks.workunit.client.0.smithi017.stdout:checking for library containing strerror... none required 2024-09-21T06:14:01.820 INFO:tasks.workunit.client.0.smithi017.stdout:checking for ANSI C header files... yes 2024-09-21T06:14:01.876 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-21T06:14:01.944 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/types.h... yes 2024-09-21T06:14:02.014 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/stat.h... yes 2024-09-21T06:14:02.094 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdlib.h... yes 2024-09-21T06:14:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 -- 172.21.15.17:0/2007500910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d541094a0 msgr2=0x7f4d541098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/2007500910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d541094a0 0x7f4d541098b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009900 tx=0x7f4d4802a410 comp rx=0 tx=0).stop 2024-09-21T06:14:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 -- 172.21.15.17:0/2007500910 shutdown_connections 2024-09-21T06:14:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/2007500910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d541094a0 0x7f4d541098b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/2007500910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d54109df0 0x7f4d54110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/2007500910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d54103b60 0x7f4d54103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 -- 172.21.15.17:0/2007500910 >> 172.21.15.17:0/2007500910 conn(0x7f4d5407b850 msgr2=0x7f4d5407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 -- 172.21.15.17:0/2007500910 shutdown_connections 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.103+0000 7f4d58d8b640 1 -- 172.21.15.17:0/2007500910 wait complete. 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.104+0000 7f4d58d8b640 1 Processor -- start 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.104+0000 7f4d58d8b640 1 -- start start 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.104+0000 7f4d58d8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 0x7f4d5419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d58d8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 0x7f4d5419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d58d8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d54109df0 0x7f4d5419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d58d8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54113960 con 0x7f4d54103b60 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d58d8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d541137e0 con 0x7f4d541094a0 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d58d8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54113ae0 con 0x7f4d54109df0 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 0x7f4d5419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 0x7f4d5419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:02.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 0x7f4d5419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:56804/0 (socket says 172.21.15.17:56804) 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 0x7f4d5419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55472/0 (socket says 172.21.15.17:55472) 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 -- 172.21.15.17:0/134596003 learned_addr learned my addr 172.21.15.17:0/134596003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d52d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d54109df0 0x7f4d5419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 -- 172.21.15.17:0/134596003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d54109df0 msgr2=0x7f4d5419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d54109df0 0x7f4d5419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 -- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 msgr2=0x7f4d5419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 0x7f4d5419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 -- 172.21.15.17:0/134596003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d541a0340 con 0x7f4d541094a0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d5259c640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 0x7f4d5419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.105+0000 7f4d51d9b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 0x7f4d5419a970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d48004770 tx=0x7f4d48004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.106+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4803f030 con 0x7f4d541094a0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.106+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d48004440 con 0x7f4d541094a0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.106+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d541a05d0 con 0x7f4d541094a0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.106+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48035070 con 0x7f4d541094a0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.106+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d541a6d90 con 0x7f4d541094a0 2024-09-21T06:14:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.107+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d54104de0 con 0x7f4d541094a0 2024-09-21T06:14:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.108+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4d48042030 con 0x7f4d541094a0 2024-09-21T06:14:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.109+0000 7f4d437fe640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4d3c0b6510 0x7f4d3c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.109+0000 7f4d5259c640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4d3c0b6510 0x7f4d3c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.109+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f4d481079b0 con 0x7f4d541094a0 2024-09-21T06:14:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.110+0000 7f4d5259c640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4d3c0b6510 0x7f4d3c0b8a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4d44005d00 tx=0x7f4d4400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.114+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d480d2230 con 0x7f4d541094a0 2024-09-21T06:14:02.171 INFO:tasks.workunit.client.0.smithi017.stdout:checking for string.h... yes 2024-09-21T06:14:02.257 INFO:tasks.workunit.client.0.smithi017.stdout:checking for memory.h... yes 2024-09-21T06:14:02.330 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strings.h... yes 2024-09-21T06:14:02.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.368+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d5410bbe0 con 0x7f4d541094a0 2024-09-21T06:14:02.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.369+0000 7f4d437fe640 1 -- 172.21.15.17:0/134596003 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11885 (secure 0 0 0) 0x7f4d480d7170 con 0x7f4d541094a0 2024-09-21T06:14:02.371 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:14:02.371 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-21T06:12:42:786101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:12:42.111135+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:14:02.372 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-21T06:14:02.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4d3c0b6510 msgr2=0x7f4d3c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:02.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4d3c0b6510 0x7f4d3c0b8a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4d44005d00 tx=0x7f4d4400b410 comp rx=0 tx=0).stop 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 msgr2=0x7f4d5419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 0x7f4d5419a970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d48004770 tx=0x7f4d48004040 comp rx=0 tx=0).stop 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 shutdown_connections 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4d3c0b6510 0x7f4d3c0b8a20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d54109df0 0x7f4d5419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d541094a0 0x7f4d5419a970 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 --2- 172.21.15.17:0/134596003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d54103b60 0x7f4d5419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 >> 172.21.15.17:0/134596003 conn(0x7f4d5407b850 msgr2=0x7f4d541075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 shutdown_connections 2024-09-21T06:14:02.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:02.372+0000 7f4d58d8b640 1 -- 172.21.15.17:0/134596003 wait complete. 2024-09-21T06:14:02.406 INFO:tasks.workunit.client.0.smithi017.stdout:checking for inttypes.h... yes 2024-09-21T06:14:02.481 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdint.h... yes 2024-09-21T06:14:02.556 INFO:tasks.workunit.client.0.smithi017.stdout:checking for unistd.h... yes 2024-09-21T06:14:02.575 INFO:tasks.workunit.client.0.smithi017.stdout:checking for memory.h... (cached) yes 2024-09-21T06:14:02.587 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strings.h... (cached) yes 2024-09-21T06:14:02.600 INFO:tasks.workunit.client.0.smithi017.stdout:checking for unistd.h... (cached) yes 2024-09-21T06:14:02.675 INFO:tasks.workunit.client.0.smithi017.stdout:checking locale.h usability... yes 2024-09-21T06:14:02.705 INFO:tasks.workunit.client.0.smithi017.stdout:checking locale.h presence... yes 2024-09-21T06:14:02.706 INFO:tasks.workunit.client.0.smithi017.stdout:checking for locale.h... yes 2024-09-21T06:14:02.730 INFO:tasks.workunit.client.0.smithi017.stdout:checking for stdlib.h... (cached) yes 2024-09-21T06:14:02.742 INFO:tasks.workunit.client.0.smithi017.stdout:checking for string.h... (cached) yes 2024-09-21T06:14:02.883 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/socket.h usability... yes 2024-09-21T06:14:02.915 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/socket.h presence... yes 2024-09-21T06:14:02.917 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/socket.h... yes 2024-09-21T06:14:02.993 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/time.h usability... yes 2024-09-21T06:14:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:02 smithi081 ceph-mon[33870]: pgmap v412: 129 pgs: 129 active+clean; 862 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-21T06:14:03.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:02 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/134596003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:03.023 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/time.h presence... yes 2024-09-21T06:14:03.024 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/time.h... yes 2024-09-21T06:14:03.108 INFO:tasks.workunit.client.0.smithi017.stdout:checking fcntl.h usability... yes 2024-09-21T06:14:03.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:02 smithi017 ceph-mon[31080]: pgmap v412: 129 pgs: 129 active+clean; 862 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-21T06:14:03.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:02 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/134596003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:02 smithi089 ceph-mon[33879]: pgmap v412: 129 pgs: 129 active+clean; 862 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-09-21T06:14:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:02 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/134596003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:03.142 INFO:tasks.workunit.client.0.smithi017.stdout:checking fcntl.h presence... yes 2024-09-21T06:14:03.143 INFO:tasks.workunit.client.0.smithi017.stdout:checking for fcntl.h... yes 2024-09-21T06:14:03.145 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T06:14:03.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T06:14:03.224 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/fcntl.h usability... yes 2024-09-21T06:14:03.257 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/fcntl.h presence... yes 2024-09-21T06:14:03.258 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/fcntl.h... yes 2024-09-21T06:14:03.348 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/param.h usability... yes 2024-09-21T06:14:03.383 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/param.h presence... yes 2024-09-21T06:14:03.384 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/param.h... yes 2024-09-21T06:14:03.430 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:03.462 INFO:tasks.workunit.client.0.smithi017.stdout:checking ioctl.h usability... no 2024-09-21T06:14:03.496 INFO:tasks.workunit.client.0.smithi017.stdout:checking ioctl.h presence... no 2024-09-21T06:14:03.497 INFO:tasks.workunit.client.0.smithi017.stdout:checking for ioctl.h... no 2024-09-21T06:14:03.576 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/ioctl.h usability... yes 2024-09-21T06:14:03.605 INFO:tasks.workunit.client.0.smithi017.stdout:checking sys/ioctl.h presence... yes 2024-09-21T06:14:03.606 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sys/ioctl.h... yes 2024-09-21T06:14:03.700 INFO:tasks.workunit.client.0.smithi017.stdout:checking return type of signal handlers... void 2024-09-21T06:14:03.769 INFO:tasks.workunit.client.0.smithi017.stdout:checking for size_t... yes 2024-09-21T06:14:03.824 INFO:tasks.workunit.client.0.smithi017.stdout:checking for dev_t... yes 2024-09-21T06:14:03.887 INFO:tasks.workunit.client.0.smithi017.stdout:checking for short... yes 2024-09-21T06:14:03.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 -- 172.21.15.17:0/140152724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c109e20 msgr2=0x7f770c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 --2- 172.21.15.17:0/140152724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c109e20 0x7f770c110650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7704009ca0 tx=0x7f770402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 -- 172.21.15.17:0/140152724 shutdown_connections 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 --2- 172.21.15.17:0/140152724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c109e20 0x7f770c110650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 --2- 172.21.15.17:0/140152724 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 0x7f770c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 --2- 172.21.15.17:0/140152724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c1054f0 0x7f770c105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.963+0000 7f7713954640 1 -- 172.21.15.17:0/140152724 >> 172.21.15.17:0/140152724 conn(0x7f770c079870 msgr2=0x7f770c079c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.964+0000 7f7713954640 1 -- 172.21.15.17:0/140152724 shutdown_connections 2024-09-21T06:14:03.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.964+0000 7f7713954640 1 -- 172.21.15.17:0/140152724 wait complete. 2024-09-21T06:14:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.964+0000 7f7713954640 1 Processor -- start 2024-09-21T06:14:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 -- start start 2024-09-21T06:14:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c1054f0 0x7f770c102820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 0x7f770c102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 0x7f770c1032a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1139e0 con 0x7f770c109e20 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7711ef1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 0x7f770c1032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f770c113860 con 0x7f770c1054f0 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7713954640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f770c113b60 con 0x7f770c1094d0 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7711ef1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 0x7f770c1032a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55502/0 (socket says 172.21.15.17:55502) 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7711ef1640 1 -- 172.21.15.17:0/1328172139 learned_addr learned my addr 172.21.15.17:0/1328172139 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f7710eef640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 0x7f770c102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.965+0000 7f77116f0640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c1054f0 0x7f770c102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7710eef640 1 -- 172.21.15.17:0/1328172139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c1054f0 msgr2=0x7f770c102820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7710eef640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c1054f0 0x7f770c102820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7710eef640 1 -- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 msgr2=0x7f770c1032a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7710eef640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 0x7f770c1032a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7710eef640 1 -- 172.21.15.17:0/1328172139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c1a8670 con 0x7f770c1094d0 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7711ef1640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 0x7f770c1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7710eef640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 0x7f770c102d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f770c06aac0 tx=0x7f76fc00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:03.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f77027fc640 1 -- 172.21.15.17:0/1328172139 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc00cc40 con 0x7f770c1094d0 2024-09-21T06:14:03.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770c1a8960 con 0x7f770c1094d0 2024-09-21T06:14:03.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770c1a8ea0 con 0x7f770c1094d0 2024-09-21T06:14:03.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f77027fc640 1 -- 172.21.15.17:0/1328172139 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76fc00cde0 con 0x7f770c1094d0 2024-09-21T06:14:03.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.966+0000 7f77027fc640 1 -- 172.21.15.17:0/1328172139 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc004800 con 0x7f770c1094d0 2024-09-21T06:14:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 Processor -- start 2024-09-21T06:14:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 -- start start 2024-09-21T06:14:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5595fb535b90 con 0x5595fb1ef980 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595fb524fc0 con 0x5595fb218840 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.969+0000 7f7719ec8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5595fb528dd0 con 0x5595fb1f7b60 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f77116f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f77116f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5bfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55514/0 (socket says 172.21.15.17:55514) 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f77116f0640 1 -- 172.21.15.17:0/987323781 learned_addr learned my addr 172.21.15.17:0/987323781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f77027fc640 1 -- 172.21.15.17:0/1328172139 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f76fc004ae0 con 0x7f770c1094d0 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7710eef640 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 -- 172.21.15.17:0/987323781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 msgr2=0x5595fb5c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 -- 172.21.15.17:0/987323781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 msgr2=0x5595fb5bfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5bfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 -- 172.21.15.17:0/987323781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fb4ac060 con 0x5595fb218840 2024-09-21T06:14:03.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f77116f0640 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5bfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.970+0000 7f7711ef1640 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5bf600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7704006010 tx=0x7f77040098a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43d8a7687a4c29e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.971+0000 7f76f77fe640 1 -- 172.21.15.17:0/987323781 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704031b80 con 0x5595fb218840 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.971+0000 7f76f77fe640 1 -- 172.21.15.17:0/987323781 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7704036030 con 0x5595fb218840 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.971+0000 7f76f77fe640 1 -- 172.21.15.17:0/987323781 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77040045d0 con 0x5595fb218840 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.971+0000 7f77027fc640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76f80b6590 0x7f76f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.971+0000 7f77116f0640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76f80b6590 0x7f76f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.971+0000 7f77027fc640 1 -- 172.21.15.17:0/1328172139 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f76fc0e7350 con 0x7f770c1094d0 2024-09-21T06:14:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 -- 172.21.15.17:0/987323781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 msgr2=0x5595fb5bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5bf600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7704006010 tx=0x7f77040098a0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 -- 172.21.15.17:0/987323781 shutdown_connections 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5bfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 --2- 172.21.15.17:0/987323781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5bf600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 -- 172.21.15.17:0/987323781 >> 172.21.15.17:0/987323781 conn(0x5595fb20c990 msgr2=0x5595fb5bd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f77116f0640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76f80b6590 0x7f76f80b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5595fb5be280 tx=0x7f7708005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 -- 172.21.15.17:0/987323781 shutdown_connections 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 -- 172.21.15.17:0/987323781 wait complete. 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 -- start start 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.972+0000 7f7719ec8740 1 Processor -- start 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1ef980 0x5595fb5cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1f7b60 0x5595fb5cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb5d6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5595fb3867a0 con 0x5595fb1f7b60 2024-09-21T06:14:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595fb4ca0a0 con 0x5595fb1ef980 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5595fb5cdc00 con 0x5595fb218840 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7719ec8740 10 client.0 _ll_register_callbacks cb 0x5595fb4a73c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f77116f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1ef980 0x5595fb5cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb5d6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb5d6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:35446/0 (socket says 172.21.15.17:35446) 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 -- 172.21.15.17:0/3930870544 learned_addr learned my addr 172.21.15.17:0/3930870544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7710eef640 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1f7b60 0x5595fb5cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 -- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1ef980 msgr2=0x5595fb5cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1ef980 0x5595fb5cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 -- 172.21.15.17:0/3930870544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1f7b60 msgr2=0x5595fb5cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1f7b60 0x5595fb5cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.973+0000 7f7711ef1640 1 -- 172.21.15.17:0/3930870544 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595fb4b8880 con 0x5595fb218840 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f7711ef1640 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb5d6f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7704004600 tx=0x7f7704004630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612d82ef6129d202 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f76f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-21T06:14:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f76f4ff9640 1 -- 172.21.15.17:0/3930870544 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770404a040 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f76f4ff9640 1 -- 172.21.15.17:0/3930870544 <== mon.1 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f7704003b70 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7704036030 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f76f4ff9640 1 -- 172.21.15.17:0/3930870544 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7704004850 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f7719ec8740 10 client.25309 fetch_fsmap learned FSMap version 26 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5595fb292b90 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f76f4ff9640 1 -- 172.21.15.17:0/3930870544 <== mon.1 v2:172.21.15.89:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7704036030 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f76f4ff9640 1 -- 172.21.15.17:0/3930870544 <== mon.1 v2:172.21.15.89:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f770404d030 con 0x5595fb218840 2024-09-21T06:14:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f7719ec8740 10 client.25309 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.974+0000 7f7719ec8740 10 client.25309 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f7719ec8740 20 client.25309 populate_metadata read hostname 'smithi017' 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f7719ec8740 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1d71c0 0x5595fb5dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f7719ec8740 4 client.25309 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595fb537ae0 con 0x5595fb1d71c0 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f77116f0640 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1d71c0 0x5595fb5dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f76f4ff9640 10 client.25309 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.975+0000 7f77116f0640 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1d71c0 0x5595fb5dcde0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5d708ced9d6ec7 server_cookie=a59f06e240805a67 in_seq=0 out_seq=0 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f76f4ff9640 1 -- 172.21.15.17:0/3930870544 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595fb537ae0 con 0x5595fb1d71c0 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f76f4ff9640 10 client.25309 handle_command_reply: tid=0 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 client.25309 shutdown 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 msgr2=0x5595fb5d6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb5d6f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7704004600 tx=0x7f7704004630 comp rx=0 tx=0).stop 2024-09-21T06:14:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 shutdown_connections 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1d71c0 0x5595fb5dcde0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1f7b60 0x5595fb5cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb5d6f80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f76f4ff9640 0 client.25309 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 --2- 172.21.15.17:0/3930870544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1ef980 0x5595fb5cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 >> 172.21.15.17:0/3930870544 conn(0x5595fb20c990 msgr2=0x5595fb5c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 shutdown_connections 2024-09-21T06:14:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 1 -- 172.21.15.17:0/3930870544 wait complete. 2024-09-21T06:14:03.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.977+0000 7f7719ec8740 20 client.25309 trim_cache size 0 max 16384 2024-09-21T06:14:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.995+0000 7f7719ec8740 1 Processor -- start 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.995+0000 7f7719ec8740 1 -- start start 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5d73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7719ec8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0012480 con 0x5595fb1ef980 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7719ec8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76f000fd50 con 0x5595fb218840 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7719ec8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f76f000dba0 con 0x5595fb1f7b60 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55536/0 (socket says 172.21.15.17:55536) 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 -- 172.21.15.17:0/1897654535 learned_addr learned my addr 172.21.15.17:0/1897654535 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7711ef1640 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7710eef640 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5d73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 -- 172.21.15.17:0/1897654535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 msgr2=0x5595fb5d73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5d73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 -- 172.21.15.17:0/1897654535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 msgr2=0x5595fb5c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 -- 172.21.15.17:0/1897654535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fb5d7900 con 0x5595fb1ef980 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f7711ef1640 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.996+0000 7f77116f0640 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d6e80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7708004140 tx=0x7f770801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2837249a57ac0f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.997+0000 7f76f6ffd640 1 -- 172.21.15.17:0/1897654535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77080044c0 con 0x5595fb1ef980 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.997+0000 7f76f6ffd640 1 -- 172.21.15.17:0/1897654535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77080054b0 con 0x5595fb1ef980 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.997+0000 7f76f6ffd640 1 -- 172.21.15.17:0/1897654535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770802b440 con 0x5595fb1ef980 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 -- 172.21.15.17:0/1897654535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 msgr2=0x5595fb5d6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d6e80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7708004140 tx=0x7f770801b000 comp rx=0 tx=0).stop 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 -- 172.21.15.17:0/1897654535 shutdown_connections 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb218840 0x5595fb5c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb1f7b60 0x5595fb5d73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 --2- 172.21.15.17:0/1897654535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d6e80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 -- 172.21.15.17:0/1897654535 >> 172.21.15.17:0/1897654535 conn(0x5595fb20c990 msgr2=0x5595fb5c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 -- 172.21.15.17:0/1897654535 shutdown_connections 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 -- 172.21.15.17:0/1897654535 wait complete. 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 -- start start 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.998+0000 7f7719ec8740 1 Processor -- start 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1f7b60 0x5595fb5d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb648df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76f000e210 con 0x5595fb1ef980 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76f000f680 con 0x5595fb1f7b60 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f76f000e8e0 con 0x5595fb218840 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f77116f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7719ec8740 10 client.0 _ll_register_callbacks cb 0x7f7708009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f77116f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55538/0 (socket says 172.21.15.17:55538) 2024-09-21T06:14:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1f7b60 0x5595fb5d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f77116f0640 1 -- 172.21.15.17:0/2146326424 learned_addr learned my addr 172.21.15.17:0/2146326424 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7711ef1640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb648df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 -- 172.21.15.17:0/2146326424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 msgr2=0x5595fb648df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:04.004 INFO:tasks.workunit.client.0.smithi017.stdout:checking size of short... 2 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb648df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 -- 172.21.15.17:0/2146326424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 msgr2=0x5595fb5d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 -- 172.21.15.17:0/2146326424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595fb649460 con 0x5595fb1f7b60 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f77116f0640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f7710eef640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1f7b60 0x5595fb5d0f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0acdf0 tx=0x7f76fc0ea990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76a46151e952d9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:03.999+0000 7f76f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f76f4ff9640 1 -- 172.21.15.17:0/2146326424 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc01c040 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f76f4ff9640 1 -- 172.21.15.17:0/2146326424 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f76fc0ac350 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77080054b0 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f76f4ff9640 1 -- 172.21.15.17:0/2146326424 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f76fc0ac860 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 10 client.25367 fetch_fsmap learned FSMap version 26 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5595fb651940 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f76f4ff9640 1 -- 172.21.15.17:0/2146326424 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77080054b0 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f76f4ff9640 1 -- 172.21.15.17:0/2146326424 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f76fc0981c0 con 0x5595fb1f7b60 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 10 client.25367 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 10 client.25367 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 20 client.25367 populate_metadata read hostname 'smithi017' 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1ac570 0x5595fb6541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 4 client.25367 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x5595fb533590 con 0x5595fb1ac570 2024-09-21T06:14:04.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.000+0000 7f77116f0640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1ac570 0x5595fb6541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.001+0000 7f76f4ff9640 10 client.25367 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:04.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:04.001+0000 7f77116f0640 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1ac570 0x5595fb6541a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8b0ce66dcbd2969 server_cookie=e7fe4f1eb2033a6b in_seq=0 out_seq=0 2024-09-21T06:14:05.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:04 smithi081 ceph-mon[33870]: pgmap v413: 129 pgs: 129 active+clean; 940 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:14:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:04 smithi089 ceph-mon[33879]: pgmap v413: 129 pgs: 129 active+clean; 940 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:14:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:04 smithi017 ceph-mon[31080]: pgmap v413: 129 pgs: 129 active+clean; 940 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:14:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f76f4ff9640 1 -- 172.21.15.17:0/2146326424 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5595fb533590 con 0x5595fb1ac570 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f76f4ff9640 10 client.25367 handle_command_reply: tid=0 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 client.25367 shutdown 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1f7b60 msgr2=0x5595fb5d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1f7b60 0x5595fb5d0f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0acdf0 tx=0x7f76fc0ea990 comp rx=0 tx=0).stop 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 shutdown_connections 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5595fb1ac570 0x5595fb6541a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5595fb218840 0x5595fb648df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595fb1f7b60 0x5595fb5d0f80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f76f4ff9640 0 client.25367 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 --2- 172.21.15.17:0/2146326424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595fb1ef980 0x5595fb5d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 >> 172.21.15.17:0/2146326424 conn(0x5595fb20c990 msgr2=0x5595fb5cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 shutdown_connections 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.847+0000 7f7719ec8740 1 -- 172.21.15.17:0/2146326424 wait complete. 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.848+0000 7f7719ec8740 20 client.25367 trim_cache size 0 max 16384 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 26, 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:14:06.851 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 6, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "5a5276c0": { 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 6, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 137.0, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:14:06.852 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:06.853 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76f80b6590 msgr2=0x7f76f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76f80b6590 0x7f76f80b8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5595fb5be280 tx=0x7f7708005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 msgr2=0x7f770c102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 0x7f770c102d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f770c06aac0 tx=0x7f76fc00ee50 comp rx=0 tx=0).stop 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 shutdown_connections 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f76f80b6590 0x7f76f80b8aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c109e20 0x7f770c1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f770c1094d0 0x7f770c102d60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 --2- 172.21.15.17:0/1328172139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f770c1054f0 0x7f770c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 >> 172.21.15.17:0/1328172139 conn(0x7f770c079870 msgr2=0x7f770c107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 shutdown_connections 2024-09-21T06:14:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:06.849+0000 7f7713954640 1 -- 172.21.15.17:0/1328172139 wait complete. 2024-09-21T06:14:07.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:06 smithi081 ceph-mon[33870]: pgmap v414: 129 pgs: 129 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 89 KiB/s wr, 27 op/s 2024-09-21T06:14:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:06 smithi089 ceph-mon[33879]: pgmap v414: 129 pgs: 129 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 89 KiB/s wr, 27 op/s 2024-09-21T06:14:07.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:06 smithi017 ceph-mon[31080]: pgmap v414: 129 pgs: 129 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 89 KiB/s wr, 27 op/s 2024-09-21T06:14:07.551 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5a5276c0', quiesce took 6.3 seconds. Will release after: 10.7 2024-09-21T06:14:08.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:08 smithi017 ceph-mon[31080]: pgmap v415: 129 pgs: 129 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 256 KiB/s wr, 52 op/s 2024-09-21T06:14:09.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:08 smithi081 ceph-mon[33870]: pgmap v415: 129 pgs: 129 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 256 KiB/s wr, 52 op/s 2024-09-21T06:14:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:08 smithi089 ceph-mon[33879]: pgmap v415: 129 pgs: 129 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 256 KiB/s wr, 52 op/s 2024-09-21T06:14:11.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:10 smithi081 ceph-mon[33870]: pgmap v416: 129 pgs: 129 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 259 KiB/s wr, 55 op/s 2024-09-21T06:14:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:10 smithi089 ceph-mon[33879]: pgmap v416: 129 pgs: 129 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 259 KiB/s wr, 55 op/s 2024-09-21T06:14:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:10 smithi017 ceph-mon[31080]: pgmap v416: 129 pgs: 129 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 259 KiB/s wr, 55 op/s 2024-09-21T06:14:13.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:12 smithi081 ceph-mon[33870]: pgmap v417: 129 pgs: 129 active+clean; 3.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 274 KiB/s wr, 58 op/s 2024-09-21T06:14:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:12 smithi089 ceph-mon[33879]: pgmap v417: 129 pgs: 129 active+clean; 3.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 274 KiB/s wr, 58 op/s 2024-09-21T06:14:13.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:12 smithi017 ceph-mon[31080]: pgmap v417: 129 pgs: 129 active+clean; 3.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 274 KiB/s wr, 58 op/s 2024-09-21T06:14:14.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:13 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:14:14.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:13 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:14:14.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:13 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:14:15.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:14 smithi081 ceph-mon[33870]: pgmap v418: 129 pgs: 129 active+clean; 3.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 256 KiB/s wr, 55 op/s 2024-09-21T06:14:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:14 smithi089 ceph-mon[33879]: pgmap v418: 129 pgs: 129 active+clean; 3.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 256 KiB/s wr, 55 op/s 2024-09-21T06:14:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:14 smithi017 ceph-mon[31080]: pgmap v418: 129 pgs: 129 active+clean; 3.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 256 KiB/s wr, 55 op/s 2024-09-21T06:14:17.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:16 smithi081 ceph-mon[33870]: pgmap v419: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 249 KiB/s wr, 51 op/s 2024-09-21T06:14:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:16 smithi089 ceph-mon[33879]: pgmap v419: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 249 KiB/s wr, 51 op/s 2024-09-21T06:14:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:16 smithi017 ceph-mon[31080]: pgmap v419: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 249 KiB/s wr, 51 op/s 2024-09-21T06:14:18.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:14:18.526 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:18.928 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:18 smithi017 ceph-mon[31080]: pgmap v420: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 188 KiB/s wr, 37 op/s 2024-09-21T06:14:19.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:18 smithi081 ceph-mon[33870]: pgmap v420: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 188 KiB/s wr, 37 op/s 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 -- 172.21.15.17:0/1258717432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 msgr2=0x7f34b41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 --2- 172.21.15.17:0/1258717432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b41087e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009900 tx=0x7f34a802a410 comp rx=0 tx=0).stop 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 -- 172.21.15.17:0/1258717432 shutdown_connections 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 --2- 172.21.15.17:0/1258717432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b41087e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 --2- 172.21.15.17:0/1258717432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b4108d20 0x7f34b410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 --2- 172.21.15.17:0/1258717432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34b4102ae0 0x7f34b4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 -- 172.21.15.17:0/1258717432 >> 172.21.15.17:0/1258717432 conn(0x7f34b4079760 msgr2=0x7f34b4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 -- 172.21.15.17:0/1258717432 shutdown_connections 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.018+0000 7f34ba351640 1 -- 172.21.15.17:0/1258717432 wait complete. 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.019+0000 7f34ba351640 1 Processor -- start 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.019+0000 7f34ba351640 1 -- start start 2024-09-21T06:14:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.019+0000 7f34ba351640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b4102ae0 0x7f34b410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34ba351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b4110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34ba351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34b4108d20 0x7f34b4110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34ba351640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4113960 con 0x7f34b41083d0 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34ba351640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41137e0 con 0x7f34b4108d20 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34ba351640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4113ae0 con 0x7f34b4102ae0 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b4110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b4110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56660/0 (socket says 172.21.15.17:56660) 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 -- 172.21.15.17:0/3107851840 learned_addr learned my addr 172.21.15.17:0/3107851840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b3fff640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b4102ae0 0x7f34b410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b88ee640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34b4108d20 0x7f34b4110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 -- 172.21.15.17:0/3107851840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b4102ae0 msgr2=0x7f34b410ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b4102ae0 0x7f34b410ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 -- 172.21.15.17:0/3107851840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34b4108d20 msgr2=0x7f34b4110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34b4108d20 0x7f34b4110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 -- 172.21.15.17:0/3107851840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b41a8650 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b37fe640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b4110520 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f34a8005940 tx=0x7f34a8005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a803f030 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34a80043d0 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b41a88e0 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.020+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8035070 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.021+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b41a8dc0 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.021+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4103d10 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.023+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f34a8042030 con 0x7f34b41083d0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.024+0000 7f34b17fa640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f349c0b6510 0x7f349c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.024+0000 7f34b3fff640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f349c0b6510 0x7f349c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.024+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f34a8107ef0 con 0x7f34b41083d0 2024-09-21T06:14:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.024+0000 7f34b3fff640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f349c0b6510 0x7f349c0b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f34b4111a30 tx=0x7f34a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.027+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f34a80ce390 con 0x7f34b41083d0 2024-09-21T06:14:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:18 smithi089 ceph-mon[33879]: pgmap v420: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 188 KiB/s wr, 37 op/s 2024-09-21T06:14:19.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.253+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34b41112e0 con 0x7f34b41083d0 2024-09-21T06:14:19.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.254+0000 7f34b17fa640 1 -- 172.21.15.17:0/3107851840 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11886 (secure 0 0 0) 0x7f34a80d2770 con 0x7f34b41083d0 2024-09-21T06:14:19.257 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:14:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-21T06:14:12:704238+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:14:11.788235+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:14:19.257 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-21T06:14:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f349c0b6510 msgr2=0x7f349c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f349c0b6510 0x7f349c0b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f34b4111a30 tx=0x7f34a4005f90 comp rx=0 tx=0).stop 2024-09-21T06:14:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 msgr2=0x7f34b4110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b4110520 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f34a8005940 tx=0x7f34a8005e30 comp rx=0 tx=0).stop 2024-09-21T06:14:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 shutdown_connections 2024-09-21T06:14:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f349c0b6510 0x7f349c0b8a20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34b41083d0 0x7f34b4110520 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34b4108d20 0x7f34b4110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 --2- 172.21.15.17:0/3107851840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34b4102ae0 0x7f34b410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 >> 172.21.15.17:0/3107851840 conn(0x7f34b4079760 msgr2=0x7f34b4105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.256+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 shutdown_connections 2024-09-21T06:14:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:19.257+0000 7f34ba351640 1 -- 172.21.15.17:0/3107851840 wait complete. 2024-09-21T06:14:19.992 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3107851840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:20.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3107851840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:20.022 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id 5a5276c0 --release --await' 2024-09-21T06:14:20.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id 5a5276c0 --release --await 2024-09-21T06:14:20.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3107851840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 -- 172.21.15.17:0/856066423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4102b40 msgr2=0x7f8da4102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 --2- 172.21.15.17:0/856066423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4102b40 0x7f8da4102f50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009900 tx=0x7f8d9402a410 comp rx=0 tx=0).stop 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 -- 172.21.15.17:0/856066423 shutdown_connections 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 --2- 172.21.15.17:0/856066423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da4108dd0 0x7f8da410f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 --2- 172.21.15.17:0/856066423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4108480 0x7f8da4108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 --2- 172.21.15.17:0/856066423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4102b40 0x7f8da4102f50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 -- 172.21.15.17:0/856066423 >> 172.21.15.17:0/856066423 conn(0x7f8da4079750 msgr2=0x7f8da4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 -- 172.21.15.17:0/856066423 shutdown_connections 2024-09-21T06:14:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.001+0000 7f8da8aff640 1 -- 172.21.15.17:0/856066423 wait complete. 2024-09-21T06:14:21.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:20 smithi017 ceph-mon[31080]: pgmap v421: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-21T06:14:21.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:20 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.002+0000 7f8da8aff640 1 Processor -- start 2024-09-21T06:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.002+0000 7f8da8aff640 1 -- start start 2024-09-21T06:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da8aff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 0x7f8da41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da8aff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da4108480 0x7f8da4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da8aff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4108dd0 0x7f8da419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da8aff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4112850 con 0x7f8da4108dd0 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da8aff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41126d0 con 0x7f8da4108480 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da8aff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41129d0 con 0x7f8da4102b40 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 0x7f8da41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 0x7f8da41992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:37368/0 (socket says 172.21.15.17:37368) 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4108dd0 0x7f8da419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 -- 172.21.15.17:0/176152399 learned_addr learned my addr 172.21.15.17:0/176152399 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da4108480 0x7f8da4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 -- 172.21.15.17:0/176152399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da4108480 msgr2=0x7f8da4199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da4108480 0x7f8da4199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 -- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4108dd0 msgr2=0x7f8da419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4108dd0 0x7f8da419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.003+0000 7f8da259c640 1 -- 172.21.15.17:0/176152399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da419f210 con 0x7f8da4102b40 2024-09-21T06:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.004+0000 7f8da259c640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 0x7f8da41992a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009230 tx=0x7f8d94004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.004+0000 7f8d9b7fe640 1 -- 172.21.15.17:0/176152399 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9403f030 con 0x7f8da4102b40 2024-09-21T06:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.004+0000 7f8d9b7fe640 1 -- 172.21.15.17:0/176152399 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d94003a80 con 0x7f8da4102b40 2024-09-21T06:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.004+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da419f4a0 con 0x7f8da4102b40 2024-09-21T06:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.004+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da406bb40 con 0x7f8da4102b40 2024-09-21T06:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.004+0000 7f8d9b7fe640 1 -- 172.21.15.17:0/176152399 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94035070 con 0x7f8da4102b40 2024-09-21T06:14:21.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:20 smithi081 ceph-mon[33870]: pgmap v421: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-21T06:14:21.010 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:20 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.006+0000 7f8d9b7fe640 1 -- 172.21.15.17:0/176152399 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8d94042030 con 0x7f8da4102b40 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 Processor -- start 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 -- start start 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bc96510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bc96a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8cf840 0x56125bc96f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56125bb81dc0 con 0x56125b8c7660 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56125bc0e1f0 con 0x56125b8f0520 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8daf073740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56125bbfd620 con 0x56125b8cf840 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8da259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bc96a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8da259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bc96a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56688/0 (socket says 172.21.15.17:56688) 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.007+0000 7f8da259c640 1 -- 172.21.15.17:0/2660653619 learned_addr learned my addr 172.21.15.17:0/2660653619 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bc96510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8cf840 0x56125bc96f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9b7fe640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8d900b6590 0x7f8d900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 -- 172.21.15.17:0/2660653619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 msgr2=0x56125bc96510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bc96510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 -- 172.21.15.17:0/2660653619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 msgr2=0x56125bc96a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bc96a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 -- 172.21.15.17:0/2660653619 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125bbc5fd0 con 0x56125b8cf840 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8da259c640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bc96a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bc96510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9b7fe640 1 -- 172.21.15.17:0/176152399 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f8d94107b50 con 0x7f8da4102b40 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8d900b6590 0x7f8d900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.008+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8cf840 0x56125bc96f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8da406b660 tx=0x7f8d8c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2bd76257e3c0b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.009+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8d900b6590 0x7f8d900b8aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009fd0 tx=0x7f8d9c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.009+0000 7f8d98ff9640 1 -- 172.21.15.17:0/2660653619 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c004230 con 0x56125b8cf840 2024-09-21T06:14:21.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.009+0000 7f8d98ff9640 1 -- 172.21.15.17:0/2660653619 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d8c009e10 con 0x56125b8cf840 2024-09-21T06:14:21.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.009+0000 7f8d98ff9640 1 -- 172.21.15.17:0/2660653619 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c004ba0 con 0x56125b8cf840 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 -- 172.21.15.17:0/2660653619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8cf840 msgr2=0x56125bc96f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8cf840 0x56125bc96f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8da406b660 tx=0x7f8d8c011810 comp rx=0 tx=0).stop 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 -- 172.21.15.17:0/2660653619 shutdown_connections 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bc96a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8cf840 0x56125bc96f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 --2- 172.21.15.17:0/2660653619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bc96510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 -- 172.21.15.17:0/2660653619 >> 172.21.15.17:0/2660653619 conn(0x56125b8e4910 msgr2=0x56125bc94400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 -- 172.21.15.17:0/2660653619 shutdown_connections 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 -- 172.21.15.17:0/2660653619 wait complete. 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.010+0000 7f8daf073740 1 -- start start 2024-09-21T06:14:21.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 Processor -- start 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bca5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bca6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8f0520 0x56125bca6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56125bb98300 con 0x56125b8c7660 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56125bc01430 con 0x56125b8cf840 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56125ba5ebb0 con 0x56125b8f0520 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8daf073740 10 client.0 _ll_register_callbacks cb 0x56125bbb2120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8da259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bca5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8da259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bca5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56696/0 (socket says 172.21.15.17:56696) 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8da259c640 1 -- 172.21.15.17:0/1647249270 learned_addr learned my addr 172.21.15.17:0/1647249270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8f0520 0x56125bca6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.011+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bca6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8da259c640 1 -- 172.21.15.17:0/1647249270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8f0520 msgr2=0x56125bca6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8da259c640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8f0520 0x56125bca6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8da259c640 1 -- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 msgr2=0x56125bca6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8da259c640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bca6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8da259c640 1 -- 172.21.15.17:0/1647249270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125bb87780 con 0x56125b8c7660 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bca6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8da259c640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bca5ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8d94105310 tx=0x7f8d940f10b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d41389234e7c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8d89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1647249270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94049040 con 0x56125b8c7660 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1647249270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f8d9403bc50 con 0x56125b8c7660 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d8c009e10 con 0x56125b8c7660 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1647249270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d940cd170 con 0x56125b8c7660 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8daf073740 10 client.15585 fetch_fsmap learned FSMap version 27 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.012+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56125b95bb00 con 0x56125b8c7660 2024-09-21T06:14:21.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1647249270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d8c009e10 con 0x56125b8c7660 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1647249270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8d940d2020 con 0x56125b8c7660 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8daf073740 10 client.15585 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8daf073740 10 client.15585 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8daf073740 20 client.15585 populate_metadata read hostname 'smithi017' 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8daf073740 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b8aeea0 0x56125bcb82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8daf073740 4 client.15585 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56125bc10140 con 0x56125b8aeea0 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.013+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b8aeea0 0x56125bcb82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b8aeea0 0x56125bcb82d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d3ed04cb8c113ea server_cookie=5c4e7bbed8077ea in_seq=0 out_seq=0 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8d89ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1647249270 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56125bc10140 con 0x56125b8aeea0 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8d89ffb640 10 client.15585 handle_command_reply: tid=0 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8daf073740 1 client.15585 shutdown 2024-09-21T06:14:21.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 msgr2=0x56125bca5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.014+0000 7f8daf073740 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bca5ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8d94105310 tx=0x7f8d940f10b0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 shutdown_connections 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b8aeea0 0x56125bcb82d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8f0520 0x56125bca6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bca6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 --2- 172.21.15.17:0/1647249270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8c7660 0x56125bca5ed0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 >> 172.21.15.17:0/1647249270 conn(0x56125b8e4910 msgr2=0x56125bc92930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8d89ffb640 0 client.15585 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 shutdown_connections 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 1 -- 172.21.15.17:0/1647249270 wait complete. 2024-09-21T06:14:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.015+0000 7f8daf073740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T06:14:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.032+0000 7f8daf073740 1 Processor -- start 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.032+0000 7f8daf073740 1 -- start start 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.032+0000 7f8daf073740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bca1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.032+0000 7f8daf073740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 0x56125bc97c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.032+0000 7f8daf073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bca30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8daf073740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84012440 con 0x56125b8cf840 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8daf073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8400fd10 con 0x56125b8f0520 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8daf073740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8400db60 con 0x56125b8c7660 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 0x56125bc97c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 0x56125bc97c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56710/0 (socket says 172.21.15.17:56710) 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 -- 172.21.15.17:0/3994859352 learned_addr learned my addr 172.21.15.17:0/3994859352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8da259c640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bca1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bca30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 -- 172.21.15.17:0/3994859352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 msgr2=0x56125bca1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bca1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 -- 172.21.15.17:0/3994859352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 msgr2=0x56125bca30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bca30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 -- 172.21.15.17:0/3994859352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125b9d2960 con 0x56125b8cf840 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8da259c640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bca1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bca30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.033+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 0x56125bc97c50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009710 tx=0x7f8d8c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb019f85e337273 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8d8bfff640 1 -- 172.21.15.17:0/3994859352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c031070 con 0x56125b8cf840 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8d8bfff640 1 -- 172.21.15.17:0/3994859352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d8c0046c0 con 0x56125b8cf840 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8d8bfff640 1 -- 172.21.15.17:0/3994859352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c01e040 con 0x56125b8cf840 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8daf073740 1 -- 172.21.15.17:0/3994859352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 msgr2=0x56125bc97c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8daf073740 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 0x56125bc97c50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009710 tx=0x7f8d8c009900 comp rx=0 tx=0).stop 2024-09-21T06:14:21.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8daf073740 1 -- 172.21.15.17:0/3994859352 shutdown_connections 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8daf073740 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8cf840 0x56125bc97c50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8daf073740 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8f0520 0x56125bca30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.034+0000 7f8daf073740 1 --2- 172.21.15.17:0/3994859352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bca1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.035+0000 7f8daf073740 1 -- 172.21.15.17:0/3994859352 >> 172.21.15.17:0/3994859352 conn(0x56125b8e4910 msgr2=0x56125bc97540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.035+0000 7f8daf073740 1 -- 172.21.15.17:0/3994859352 shutdown_connections 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.035+0000 7f8daf073740 1 -- 172.21.15.17:0/3994859352 wait complete. 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.035+0000 7f8daf073740 1 -- start start 2024-09-21T06:14:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.035+0000 7f8daf073740 1 Processor -- start 2024-09-21T06:14:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bcae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bcae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 0x56125bca9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8400e1d0 con 0x56125b8f0520 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8400f640 con 0x56125b8cf840 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8400e8a0 con 0x56125b8c7660 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 0x56125bca9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8daf073740 10 client.0 _ll_register_callbacks cb 0x7f8d940c9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8d9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bcae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bcae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8d9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bcae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:52650/0 (socket says 172.21.15.17:52650) 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bcae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:37410/0 (socket says 172.21.15.17:37410) 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8d9bfff640 1 -- 172.21.15.17:0/1127398188 learned_addr learned my addr 172.21.15.17:0/1127398188 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 0x56125bca9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56722/0 (socket says 172.21.15.17:56722) 2024-09-21T06:14:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 -- 172.21.15.17:0/1127398188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 msgr2=0x56125bcae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bcae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 -- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 msgr2=0x56125bcae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bcae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 -- 172.21.15.17:0/1127398188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125bca9690 con 0x56125b8f0520 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8d9bfff640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bcae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da259c640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bcae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8da2d9d640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 0x56125bca9150 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005fd0 tx=0x7f8d9c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ea0799ad8b0c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.036+0000 7f8d89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1127398188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c012980 con 0x56125b8f0520 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1127398188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f8d9c018070 con 0x56125b8f0520 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56125bc0bbf0 con 0x56125b8f0520 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1127398188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c032050 con 0x56125b8f0520 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8daf073740 10 client.15591 fetch_fsmap learned FSMap version 27 2024-09-21T06:14:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56125bd23410 con 0x56125b8f0520 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1127398188 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56125bc0bbf0 con 0x56125b8f0520 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1127398188 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8d9c00f040 con 0x56125b8f0520 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8daf073740 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.037+0000 7f8daf073740 10 client.15591 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8daf073740 20 client.15591 populate_metadata read hostname 'smithi017' 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8daf073740 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b884250 0x56125bd25c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8daf073740 4 client.15591 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5a5276c0", "release": true, "await": true}] 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5a5276c0", "release": true, "await": true}) -- 0x56125bc09020 con 0x56125b884250 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8da259c640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b884250 0x56125bd25c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8d89ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.038+0000 7f8da259c640 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b884250 0x56125bd25c60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce4d7f064a6a6f7c server_cookie=bb689e34b535248 in_seq=0 out_seq=0 2024-09-21T06:14:21.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.043+0000 7f8d89ffb640 1 -- 172.21.15.17:0/1127398188 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56125bc09020 con 0x56125b884250 2024-09-21T06:14:21.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.043+0000 7f8d89ffb640 10 client.15591 handle_command_reply: tid=0 2024-09-21T06:14:21.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.043+0000 7f8daf073740 1 client.15591 shutdown 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 msgr2=0x56125bca9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 0x56125bca9150 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005fd0 tx=0x7f8d9c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 shutdown_connections 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56125b884250 0x56125bd25c60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56125b8f0520 0x56125bca9150 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56125b8cf840 0x56125bcae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8d89ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 --2- 172.21.15.17:0/1127398188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56125b8c7660 0x56125bcae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 >> 172.21.15.17:0/1127398188 conn(0x56125b8e4910 msgr2=0x56125bc97f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 shutdown_connections 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 1 -- 172.21.15.17:0/1127398188 wait complete. 2024-09-21T06:14:21.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.044+0000 7f8daf073740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 27, 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 8, 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "5a5276c0": { 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 8, 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:14:21.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 137.0, 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:14:21.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:21.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:14:21.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8d900b6590 msgr2=0x7f8d900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8d900b6590 0x7f8d900b8aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009fd0 tx=0x7f8d9c004a40 comp rx=0 tx=0).stop 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 msgr2=0x7f8da41992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 0x7f8da41992a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009230 tx=0x7f8d94004270 comp rx=0 tx=0).stop 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 shutdown_connections 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f8d900b6590 0x7f8d900b8aa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da4108dd0 0x7f8da419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da4108480 0x7f8da4199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 --2- 172.21.15.17:0/176152399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da4102b40 0x7f8da41992a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 >> 172.21.15.17:0/176152399 conn(0x7f8da4079750 msgr2=0x7f8da41016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 shutdown_connections 2024-09-21T06:14:21.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:21.045+0000 7f8da8aff640 1 -- 172.21.15.17:0/176152399 wait complete. 2024-09-21T06:14:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:20 smithi089 ceph-mon[33879]: pgmap v421: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-21T06:14:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:20 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:21.123 INFO:tasks.workunit.client.0.smithi017.stdout:checking for int... yes 2024-09-21T06:14:21.224 INFO:tasks.workunit.client.0.smithi017.stdout:checking size of int... 4 2024-09-21T06:14:21.295 INFO:tasks.workunit.client.0.smithi017.stdout:checking for long... yes 2024-09-21T06:14:21.396 INFO:tasks.workunit.client.0.smithi017.stdout:checking size of long... 8 2024-09-21T06:14:21.466 INFO:tasks.workunit.client.0.smithi017.stdout:checking for long long... yes 2024-09-21T06:14:21.567 INFO:tasks.workunit.client.0.smithi017.stdout:checking size of long long... 8 2024-09-21T06:14:21.637 INFO:tasks.workunit.client.0.smithi017.stdout:checking for ssize_t... yes 2024-09-21T06:14:21.695 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sig_atomic_t... yes 2024-09-21T06:14:21.871 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether gcc needs -traditional... no 2024-09-21T06:14:21.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:21.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:21.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:14:21.932 INFO:tasks.workunit.client.0.smithi017.stdout:checking for an ANSI C-conforming const... yes 2024-09-21T06:14:21.969 INFO:tasks.workunit.client.0.smithi017.stdout:checking for inline... inline 2024-09-21T06:14:22.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:22.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:22.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:14:22.059 INFO:tasks.workunit.client.0.smithi017.stdout:checking for working alloca.h... yes 2024-09-21T06:14:22.079 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5a5276c0', total seconds elapsed: 20.8 2024-09-21T06:14:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:14:22.141 INFO:tasks.workunit.client.0.smithi017.stdout:checking for alloca... yes 2024-09-21T06:14:22.233 INFO:tasks.workunit.client.0.smithi017.stdout:checking for working memcmp... yes 2024-09-21T06:14:22.325 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strftime... yes 2024-09-21T06:14:22.444 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-21T06:14:22.540 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether stat accepts an empty string... no 2024-09-21T06:14:22.632 INFO:tasks.workunit.client.0.smithi017.stdout:checking for vprintf... yes 2024-09-21T06:14:22.729 INFO:tasks.workunit.client.0.smithi017.stdout:checking for _doprnt... no 2024-09-21T06:14:22.764 INFO:tasks.workunit.client.0.smithi017.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-21T06:14:22.780 INFO:tasks.workunit.client.0.smithi017.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-21T06:14:22.871 INFO:tasks.workunit.client.0.smithi017.stdout:checking for the pthreads library -lpthreads... no 2024-09-21T06:14:22.950 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether pthreads work without any flags... yes 2024-09-21T06:14:23.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:22 smithi081 ceph-mon[33870]: pgmap v422: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-21T06:14:23.021 INFO:tasks.workunit.client.0.smithi017.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-21T06:14:23.021 INFO:tasks.workunit.client.0.smithi017.stdout:checking if more special flags are required for pthreads... no 2024-09-21T06:14:23.022 INFO:tasks.workunit.client.0.smithi017.stdout:checking for cc_r... gcc 2024-09-21T06:14:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:22 smithi089 ceph-mon[33879]: pgmap v422: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-21T06:14:23.118 INFO:tasks.workunit.client.0.smithi017.stdout:checking for setrlimit... yes 2024-09-21T06:14:23.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:22 smithi017 ceph-mon[31080]: pgmap v422: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-21T06:14:23.216 INFO:tasks.workunit.client.0.smithi017.stdout:checking for setproctitle... no 2024-09-21T06:14:23.310 INFO:tasks.workunit.client.0.smithi017.stdout:checking for getopt_long... yes 2024-09-21T06:14:23.406 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strtoull... yes 2024-09-21T06:14:23.509 INFO:tasks.workunit.client.0.smithi017.stdout:checking for strtoq... yes 2024-09-21T06:14:23.610 INFO:tasks.workunit.client.0.smithi017.stdout:checking for snprintf... yes 2024-09-21T06:14:23.723 INFO:tasks.workunit.client.0.smithi017.stdout:checking for vsnprintf... yes 2024-09-21T06:14:23.824 INFO:tasks.workunit.client.0.smithi017.stdout:checking for vfprintf... yes 2024-09-21T06:14:23.921 INFO:tasks.workunit.client.0.smithi017.stdout:checking for gethostname... yes 2024-09-21T06:14:24.019 INFO:tasks.workunit.client.0.smithi017.stdout:checking for setlocale... yes 2024-09-21T06:14:24.123 INFO:tasks.workunit.client.0.smithi017.stdout:checking for sync... yes 2024-09-21T06:14:24.220 INFO:tasks.workunit.client.0.smithi017.stdout:checking whether snprintf is C99 conformant... done 2024-09-21T06:14:24.240 INFO:tasks.workunit.client.0.smithi017.stdout:configure: creating ./config.status 2024-09-21T06:14:24.502 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating Makefile 2024-09-21T06:14:24.533 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating src/Makefile 2024-09-21T06:14:25.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:24 smithi081 ceph-mon[33870]: pgmap v423: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7.5 KiB/s wr, 9 op/s 2024-09-21T06:14:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:24 smithi089 ceph-mon[33879]: pgmap v423: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7.5 KiB/s wr, 9 op/s 2024-09-21T06:14:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:24 smithi017 ceph-mon[31080]: pgmap v423: 129 pgs: 129 active+clean; 3.4 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7.5 KiB/s wr, 9 op/s 2024-09-21T06:14:27.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:26 smithi081 ceph-mon[33870]: pgmap v424: 129 pgs: 129 active+clean; 3.6 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-09-21T06:14:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:26 smithi089 ceph-mon[33879]: pgmap v424: 129 pgs: 129 active+clean; 3.6 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-09-21T06:14:27.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:26 smithi017 ceph-mon[31080]: pgmap v424: 129 pgs: 129 active+clean; 3.6 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-09-21T06:14:29.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:28 smithi081 ceph-mon[33870]: pgmap v425: 129 pgs: 129 active+clean; 5.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 202 KiB/s wr, 64 op/s 2024-09-21T06:14:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:28 smithi089 ceph-mon[33879]: pgmap v425: 129 pgs: 129 active+clean; 5.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 202 KiB/s wr, 64 op/s 2024-09-21T06:14:29.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:28 smithi017 ceph-mon[31080]: pgmap v425: 129 pgs: 129 active+clean; 5.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 202 KiB/s wr, 64 op/s 2024-09-21T06:14:31.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:30 smithi081 ceph-mon[33870]: pgmap v426: 129 pgs: 129 active+clean; 5.2 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 210 KiB/s wr, 69 op/s 2024-09-21T06:14:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:30 smithi089 ceph-mon[33879]: pgmap v426: 129 pgs: 129 active+clean; 5.2 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 210 KiB/s wr, 69 op/s 2024-09-21T06:14:31.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:30 smithi017 ceph-mon[31080]: pgmap v426: 129 pgs: 129 active+clean; 5.2 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 210 KiB/s wr, 69 op/s 2024-09-21T06:14:31.818 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating man/Makefile 2024-09-21T06:14:33.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:32 smithi081 ceph-mon[33870]: pgmap v427: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 215 KiB/s wr, 72 op/s 2024-09-21T06:14:33.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:32 smithi089 ceph-mon[33879]: pgmap v427: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 215 KiB/s wr, 72 op/s 2024-09-21T06:14:33.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:32 smithi017 ceph-mon[31080]: pgmap v427: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 215 KiB/s wr, 72 op/s 2024-09-21T06:14:35.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:34 smithi081 ceph-mon[33870]: pgmap v428: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 214 KiB/s wr, 71 op/s 2024-09-21T06:14:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:34 smithi089 ceph-mon[33879]: pgmap v428: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 214 KiB/s wr, 71 op/s 2024-09-21T06:14:35.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:34 smithi017 ceph-mon[31080]: pgmap v428: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 214 KiB/s wr, 71 op/s 2024-09-21T06:14:36.807 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: creating config.h 2024-09-21T06:14:37.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:36 smithi081 ceph-mon[33870]: pgmap v429: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 211 KiB/s wr, 69 op/s 2024-09-21T06:14:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:36 smithi089 ceph-mon[33879]: pgmap v429: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 211 KiB/s wr, 69 op/s 2024-09-21T06:14:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:36 smithi017 ceph-mon[31080]: pgmap v429: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 211 KiB/s wr, 69 op/s 2024-09-21T06:14:37.767 INFO:tasks.workunit.client.0.smithi017.stdout:config.status: executing depfiles commands 2024-09-21T06:14:37.989 INFO:tasks.workunit.client.0.smithi017.stderr:+ make 2024-09-21T06:14:38.011 INFO:tasks.workunit.client.0.smithi017.stdout:make all-recursive 2024-09-21T06:14:38.021 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T06:14:38.025 INFO:tasks.workunit.client.0.smithi017.stdout:Making all in src 2024-09-21T06:14:38.058 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-21T06:14:38.058 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-21T06:14:38.058 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-21T06:14:38.190 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-21T06:14:38.190 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-21T06:14:38.395 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-21T06:14:38.395 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-21T06:14:38.588 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-21T06:14:38.588 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-21T06:14:38.772 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-21T06:14:38.772 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-21T06:14:38.958 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-21T06:14:38.959 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-21T06:14:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:38 smithi089 ceph-mon[33879]: pgmap v430: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 196 KiB/s wr, 57 op/s 2024-09-21T06:14:39.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:38 smithi017 ceph-mon[31080]: pgmap v430: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 196 KiB/s wr, 57 op/s 2024-09-21T06:14:39.138 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-21T06:14:39.138 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-21T06:14:39.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:38 smithi081 ceph-mon[33870]: pgmap v430: 129 pgs: 129 active+clean; 5.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 196 KiB/s wr, 57 op/s 2024-09-21T06:14:39.342 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-21T06:14:39.342 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-21T06:14:39.504 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-21T06:14:39.504 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-21T06:14:39.680 INFO:tasks.workunit.client.0.smithi017.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-21T06:14:39.680 INFO:tasks.workunit.client.0.smithi017.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-21T06:14:39.796 INFO:tasks.workunit.client.0.smithi017.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-21T06:14:39.871 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-21T06:14:39.878 INFO:tasks.workunit.client.0.smithi017.stdout:Making all in man 2024-09-21T06:14:39.891 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-21T06:14:39.891 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Nothing to be done for 'all'. 2024-09-21T06:14:39.891 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-21T06:14:39.899 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T06:14:39.902 INFO:tasks.workunit.client.0.smithi017.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T06:14:39.903 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-21T06:14:39.903 INFO:tasks.workunit.client.0.smithi017.stderr:+ cd src 2024-09-21T06:14:39.905 INFO:tasks.workunit.client.0.smithi017.stderr:+ mkdir blogtest_in 2024-09-21T06:14:39.909 INFO:tasks.workunit.client.0.smithi017.stdout:running blogbench 2024-09-21T06:14:39.910 INFO:tasks.workunit.client.0.smithi017.stderr:+ echo 'running blogbench' 2024-09-21T06:14:39.910 INFO:tasks.workunit.client.0.smithi017.stderr:+ ./blogbench -d blogtest_in 2024-09-21T06:14:39.910 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-21T06:14:39.910 INFO:tasks.workunit.client.0.smithi017.stdout:Frequency = 10 secs 2024-09-21T06:14:39.910 INFO:tasks.workunit.client.0.smithi017.stdout:Scratch dir = [blogtest_in] 2024-09-21T06:14:40.463 INFO:tasks.workunit.client.0.smithi017.stdout:Spawning 3 writers... 2024-09-21T06:14:40.463 INFO:tasks.workunit.client.0.smithi017.stdout:Spawning 1 rewriters... 2024-09-21T06:14:40.463 INFO:tasks.workunit.client.0.smithi017.stdout:Spawning 5 commenters... 2024-09-21T06:14:40.463 INFO:tasks.workunit.client.0.smithi017.stdout:Spawning 100 readers... 2024-09-21T06:14:40.466 INFO:tasks.workunit.client.0.smithi017.stdout:Benchmarking for 30 iterations. 2024-09-21T06:14:40.466 INFO:tasks.workunit.client.0.smithi017.stdout:The test will run during 5 minutes. 2024-09-21T06:14:40.466 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-21T06:14:40.466 INFO:tasks.workunit.client.0.smithi017.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-21T06:14:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:40 smithi089 ceph-mon[33879]: pgmap v431: 129 pgs: 129 active+clean; 5.2 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-21T06:14:41.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:40 smithi017 ceph-mon[31080]: pgmap v431: 129 pgs: 129 active+clean; 5.2 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-21T06:14:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:40 smithi081 ceph-mon[33870]: pgmap v431: 129 pgs: 129 active+clean; 5.2 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-21T06:14:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:42 smithi089 ceph-mon[33879]: pgmap v432: 129 pgs: 129 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-21T06:14:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:42 smithi017 ceph-mon[31080]: pgmap v432: 129 pgs: 129 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-21T06:14:43.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:42 smithi081 ceph-mon[33870]: pgmap v432: 129 pgs: 129 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-21T06:14:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:43 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:14:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:43 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:14:44.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:43 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:14:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:44 smithi089 ceph-mon[33879]: pgmap v433: 129 pgs: 129 active+clean; 8.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-09-21T06:14:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:44 smithi017 ceph-mon[31080]: pgmap v433: 129 pgs: 129 active+clean; 8.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-09-21T06:14:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:44 smithi081 ceph-mon[33870]: pgmap v433: 129 pgs: 129 active+clean; 8.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-09-21T06:14:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:46 smithi089 ceph-mon[33879]: pgmap v434: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 632 KiB/s wr, 55 op/s 2024-09-21T06:14:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:46 smithi017 ceph-mon[31080]: pgmap v434: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 632 KiB/s wr, 55 op/s 2024-09-21T06:14:47.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:46 smithi081 ceph-mon[33870]: pgmap v434: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 632 KiB/s wr, 55 op/s 2024-09-21T06:14:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:48 smithi089 ceph-mon[33879]: pgmap v435: 129 pgs: 129 active+clean; 19 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-21T06:14:49.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:48 smithi017 ceph-mon[31080]: pgmap v435: 129 pgs: 129 active+clean; 19 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-21T06:14:49.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:48 smithi081 ceph-mon[33870]: pgmap v435: 129 pgs: 129 active+clean; 19 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-21T06:14:50.466 INFO:tasks.workunit.client.0.smithi017.stdout: 3 11757 411 7057 204 2498 385 2024-09-21T06:14:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:50 smithi089 ceph-mon[33879]: pgmap v436: 129 pgs: 129 active+clean; 21 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-21T06:14:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:50 smithi017 ceph-mon[31080]: pgmap v436: 129 pgs: 129 active+clean; 21 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-21T06:14:51.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:50 smithi081 ceph-mon[33870]: pgmap v436: 129 pgs: 129 active+clean; 21 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-21T06:14:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:52 smithi089 ceph-mon[33879]: pgmap v437: 129 pgs: 129 active+clean; 23 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-09-21T06:14:53.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:52 smithi017 ceph-mon[31080]: pgmap v437: 129 pgs: 129 active+clean; 23 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-09-21T06:14:53.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:52 smithi081 ceph-mon[33870]: pgmap v437: 129 pgs: 129 active+clean; 23 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.7 MiB/s wr, 120 op/s 2024-09-21T06:14:53.651 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T06:14:53.651 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T06:14:53.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:14:54.053 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 -- 172.21.15.17:0/189412943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504102ae0 msgr2=0x7f2504102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 --2- 172.21.15.17:0/189412943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504102ae0 0x7f2504102ef0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009900 tx=0x7f24f402a410 comp rx=0 tx=0).stop 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 -- 172.21.15.17:0/189412943 shutdown_connections 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 --2- 172.21.15.17:0/189412943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 0x7f250410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 --2- 172.21.15.17:0/189412943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25041083d0 0x7f25041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 --2- 172.21.15.17:0/189412943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504102ae0 0x7f2504102ef0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 -- 172.21.15.17:0/189412943 >> 172.21.15.17:0/189412943 conn(0x7f2504079760 msgr2=0x7f2504079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 -- 172.21.15.17:0/189412943 shutdown_connections 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.620+0000 7f2508849640 1 -- 172.21.15.17:0/189412943 wait complete. 2024-09-21T06:14:54.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.621+0000 7f2508849640 1 Processor -- start 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.621+0000 7f2508849640 1 -- start start 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2508849640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2504102ae0 0x7f2504105e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2508849640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 0x7f2504104440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2508849640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 0x7f2504104980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2508849640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112890 con 0x7f25041083d0 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2508849640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112710 con 0x7f2504108d20 2024-09-21T06:14:54.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2508849640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112a10 con 0x7f2504102ae0 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2501d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 0x7f2504104440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2501d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 0x7f2504104440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44486/0 (socket says 172.21.15.17:44486) 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2501d9b640 1 -- 172.21.15.17:0/97491147 learned_addr learned my addr 172.21.15.17:0/97491147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2502d9d640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 0x7f2504104980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f250259c640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2504102ae0 0x7f2504105e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2502d9d640 1 -- 172.21.15.17:0/97491147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2504102ae0 msgr2=0x7f2504105e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2502d9d640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2504102ae0 0x7f2504105e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2502d9d640 1 -- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 msgr2=0x7f2504104440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.622+0000 7f2502d9d640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 0x7f2504104440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f2502d9d640 1 -- 172.21.15.17:0/97491147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041051a0 con 0x7f2504108d20 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f2501d9b640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 0x7f2504104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:54.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f2502d9d640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 0x7f2504104980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009fd0 tx=0x7f24fc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:54.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00ce20 con 0x7f2504108d20 2024-09-21T06:14:54.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24fc005020 con 0x7f2504108d20 2024-09-21T06:14:54.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041ace10 con 0x7f2504108d20 2024-09-21T06:14:54.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041ad310 con 0x7f2504108d20 2024-09-21T06:14:54.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.623+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc010690 con 0x7f2504108d20 2024-09-21T06:14:54.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.625+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2504102ef0 con 0x7f2504108d20 2024-09-21T06:14:54.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.626+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f24fc004a40 con 0x7f2504108d20 2024-09-21T06:14:54.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.627+0000 7f24f37fe640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24ec0b6590 0x7f24ec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.627+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f24fc0e7bf0 con 0x7f2504108d20 2024-09-21T06:14:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.627+0000 7f250259c640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24ec0b6590 0x7f24ec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.628+0000 7f250259c640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24ec0b6590 0x7f24ec0b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f250419e320 tx=0x7f24f4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:54.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.632+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24fc0ae090 con 0x7f2504108d20 2024-09-21T06:14:54.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.963+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25041ad780 con 0x7f2504108d20 2024-09-21T06:14:54.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.964+0000 7f24f37fe640 1 -- 172.21.15.17:0/97491147 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11889 (secure 0 0 0) 0x7f24fc0b2470 con 0x7f2504108d20 2024-09-21T06:14:54.966 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:14:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-21T06:14:54.967 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-21T06:14:42:761166+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:14:42.746390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:14:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24ec0b6590 msgr2=0x7f24ec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24ec0b6590 0x7f24ec0b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f250419e320 tx=0x7f24f4000bc0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 msgr2=0x7f2504104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 0x7f2504104980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009fd0 tx=0x7f24fc00ef10 comp rx=0 tx=0).stop 2024-09-21T06:14:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 shutdown_connections 2024-09-21T06:14:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f24ec0b6590 0x7f24ec0b8aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25041083d0 0x7f2504104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2504108d20 0x7f2504104980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 --2- 172.21.15.17:0/97491147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2504102ae0 0x7f2504105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 >> 172.21.15.17:0/97491147 conn(0x7f2504079760 msgr2=0x7f25041067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 shutdown_connections 2024-09-21T06:14:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:54.967+0000 7f2508849640 1 -- 172.21.15.17:0/97491147 wait complete. 2024-09-21T06:14:55.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:54 smithi089 ceph-mon[33879]: pgmap v438: 129 pgs: 129 active+clean; 28 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-21T06:14:55.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:54 smithi017 ceph-mon[31080]: pgmap v438: 129 pgs: 129 active+clean; 28 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-21T06:14:55.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:54 smithi081 ceph-mon[33870]: pgmap v438: 129 pgs: 129 active+clean; 28 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 2.1 MiB/s wr, 130 op/s 2024-09-21T06:14:56.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:55 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/97491147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:56.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:55 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/97491147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:56.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:55 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/97491147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:14:57.057 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:56 smithi017 ceph-mon[31080]: pgmap v439: 129 pgs: 129 active+clean; 29 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-21T06:14:57.059 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T06:14:57.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T06:14:57.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:56 smithi089 ceph-mon[33879]: pgmap v439: 129 pgs: 129 active+clean; 29 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-21T06:14:57.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:56 smithi081 ceph-mon[33870]: pgmap v439: 129 pgs: 129 active+clean; 29 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-21T06:14:57.446 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:57.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.988+0000 7f18e959a640 1 -- 172.21.15.17:0/3753994573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc031800 con 0x7f18ec102a80 2024-09-21T06:14:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.989+0000 7f18f0fec640 1 -- 172.21.15.17:0/3753994573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 msgr2=0x7f18ec102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.989+0000 7f18f0fec640 1 --2- 172.21.15.17:0/3753994573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec102e90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009900 tx=0x7f18dc02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:14:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 -- 172.21.15.17:0/3753994573 shutdown_connections 2024-09-21T06:14:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 --2- 172.21.15.17:0/3753994573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec108d10 0x7f18ec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 --2- 172.21.15.17:0/3753994573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec1083c0 0x7f18ec1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 --2- 172.21.15.17:0/3753994573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec102e90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 -- 172.21.15.17:0/3753994573 >> 172.21.15.17:0/3753994573 conn(0x7f18ec079760 msgr2=0x7f18ec079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 -- 172.21.15.17:0/3753994573 shutdown_connections 2024-09-21T06:14:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.990+0000 7f18f0fec640 1 -- 172.21.15.17:0/3753994573 wait complete. 2024-09-21T06:14:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 Processor -- start 2024-09-21T06:14:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 -- start start 2024-09-21T06:14:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec1083c0 0x7f18ec198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec108d10 0x7f18ec19da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec1981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44494/0 (socket says 172.21.15.17:44494) 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18ea59c640 1 -- 172.21.15.17:0/4002822527 learned_addr learned my addr 172.21.15.17:0/4002822527 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec111730 con 0x7f18ec102a80 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec1083c0 0x7f18ec198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1115b0 con 0x7f18ec108d10 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.991+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1118b0 con 0x7f18ec1083c0 2024-09-21T06:14:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18ead9d640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec108d10 0x7f18ec19da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18e9d9b640 1 -- 172.21.15.17:0/4002822527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec108d10 msgr2=0x7f18ec19da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec108d10 0x7f18ec19da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18e9d9b640 1 -- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 msgr2=0x7f18ec1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18e9d9b640 1 -- 172.21.15.17:0/4002822527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec19e090 con 0x7f18ec1083c0 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18ead9d640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec108d10 0x7f18ec19da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18ea59c640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.992+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec1083c0 0x7f18ec198780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f18e0010aa0 tx=0x7f18e0010f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.993+0000 7f18db7fe640 1 -- 172.21.15.17:0/4002822527 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e000ea80 con 0x7f18ec1083c0 2024-09-21T06:14:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.993+0000 7f18db7fe640 1 -- 172.21.15.17:0/4002822527 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18e001a070 con 0x7f18ec1083c0 2024-09-21T06:14:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.993+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec19e380 con 0x7f18ec1083c0 2024-09-21T06:14:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.993+0000 7f18db7fe640 1 -- 172.21.15.17:0/4002822527 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0009390 con 0x7f18ec1083c0 2024-09-21T06:14:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.993+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec19e850 con 0x7f18ec1083c0 2024-09-21T06:14:57.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.996+0000 7f18db7fe640 1 -- 172.21.15.17:0/4002822527 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f18e0015410 con 0x7f18ec1083c0 2024-09-21T06:14:57.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.996+0000 7f18f7560740 1 Processor -- start 2024-09-21T06:14:57.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 -- start start 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b88a840 0x55df3bc31600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc31b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc32080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55df3bba7b90 con 0x55df3b869b60 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55df3bb96fc0 con 0x55df3b88a840 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18f7560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55df3bb9add0 con 0x55df3b861980 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18e9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc32080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:57.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18e9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc32080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44502/0 (socket says 172.21.15.17:44502) 2024-09-21T06:14:58.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18e9d9b640 1 -- 172.21.15.17:0/515020679 learned_addr learned my addr 172.21.15.17:0/515020679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:58.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18ea59c640 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc31b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.997+0000 7f18ead9d640 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b88a840 0x55df3bc31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18db7fe640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f18d40b65c0 0x7f18d40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ea59c640 1 -- 172.21.15.17:0/515020679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b88a840 msgr2=0x55df3bc31600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ea59c640 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b88a840 0x55df3bc31600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ea59c640 1 -- 172.21.15.17:0/515020679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 msgr2=0x55df3bc32080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ea59c640 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc32080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ea59c640 1 -- 172.21.15.17:0/515020679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3bb1e060 con 0x55df3b861980 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ead9d640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f18d40b65c0 0x7f18d40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18db7fe640 1 -- 172.21.15.17:0/4002822527 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f18e00e75c0 con 0x7f18ec1083c0 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.998+0000 7f18ea59c640 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc31b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0057c0 tx=0x7f18dc0314b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba761ab455f79b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.999+0000 7f18d8ff9640 1 -- 172.21.15.17:0/515020679 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc035070 con 0x55df3b861980 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.999+0000 7f18d8ff9640 1 -- 172.21.15.17:0/515020679 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18dc0044c0 con 0x55df3b861980 2024-09-21T06:14:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:57.999+0000 7f18d8ff9640 1 -- 172.21.15.17:0/515020679 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc045470 con 0x55df3b861980 2024-09-21T06:14:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 -- 172.21.15.17:0/515020679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 msgr2=0x55df3bc31b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc31b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0057c0 tx=0x7f18dc0314b0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18ead9d640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f18d40b65c0 0x7f18d40b8ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18e40109a0 tx=0x7f18e4004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 -- 172.21.15.17:0/515020679 shutdown_connections 2024-09-21T06:14:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc32080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc31b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 --2- 172.21.15.17:0/515020679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b88a840 0x55df3bc31600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 -- 172.21.15.17:0/515020679 >> 172.21.15.17:0/515020679 conn(0x55df3b87e990 msgr2=0x55df3bc2f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 -- 172.21.15.17:0/515020679 shutdown_connections 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 -- 172.21.15.17:0/515020679 wait complete. 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.000+0000 7f18f7560740 1 -- start start 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18f7560740 1 Processor -- start 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18f7560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc3d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18f7560740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b869b60 0x55df3bc3d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18f7560740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b88a840 0x55df3bc49110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18f7560740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55df3b9f87a0 con 0x55df3b88a840 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18ea59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc3d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b869b60 0x55df3bc3d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18ea59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc3d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:37050/0 (socket says 172.21.15.17:37050) 2024-09-21T06:14:58.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.001+0000 7f18ea59c640 1 -- 172.21.15.17:0/724334344 learned_addr learned my addr 172.21.15.17:0/724334344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55df3bb3c0a0 con 0x55df3b869b60 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55df3bc3fe20 con 0x55df3b861980 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18f7560740 10 client.0 _ll_register_callbacks cb 0x55df3bb193c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ead9d640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b88a840 0x55df3bc49110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ea59c640 1 -- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b869b60 msgr2=0x55df3bc3d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ea59c640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b869b60 0x55df3bc3d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ea59c640 1 -- 172.21.15.17:0/724334344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b88a840 msgr2=0x55df3bc49110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ea59c640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b88a840 0x55df3bc49110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ea59c640 1 -- 172.21.15.17:0/724334344 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3bb2a880 con 0x55df3b861980 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b869b60 0x55df3bc3d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18ea59c640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc3d210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0318d0 tx=0x7f18dc031900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6caeaa34cdd6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.002+0000 7f18d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-21T06:14:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.003+0000 7f18d1ffb640 1 -- 172.21.15.17:0/724334344 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc054060 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.003+0000 7f18d1ffb640 1 -- 172.21.15.17:0/724334344 <== mon.1 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f18dc045700 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.003+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55df3bba9ae0 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.003+0000 7f18d1ffb640 1 -- 172.21.15.17:0/724334344 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18dc035040 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.003+0000 7f18f7560740 10 client.25354 fetch_fsmap learned FSMap version 28 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.003+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55df3b904b90 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18d1ffb640 1 -- 172.21.15.17:0/724334344 <== mon.1 v2:172.21.15.89:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18dc045dd0 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18d1ffb640 1 -- 172.21.15.17:0/724334344 <== mon.1 v2:172.21.15.89:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f18dc04fc10 con 0x55df3b861980 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18f7560740 10 client.25354 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18f7560740 10 client.25354 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18f7560740 20 client.25354 populate_metadata read hostname 'smithi017' 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18f7560740 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b8491c0 0x55df3bc4eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18f7560740 4 client.25354 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.004+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df3bba9ae0 con 0x55df3b8491c0 2024-09-21T06:14:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.005+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b8491c0 0x55df3bc4eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.005+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b8491c0 0x55df3bc4eff0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fbb365758edd42d server_cookie=bcd9f2069ddc59ee in_seq=0 out_seq=0 2024-09-21T06:14:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.005+0000 7f18d1ffb640 10 client.25354 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18d1ffb640 1 -- 172.21.15.17:0/724334344 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df3bba9ae0 con 0x55df3b8491c0 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18d1ffb640 10 client.25354 handle_command_reply: tid=0 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 client.25354 shutdown 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 msgr2=0x55df3bc3d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc3d210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0318d0 tx=0x7f18dc031900 comp rx=0 tx=0).stop 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 shutdown_connections 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b8491c0 0x55df3bc4eff0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b88a840 0x55df3bc49110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18d1ffb640 0 client.25354 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b869b60 0x55df3bc3d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 --2- 172.21.15.17:0/724334344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc3d210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 >> 172.21.15.17:0/724334344 conn(0x55df3b87e990 msgr2=0x55df3bc32630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.006+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 shutdown_connections 2024-09-21T06:14:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.007+0000 7f18f7560740 1 -- 172.21.15.17:0/724334344 wait complete. 2024-09-21T06:14:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.007+0000 7f18f7560740 20 client.25354 trim_cache size 0 max 16384 2024-09-21T06:14:58.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 Processor -- start 2024-09-21T06:14:58.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 -- start start 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc49080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 0x55df3bc38380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b869b60 0x55df3bc36710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1b1000 con 0x55df3b861980 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1ae8a0 con 0x55df3b8491c0 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18f7560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1ac6f0 con 0x55df3b869b60 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.032+0000 7f18e9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 0x55df3bc38380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 0x55df3bc38380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44534/0 (socket says 172.21.15.17:44534) 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 -- 172.21.15.17:0/3429577402 learned_addr learned my addr 172.21.15.17:0/3429577402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18ea59c640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc49080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18ead9d640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b869b60 0x55df3bc36710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 -- 172.21.15.17:0/3429577402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b869b60 msgr2=0x55df3bc36710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b869b60 0x55df3bc36710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 -- 172.21.15.17:0/3429577402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 msgr2=0x55df3bc49080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc49080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 -- 172.21.15.17:0/3429577402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3bc3ec10 con 0x55df3b861980 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18ead9d640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b869b60 0x55df3bc36710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18ea59c640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc49080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 0x55df3bc38380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f18e00aa630 tx=0x7f18e00ed110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d818e5d6b4d2e34d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.033+0000 7f18d3fff640 1 -- 172.21.15.17:0/3429577402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e00acb30 con 0x55df3b861980 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.034+0000 7f18d3fff640 1 -- 172.21.15.17:0/3429577402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18e00aced0 con 0x55df3b861980 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.034+0000 7f18d3fff640 1 -- 172.21.15.17:0/3429577402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e00e7330 con 0x55df3b861980 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 -- 172.21.15.17:0/3429577402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 msgr2=0x55df3bc38380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 0x55df3bc38380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f18e00aa630 tx=0x7f18e00ed110 comp rx=0 tx=0).stop 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 -- 172.21.15.17:0/3429577402 shutdown_connections 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b861980 0x55df3bc38380 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b869b60 0x55df3bc36710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 --2- 172.21.15.17:0/3429577402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc49080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 -- 172.21.15.17:0/3429577402 >> 172.21.15.17:0/3429577402 conn(0x55df3b87e990 msgr2=0x55df3bc32ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:58.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 -- 172.21.15.17:0/3429577402 shutdown_connections 2024-09-21T06:14:58.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.035+0000 7f18f7560740 1 -- 172.21.15.17:0/3429577402 wait complete. 2024-09-21T06:14:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 -- start start 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 Processor -- start 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc52980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc50e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc51550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1acd60 con 0x55df3b869b60 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1ae1d0 con 0x55df3b8491c0 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec1ad430 con 0x55df3b861980 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.036+0000 7f18f7560740 10 client.0 _ll_register_callbacks cb 0x7f18e00ed060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc51550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc52980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc51550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44536/0 (socket says 172.21.15.17:44536) 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc52980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:54506/0 (socket says 172.21.15.17:54506) 2024-09-21T06:14:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ead9d640 1 -- 172.21.15.17:0/3214643783 learned_addr learned my addr 172.21.15.17:0/3214643783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc50e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 -- 172.21.15.17:0/3214643783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 msgr2=0x55df3bc50e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc50e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 -- 172.21.15.17:0/3214643783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 msgr2=0x55df3bc51550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc51550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 -- 172.21.15.17:0/3214643783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3bcb9780 con 0x55df3b8491c0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18ea59c640 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc52980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18dc03c490 tx=0x7f18dc031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b97e16f5244ef57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.037+0000 7f18d1ffb640 1 -- 172.21.15.17:0/3214643783 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc054040 con 0x55df3b8491c0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18d1ffb640 1 -- 172.21.15.17:0/3214643783 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f18dc03cc60 con 0x55df3b8491c0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18e00aced0 con 0x55df3b8491c0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18d1ffb640 1 -- 172.21.15.17:0/3214643783 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18dc067050 con 0x55df3b8491c0 2024-09-21T06:14:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 10 client.25412 fetch_fsmap learned FSMap version 28 2024-09-21T06:14:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55df3bcba820 con 0x55df3b8491c0 2024-09-21T06:14:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18d1ffb640 1 -- 172.21.15.17:0/3214643783 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18e00aced0 con 0x55df3b8491c0 2024-09-21T06:14:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18d1ffb640 1 -- 172.21.15.17:0/3214643783 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f18dc045890 con 0x55df3b8491c0 2024-09-21T06:14:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 10 client.25412 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:14:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 10 client.25412 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 20 client.25412 populate_metadata read hostname 'smithi017' 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b88a840 0x55df3bcbcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 4 client.25412 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.038+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55df3bba5590 con 0x55df3b88a840 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.039+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b88a840 0x55df3bcbcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.039+0000 7f18d1ffb640 10 client.25412 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:58.039+0000 7f18e9d9b640 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b88a840 0x55df3bcbcf30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a9f0a801494a61 server_cookie=37ed0377f34a255a in_seq=0 out_seq=0 2024-09-21T06:14:59.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:14:58 smithi089 ceph-mon[33879]: pgmap v440: 129 pgs: 129 active+clean; 33 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-09-21T06:14:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:14:58 smithi017 ceph-mon[31080]: pgmap v440: 129 pgs: 129 active+clean; 33 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-09-21T06:14:59.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:14:58 smithi081 ceph-mon[33870]: pgmap v440: 129 pgs: 129 active+clean; 33 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18d1ffb640 1 -- 172.21.15.17:0/3214643783 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55df3bba5590 con 0x55df3b88a840 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18d1ffb640 10 client.25412 handle_command_reply: tid=0 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 client.25412 shutdown 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 msgr2=0x55df3bc52980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc52980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18dc03c490 tx=0x7f18dc031630 comp rx=0 tx=0).stop 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 shutdown_connections 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55df3b88a840 0x55df3bcbcf30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df3b869b60 0x55df3bc51550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df3b861980 0x55df3bc50e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 --2- 172.21.15.17:0/3214643783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df3b8491c0 0x55df3bc52980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18d1ffb640 0 client.25412 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 >> 172.21.15.17:0/3214643783 conn(0x55df3b87e990 msgr2=0x55df3bc32ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 shutdown_connections 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 1 -- 172.21.15.17:0/3214643783 wait complete. 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.722+0000 7f18f7560740 20 client.25412 trim_cache size 0 max 16384 2024-09-21T06:14:59.725 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 28, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 10, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "a5ca4004": { 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 10, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 147.8, 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:14:59.726 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:14:59.727 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f18d40b65c0 msgr2=0x7f18d40b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f18d40b65c0 0x7f18d40b8ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18e40109a0 tx=0x7f18e4004a40 comp rx=0 tx=0).stop 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec1083c0 msgr2=0x7f18ec198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec1083c0 0x7f18ec198780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f18e0010aa0 tx=0x7f18e0010f60 comp rx=0 tx=0).stop 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 shutdown_connections 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f18d40b65c0 0x7f18d40b8ad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec108d10 0x7f18ec19da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18ec1083c0 0x7f18ec198780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 --2- 172.21.15.17:0/4002822527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18ec102a80 0x7f18ec1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 >> 172.21.15.17:0/4002822527 conn(0x7f18ec079760 msgr2=0x7f18ec1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 shutdown_connections 2024-09-21T06:14:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:14:59.723+0000 7f18f0fec640 1 -- 172.21.15.17:0/4002822527 wait complete. 2024-09-21T06:15:00.466 INFO:tasks.workunit.client.0.smithi017.stdout: 5 12285 133 7544 84 886 190 2024-09-21T06:15:00.603 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a5ca4004', quiesce took 7.0 seconds. Will release after: 20.8 2024-09-21T06:15:00.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:00 smithi017 ceph-mon[31080]: pgmap v441: 129 pgs: 129 active+clean; 34 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.5 MiB/s wr, 111 op/s 2024-09-21T06:15:01.060 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:00 smithi081 ceph-mon[33870]: pgmap v441: 129 pgs: 129 active+clean; 34 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.5 MiB/s wr, 111 op/s 2024-09-21T06:15:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:00 smithi089 ceph-mon[33879]: pgmap v441: 129 pgs: 129 active+clean; 34 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.5 MiB/s wr, 111 op/s 2024-09-21T06:15:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:02 smithi089 ceph-mon[33879]: pgmap v442: 129 pgs: 129 active+clean; 35 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-09-21T06:15:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:02 smithi017 ceph-mon[31080]: pgmap v442: 129 pgs: 129 active+clean; 35 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-09-21T06:15:03.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:02 smithi081 ceph-mon[33870]: pgmap v442: 129 pgs: 129 active+clean; 35 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-09-21T06:15:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:04 smithi089 ceph-mon[33879]: pgmap v443: 129 pgs: 129 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.3 MiB/s wr, 158 op/s 2024-09-21T06:15:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:04 smithi017 ceph-mon[31080]: pgmap v443: 129 pgs: 129 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.3 MiB/s wr, 158 op/s 2024-09-21T06:15:05.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:04 smithi081 ceph-mon[33870]: pgmap v443: 129 pgs: 129 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.3 MiB/s wr, 158 op/s 2024-09-21T06:15:07.011 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:06 smithi017 ceph-mon[31080]: pgmap v444: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1015 KiB/s wr, 157 op/s 2024-09-21T06:15:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:06 smithi089 ceph-mon[33879]: pgmap v444: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1015 KiB/s wr, 157 op/s 2024-09-21T06:15:07.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:06 smithi081 ceph-mon[33870]: pgmap v444: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1015 KiB/s wr, 157 op/s 2024-09-21T06:15:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:08 smithi089 ceph-mon[33879]: pgmap v445: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 881 KiB/s wr, 145 op/s 2024-09-21T06:15:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:08 smithi017 ceph-mon[31080]: pgmap v445: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 881 KiB/s wr, 145 op/s 2024-09-21T06:15:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:08 smithi081 ceph-mon[33870]: pgmap v445: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 881 KiB/s wr, 145 op/s 2024-09-21T06:15:10.467 INFO:tasks.workunit.client.0.smithi017.stdout: 5 577 0 258 0 27 0 2024-09-21T06:15:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:10 smithi089 ceph-mon[33879]: pgmap v446: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 506 KiB/s wr, 122 op/s 2024-09-21T06:15:11.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:10 smithi017 ceph-mon[31080]: pgmap v446: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 506 KiB/s wr, 122 op/s 2024-09-21T06:15:11.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:10 smithi081 ceph-mon[33870]: pgmap v446: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 506 KiB/s wr, 122 op/s 2024-09-21T06:15:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:12 smithi089 ceph-mon[33879]: pgmap v447: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 109 op/s 2024-09-21T06:15:13.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:12 smithi017 ceph-mon[31080]: pgmap v447: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 109 op/s 2024-09-21T06:15:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:12 smithi081 ceph-mon[33870]: pgmap v447: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 109 op/s 2024-09-21T06:15:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:14 smithi089 ceph-mon[33879]: pgmap v448: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 309 KiB/s wr, 101 op/s 2024-09-21T06:15:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:14 smithi017 ceph-mon[31080]: pgmap v448: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 309 KiB/s wr, 101 op/s 2024-09-21T06:15:15.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:14 smithi081 ceph-mon[33870]: pgmap v448: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 309 KiB/s wr, 101 op/s 2024-09-21T06:15:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:16 smithi089 ceph-mon[33879]: pgmap v449: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 72 KiB/s wr, 25 op/s 2024-09-21T06:15:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:16 smithi017 ceph-mon[31080]: pgmap v449: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 72 KiB/s wr, 25 op/s 2024-09-21T06:15:17.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:16 smithi081 ceph-mon[33870]: pgmap v449: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 72 KiB/s wr, 25 op/s 2024-09-21T06:15:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:18 smithi089 ceph-mon[33879]: pgmap v450: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T06:15:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:18 smithi017 ceph-mon[31080]: pgmap v450: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T06:15:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:18 smithi081 ceph-mon[33870]: pgmap v450: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-21T06:15:20.467 INFO:tasks.workunit.client.0.smithi017.stdout: 5 0 0 0 0 0 0 2024-09-21T06:15:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:20 smithi089 ceph-mon[33879]: pgmap v451: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T06:15:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:20 smithi017 ceph-mon[31080]: pgmap v451: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T06:15:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:20 smithi081 ceph-mon[33870]: pgmap v451: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T06:15:21.404 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:15:21.677 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:22.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:22.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:22.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:22.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:21 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:15:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:22.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:21 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 -- 172.21.15.17:0/2739082834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 msgr2=0x7f277c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 --2- 172.21.15.17:0/2739082834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c103f90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f276c009900 tx=0x7f276c02a410 comp rx=0 tx=0).stop 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 -- 172.21.15.17:0/2739082834 shutdown_connections 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 --2- 172.21.15.17:0/2739082834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 0x7f277c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 --2- 172.21.15.17:0/2739082834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f277c1094c0 0x7f277c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 --2- 172.21.15.17:0/2739082834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c103f90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 -- 172.21.15.17:0/2739082834 >> 172.21.15.17:0/2739082834 conn(0x7f277c0ff610 msgr2=0x7f277c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.204+0000 7f27828f3640 1 -- 172.21.15.17:0/2739082834 shutdown_connections 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 -- 172.21.15.17:0/2739082834 wait complete. 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 Processor -- start 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 -- start start 2024-09-21T06:15:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f277c1094c0 0x7f277c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 0x7f277c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f277c113980 con 0x7f277c103b80 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f277c113800 con 0x7f277c109e10 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.205+0000 7f27828f3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f277c113b00 con 0x7f277c1094c0 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56308/0 (socket says 172.21.15.17:56308) 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 -- 172.21.15.17:0/507215986 learned_addr learned my addr 172.21.15.17:0/507215986 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f2780e90640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 0x7f277c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f2773fff640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f277c1094c0 0x7f277c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 -- 172.21.15.17:0/507215986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f277c1094c0 msgr2=0x7f277c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f277c1094c0 0x7f277c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 -- 172.21.15.17:0/507215986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 msgr2=0x7f277c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 0x7f277c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 -- 172.21.15.17:0/507215986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c1a0340 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f2780e90640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 0x7f277c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f277bfff640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c19a490 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f276c009230 tx=0x7f276c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c03f030 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c1a05d0 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f276c003a80 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c035070 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.206+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c1a0ab0 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.208+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277c104e00 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.209+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f276c042030 con 0x7f277c103b80 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.210+0000 7f2779ffb640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f27680b6540 0x7f27680b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.210+0000 7f2773fff640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f27680b6540 0x7f27680b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:22.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.210+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f276c107de0 con 0x7f277c103b80 2024-09-21T06:15:22.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.210+0000 7f2773fff640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f27680b6540 0x7f27680b8a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f277c108f40 tx=0x7f276400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:22.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.215+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f276c0ce2e0 con 0x7f277c103b80 2024-09-21T06:15:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:21 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:15:22.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.440+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f277c103f90 con 0x7f277c103b80 2024-09-21T06:15:22.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.441+0000 7f2779ffb640 1 -- 172.21.15.17:0/507215986 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11889 (secure 0 0 0) 0x7f276c0d26c0 con 0x7f277c103b80 2024-09-21T06:15:22.442 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:15:22.443 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-21T06:14:42:761166+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:14:42.746390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:15:22.443 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f27680b6540 msgr2=0x7f27680b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f27680b6540 0x7f27680b8a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f277c108f40 tx=0x7f276400b390 comp rx=0 tx=0).stop 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 msgr2=0x7f277c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c19a490 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f276c009230 tx=0x7f276c004270 comp rx=0 tx=0).stop 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 shutdown_connections 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f27680b6540 0x7f27680b8a50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c109e10 0x7f277c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f277c1094c0 0x7f277c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 --2- 172.21.15.17:0/507215986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277c103b80 0x7f277c19a490 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:22.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 >> 172.21.15.17:0/507215986 conn(0x7f277c0ff610 msgr2=0x7f277c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:22.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 shutdown_connections 2024-09-21T06:15:22.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:22.443+0000 7f27828f3640 1 -- 172.21.15.17:0/507215986 wait complete. 2024-09-21T06:15:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:22 smithi089 ceph-mon[33879]: pgmap v452: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T06:15:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:22 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/507215986' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:23.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:22 smithi017 ceph-mon[31080]: pgmap v452: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T06:15:23.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:22 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/507215986' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:23.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:22 smithi081 ceph-mon[33870]: pgmap v452: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-21T06:15:23.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:22 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/507215986' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:23.303 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id a5ca4004 --release --await' 2024-09-21T06:15:23.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id a5ca4004 --release --await 2024-09-21T06:15:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 -- 172.21.15.17:0/2259875234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4104920 msgr2=0x7f40d4104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2259875234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4104920 0x7f40d4104d30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009900 tx=0x7f40c402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 -- 172.21.15.17:0/2259875234 shutdown_connections 2024-09-21T06:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2259875234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d410ded0 0x7f40d4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2259875234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4105270 0x7f40d410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2259875234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4104920 0x7f40d4104d30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 -- 172.21.15.17:0/2259875234 >> 172.21.15.17:0/2259875234 conn(0x7f40d4079760 msgr2=0x7f40d4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 -- 172.21.15.17:0/2259875234 shutdown_connections 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.080+0000 7f40d9d11640 1 -- 172.21.15.17:0/2259875234 wait complete. 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 Processor -- start 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 -- start start 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4104920 0x7f40d419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 0x7f40d419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d410ded0 0x7f40d419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4113970 con 0x7f40d4105270 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41137f0 con 0x7f40d410ded0 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d9d11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4113af0 con 0x7f40d4104920 2024-09-21T06:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 0x7f40d419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 0x7f40d419aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56330/0 (socket says 172.21.15.17:56330) 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.081+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2137793270 learned_addr learned my addr 172.21.15.17:0/2137793270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d3fff640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d410ded0 0x7f40d419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4104920 0x7f40d419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2137793270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4104920 msgr2=0x7f40d419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4104920 0x7f40d419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2137793270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d410ded0 msgr2=0x7f40d419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d410ded0 0x7f40d419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2137793270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d41a0390 con 0x7f40d4105270 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4104920 0x7f40d419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 0x7f40d419aa80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d740 tx=0x7f40c800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d0ff9640 1 -- 172.21.15.17:0/2137793270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8017070 con 0x7f40d4105270 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d0ff9640 1 -- 172.21.15.17:0/2137793270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40c800de50 con 0x7f40d4105270 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d0ff9640 1 -- 172.21.15.17:0/2137793270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8004c60 con 0x7f40d4105270 2024-09-21T06:15:24.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d41a0680 con 0x7f40d4105270 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.082+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d41a6ea0 con 0x7f40d4105270 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 Processor -- start 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 -- start start 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55ba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 0x564ee55baa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55baf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ee54a5dc0 con 0x564ee51f3840 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ee55321f0 con 0x564ee5214520 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40e0285740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ee5521620 con 0x564ee51eb660 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40d0ff9640 1 -- 172.21.15.17:0/2137793270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f40c8004e00 con 0x7f40d4105270 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 0x564ee55baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55baf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55ba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 0x564ee55baa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54404/0 (socket says 172.21.15.17:54404) 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.085+0000 7f40d37fe640 1 -- 172.21.15.17:0/1179930643 learned_addr learned my addr 172.21.15.17:0/1179930643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d37fe640 1 -- 172.21.15.17:0/1179930643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 msgr2=0x564ee55ba510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d37fe640 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55ba510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d37fe640 1 -- 172.21.15.17:0/1179930643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 msgr2=0x564ee55baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d37fe640 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55baf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d37fe640 1 -- 172.21.15.17:0/1179930643 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee54e9fd0 con 0x564ee51eb660 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d37fe640 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 0x564ee55baa50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40c4032c40 tx=0x7f40c4032c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e49081ff844f0ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d0ff9640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f40bc0b6540 0x7f40bc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1179930643 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4035030 con 0x564ee51eb660 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1179930643 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40c40044c0 con 0x564ee51eb660 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40b9ffb640 1 -- 172.21.15.17:0/1179930643 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c40055f0 con 0x564ee51eb660 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d3fff640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f40bc0b6540 0x7f40bc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.086+0000 7f40d0ff9640 1 -- 172.21.15.17:0/2137793270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f40c80e70b0 con 0x7f40d4105270 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 -- 172.21.15.17:0/1179930643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 msgr2=0x564ee55baa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40d3fff640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f40bc0b6540 0x7f40bc0b8a50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40d4105900 tx=0x7f40cc007600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 0x564ee55baa50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40c4032c40 tx=0x7f40c4032c70 comp rx=0 tx=0).stop 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 -- 172.21.15.17:0/1179930643 shutdown_connections 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55baf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51eb660 0x564ee55baa50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 --2- 172.21.15.17:0/1179930643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55ba510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 -- 172.21.15.17:0/1179930643 >> 172.21.15.17:0/1179930643 conn(0x564ee5208910 msgr2=0x564ee55b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 -- 172.21.15.17:0/1179930643 shutdown_connections 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.087+0000 7f40e0285740 1 -- 172.21.15.17:0/1179930643 wait complete. 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 -- start start 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 Processor -- start 2024-09-21T06:15:24.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51f3840 0x564ee55ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ee54bc300 con 0x564ee51eb660 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ee5525430 con 0x564ee51f3840 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ee5382bb0 con 0x564ee5214520 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40e0285740 10 client.0 _ll_register_callbacks cb 0x564ee54d6120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56342/0 (socket says 172.21.15.17:56342) 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40d37fe640 1 -- 172.21.15.17:0/821563838 learned_addr learned my addr 172.21.15.17:0/821563838 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.088+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51f3840 0x564ee55ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d3fff640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d37fe640 1 -- 172.21.15.17:0/821563838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 msgr2=0x564ee55ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d37fe640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d37fe640 1 -- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51f3840 msgr2=0x564ee55ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d37fe640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51f3840 0x564ee55ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d37fe640 1 -- 172.21.15.17:0/821563838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee54ab780 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40d37fe640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55c9f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f40c4006010 tx=0x7f40c4005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c7afc7c2ad9aea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40b2ffd640 1 -- 172.21.15.17:0/821563838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c404c070 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40b2ffd640 1 -- 172.21.15.17:0/821563838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f40c4031600 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ee5534140 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40b2ffd640 1 -- 172.21.15.17:0/821563838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40c4058050 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40e0285740 10 client.15633 fetch_fsmap learned FSMap version 28 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.089+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564ee527fb00 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40b2ffd640 1 -- 172.21.15.17:0/821563838 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564ee5534140 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40b2ffd640 1 -- 172.21.15.17:0/821563838 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f40c403b580 con 0x564ee51eb660 2024-09-21T06:15:24.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40e0285740 10 client.15633 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40e0285740 10 client.15633 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40e0285740 20 client.15633 populate_metadata read hostname 'smithi017' 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40e0285740 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51d2ea0 0x564ee55dc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40e0285740 4 client.15633 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ee552fbf0 con 0x564ee51d2ea0 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51d2ea0 0x564ee55dc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51d2ea0 0x564ee55dc020 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460aa41cb10f542e server_cookie=6bfe4088d286799f in_seq=0 out_seq=0 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.090+0000 7f40b2ffd640 10 client.15633 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.091+0000 7f40b2ffd640 1 -- 172.21.15.17:0/821563838 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ee552fbf0 con 0x564ee51d2ea0 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.091+0000 7f40b2ffd640 10 client.15633 handle_command_reply: tid=0 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.091+0000 7f40e0285740 1 client.15633 shutdown 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.091+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 msgr2=0x564ee55c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.091+0000 7f40e0285740 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55c9f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f40c4006010 tx=0x7f40c4005160 comp rx=0 tx=0).stop 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.091+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 shutdown_connections 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51d2ea0 0x564ee55dc020 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51f3840 0x564ee55ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40b2ffd640 0 client.15633 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 --2- 172.21.15.17:0/821563838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55c9f70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 >> 172.21.15.17:0/821563838 conn(0x564ee5208910 msgr2=0x564ee55bd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 shutdown_connections 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 1 -- 172.21.15.17:0/821563838 wait complete. 2024-09-21T06:15:24.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.092+0000 7f40e0285740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 Processor -- start 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 -- start start 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51f3840 0x564ee55c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41b11b0 con 0x564ee51eb660 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41aea50 con 0x564ee5214520 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40e0285740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ac8a0 con 0x564ee51f3840 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.109+0000 7f40d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56346/0 (socket says 172.21.15.17:56346) 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 -- 172.21.15.17:0/2109142805 learned_addr learned my addr 172.21.15.17:0/2109142805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d3fff640 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51f3840 0x564ee55c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 -- 172.21.15.17:0/2109142805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51f3840 msgr2=0x564ee55c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51f3840 0x564ee55c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 -- 172.21.15.17:0/2109142805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 msgr2=0x564ee55c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 -- 172.21.15.17:0/2109142805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee52f6960 con 0x564ee51eb660 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55ca8a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f40c403b950 tx=0x7f40c4032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4a58020287dcde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40b97fa640 1 -- 172.21.15.17:0/2109142805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4055020 con 0x564ee51eb660 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40b97fa640 1 -- 172.21.15.17:0/2109142805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40c403bb40 con 0x564ee51eb660 2024-09-21T06:15:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.110+0000 7f40b97fa640 1 -- 172.21.15.17:0/2109142805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c404c040 con 0x564ee51eb660 2024-09-21T06:15:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 -- 172.21.15.17:0/2109142805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 msgr2=0x564ee55ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55ca8a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f40c403b950 tx=0x7f40c4032fc0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 -- 172.21.15.17:0/2109142805 shutdown_connections 2024-09-21T06:15:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee5214520 0x564ee55c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee51f3840 0x564ee55c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 --2- 172.21.15.17:0/2109142805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51eb660 0x564ee55ca8a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 -- 172.21.15.17:0/2109142805 >> 172.21.15.17:0/2109142805 conn(0x564ee5208910 msgr2=0x564ee55b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 -- 172.21.15.17:0/2109142805 shutdown_connections 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.111+0000 7f40e0285740 1 -- 172.21.15.17:0/2109142805 wait complete. 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 -- start start 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 Processor -- start 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51eb660 0x564ee55dd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ddd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41acf10 con 0x564ee51f3840 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ae380 con 0x564ee51eb660 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40d41ad5e0 con 0x564ee5214520 2024-09-21T06:15:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40e0285740 10 client.0 _ll_register_callbacks cb 0x7f40c80eaa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56358/0 (socket says 172.21.15.17:56358) 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2515364602 learned_addr learned my addr 172.21.15.17:0/2515364602 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.112+0000 7f40d3fff640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51eb660 0x564ee55dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2515364602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 msgr2=0x564ee55ddd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ddd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51eb660 msgr2=0x564ee55dd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51eb660 0x564ee55dd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d2ffd640 1 -- 172.21.15.17:0/2515364602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee56459d0 con 0x564ee51f3840 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40d2ffd640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55dd7b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ace40 tx=0x7f40c80d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc28e3821040fd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40b2ffd640 1 -- 172.21.15.17:0/2515364602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8020040 con 0x564ee51f3840 2024-09-21T06:15:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40b2ffd640 1 -- 172.21.15.17:0/2515364602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f40c80a9120 con 0x564ee51f3840 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c403bb40 con 0x564ee51f3840 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40b2ffd640 1 -- 172.21.15.17:0/2515364602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40c80ac800 con 0x564ee51f3840 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40e0285740 10 client.15639 fetch_fsmap learned FSMap version 28 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.113+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564ee5646cf0 con 0x564ee51f3840 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40b2ffd640 1 -- 172.21.15.17:0/2515364602 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40c403bb40 con 0x564ee51f3840 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40b2ffd640 1 -- 172.21.15.17:0/2515364602 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f40c80e4ce0 con 0x564ee51f3840 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40e0285740 10 client.15639 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40e0285740 10 client.15639 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40e0285740 20 client.15639 populate_metadata read hostname 'smithi017' 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40e0285740 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51a8250 0x564ee5649470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40e0285740 4 client.15639 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a5ca4004", "release": true, "await": true}] 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a5ca4004", "release": true, "await": true}) -- 0x564ee552d020 con 0x564ee51a8250 2024-09-21T06:15:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51a8250 0x564ee5649470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40d37fe640 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51a8250 0x564ee5649470 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=858d6d4cf9d253cb server_cookie=797d03c617132e18 in_seq=0 out_seq=0 2024-09-21T06:15:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.114+0000 7f40b2ffd640 10 client.15639 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40b2ffd640 1 -- 172.21.15.17:0/2515364602 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564ee552d020 con 0x564ee51a8250 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40b2ffd640 10 client.15639 handle_command_reply: tid=0 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 client.15639 shutdown 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 msgr2=0x564ee55dd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55dd7b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ace40 tx=0x7f40c80d0040 comp rx=0 tx=0).stop 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 shutdown_connections 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ee51a8250 0x564ee5649470 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ee51f3840 0x564ee55dd7b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ee5214520 0x564ee55ddd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 --2- 172.21.15.17:0/2515364602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ee51eb660 0x564ee55dd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 >> 172.21.15.17:0/2515364602 conn(0x564ee5208910 msgr2=0x564ee55b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.200+0000 7f40b2ffd640 0 client.15639 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 shutdown_connections 2024-09-21T06:15:24.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40e0285740 1 -- 172.21.15.17:0/2515364602 wait complete. 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40e0285740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 28, 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 12, 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "a5ca4004": { 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 12, 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:15:24.204 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 147.8, 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:24.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f40bc0b6540 msgr2=0x7f40bc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f40bc0b6540 0x7f40bc0b8a50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40d4105900 tx=0x7f40cc007600 comp rx=0 tx=0).stop 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 msgr2=0x7f40d419aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:24.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 0x7f40d419aa80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d740 tx=0x7f40c800dc00 comp rx=0 tx=0).stop 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 shutdown_connections 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f40bc0b6540 0x7f40bc0b8a50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40d4105270 0x7f40d419aa80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d410ded0 0x7f40d419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 --2- 172.21.15.17:0/2137793270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40d4104920 0x7f40d419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.201+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 >> 172.21.15.17:0/2137793270 conn(0x7f40d4079760 msgr2=0x7f40d4100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.202+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 shutdown_connections 2024-09-21T06:15:24.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:24.202+0000 7f40d9d11640 1 -- 172.21.15.17:0/2137793270 wait complete. 2024-09-21T06:15:25.034 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a5ca4004', total seconds elapsed: 31.4 2024-09-21T06:15:25.034 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T06:15:25.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:15:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:24 smithi089 ceph-mon[33879]: pgmap v453: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:15:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:24 smithi017 ceph-mon[31080]: pgmap v453: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:15:25.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:24 smithi081 ceph-mon[33870]: pgmap v453: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:15:25.385 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 -- 172.21.15.17:0/664523129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 msgr2=0x7f23981087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 --2- 172.21.15.17:0/664523129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f23981087b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2388009900 tx=0x7f238802a410 comp rx=0 tx=0).stop 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 -- 172.21.15.17:0/664523129 shutdown_connections 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 --2- 172.21.15.17:0/664523129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f23981087b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 --2- 172.21.15.17:0/664523129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 --2- 172.21.15.17:0/664523129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 0x7f2398102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 -- 172.21.15.17:0/664523129 >> 172.21.15.17:0/664523129 conn(0x7f2398079730 msgr2=0x7f2398079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 -- 172.21.15.17:0/664523129 shutdown_connections 2024-09-21T06:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.955+0000 7f239f6bc640 1 -- 172.21.15.17:0/664523129 wait complete. 2024-09-21T06:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.956+0000 7f239f6bc640 1 Processor -- start 2024-09-21T06:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 -- start start 2024-09-21T06:15:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 0x7f23981981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f2398198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239819da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111710 con 0x7f23981083a0 2024-09-21T06:15:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111590 con 0x7f2398102a60 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239f6bc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111890 con 0x7f2398108cf0 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239cc57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f2398198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239dc59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239819da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239dc59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239819da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54468/0 (socket says 172.21.15.17:54468) 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239dc59640 1 -- 172.21.15.17:0/3367868722 learned_addr learned my addr 172.21.15.17:0/3367868722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.957+0000 7f239d458640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 0x7f23981981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239d458640 1 -- 172.21.15.17:0/3367868722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 msgr2=0x7f239819da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239d458640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239819da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239d458640 1 -- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 msgr2=0x7f2398198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239d458640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f2398198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239d458640 1 -- 172.21.15.17:0/3367868722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239819e130 con 0x7f2398102a60 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239cc57640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f2398198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239dc59640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239819da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f239d458640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 0x7f23981981c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f239400dcd0 tx=0x7f2394009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394016c60 con 0x7f2398102a60 2024-09-21T06:15:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.958+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2394016e00 con 0x7f2398102a60 2024-09-21T06:15:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.959+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239819e420 con 0x7f2398102a60 2024-09-21T06:15:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.959+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401f900 con 0x7f2398102a60 2024-09-21T06:15:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.959+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981a4b80 con 0x7f2398102a60 2024-09-21T06:15:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.960+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2398102e70 con 0x7f2398102a60 2024-09-21T06:15:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.962+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f239401faa0 con 0x7f2398102a60 2024-09-21T06:15:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.963+0000 7f238e7fc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23840b6510 0x7f23840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.963+0000 7f239cc57640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23840b6510 0x7f23840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.963+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f23940f01c0 con 0x7f2398102a60 2024-09-21T06:15:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.964+0000 7f239cc57640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23840b6510 0x7f23840b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2388004770 tx=0x7f23880058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:25.965+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23940b66c0 con 0x7f2398102a60 2024-09-21T06:15:26.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.319+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23981992f0 con 0x7f2398102a60 2024-09-21T06:15:26.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.320+0000 7f238e7fc640 1 -- 172.21.15.17:0/3367868722 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11889 (secure 0 0 0) 0x7f23981992f0 con 0x7f2398102a60 2024-09-21T06:15:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:15:26.322 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-21T06:14:42:761166+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:14:42.746390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:15:26.323 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-21T06:15:26.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.323+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23840b6510 msgr2=0x7f23840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:26.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.323+0000 7f239f6bc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23840b6510 0x7f23840b8a20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2388004770 tx=0x7f23880058d0 comp rx=0 tx=0).stop 2024-09-21T06:15:26.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.323+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 msgr2=0x7f23981981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.323+0000 7f239f6bc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 0x7f23981981c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f239400dcd0 tx=0x7f2394009740 comp rx=0 tx=0).stop 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 shutdown_connections 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23840b6510 0x7f23840b8a20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23981083a0 0x7f2398198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2398108cf0 0x7f239819da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 --2- 172.21.15.17:0/3367868722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2398102a60 0x7f23981981c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 >> 172.21.15.17:0/3367868722 conn(0x7f2398079730 msgr2=0x7f2398104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 shutdown_connections 2024-09-21T06:15:26.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:26.324+0000 7f239f6bc640 1 -- 172.21.15.17:0/3367868722 wait complete. 2024-09-21T06:15:27.049 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:26 smithi017 ceph-mon[31080]: pgmap v454: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-21T06:15:27.049 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:26 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3367868722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:26 smithi089 ceph-mon[33879]: pgmap v454: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-21T06:15:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:26 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3367868722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:27.222 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T06:15:27.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T06:15:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:26 smithi081 ceph-mon[33870]: pgmap v454: 129 pgs: 129 active+clean; 38 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-21T06:15:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:26 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3367868722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:27.608 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 -- 172.21.15.17:0/151465709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4108d10 msgr2=0x7f12f410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/151465709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4108d10 0x7f12f410f540 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009ca0 tx=0x7f12ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 -- 172.21.15.17:0/151465709 shutdown_connections 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/151465709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4108d10 0x7f12f410f540 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/151465709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/151465709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f4102a80 0x7f12f4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 -- 172.21.15.17:0/151465709 >> 172.21.15.17:0/151465709 conn(0x7f12f4079760 msgr2=0x7f12f4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 -- 172.21.15.17:0/151465709 shutdown_connections 2024-09-21T06:15:28.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.212+0000 7f12fc0c6640 1 -- 172.21.15.17:0/151465709 wait complete. 2024-09-21T06:15:28.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.213+0000 7f12fc0c6640 1 Processor -- start 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.213+0000 7f12fc0c6640 1 -- start start 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.213+0000 7f12fc0c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4102a80 0x7f12f419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.213+0000 7f12fc0c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.213+0000 7f12fc0c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f4108d10 0x7f12f4198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12fc0c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12f4111770 con 0x7f12f4102a80 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12fc0c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41115f0 con 0x7f12f4108d10 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12fc0c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41118f0 con 0x7f12f41083c0 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4102a80 0x7f12f419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f4197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54490/0 (socket says 172.21.15.17:54490) 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 -- 172.21.15.17:0/2875982047 learned_addr learned my addr 172.21.15.17:0/2875982047 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12fa663640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f4108d10 0x7f12f4198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 -- 172.21.15.17:0/2875982047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f4108d10 msgr2=0x7f12f4198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:28.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f4108d10 0x7f12f4198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 -- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4102a80 msgr2=0x7f12f419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4102a80 0x7f12f419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 -- 172.21.15.17:0/2875982047 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41acaa0 con 0x7f12f41083c0 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.214+0000 7f12f9661640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f4197f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f12e40097d0 tx=0x7f12e4009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.215+0000 7f12eaffd640 1 -- 172.21.15.17:0/2875982047 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e400e8b0 con 0x7f12f41083c0 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.215+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f41accd0 con 0x7f12f41083c0 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.215+0000 7f12eaffd640 1 -- 172.21.15.17:0/2875982047 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e4005020 con 0x7f12f41083c0 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.215+0000 7f12eaffd640 1 -- 172.21.15.17:0/2875982047 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4004a00 con 0x7f12f41083c0 2024-09-21T06:15:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.215+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f41ad1b0 con 0x7f12f41083c0 2024-09-21T06:15:28.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.218+0000 7f12eaffd640 1 -- 172.21.15.17:0/2875982047 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f12e401b020 con 0x7f12f41083c0 2024-09-21T06:15:28.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.218+0000 7f130263a740 1 Processor -- start 2024-09-21T06:15:28.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 -- start start 2024-09-21T06:15:28.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38daf840 0x561c39156600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c39157080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561c390ccb90 con 0x561c38d86980 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561c390bbfc0 con 0x561c38d8eb60 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f12eaffd640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e00b6590 0x7f12e00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f130263a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561c390bfdd0 con 0x561c38daf840 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.219+0000 7f12fa663640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38daf840 0x561c39156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12eaffd640 1 -- 172.21.15.17:0/2875982047 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f12e40e6e70 con 0x7f12f41083c0 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56406/0 (socket says 172.21.15.17:56406) 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9e62640 1 -- 172.21.15.17:0/1670605407 learned_addr learned my addr 172.21.15.17:0/1670605407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12fa663640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e00b6590 0x7f12e00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9661640 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c39157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9661640 1 -- 172.21.15.17:0/1670605407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38daf840 msgr2=0x561c39156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9661640 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38daf840 0x561c39156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9661640 1 -- 172.21.15.17:0/1670605407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 msgr2=0x561c39156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9661640 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.220+0000 7f12f9661640 1 -- 172.21.15.17:0/1670605407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c39043060 con 0x561c38d8eb60 2024-09-21T06:15:28.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.221+0000 7f12f9e62640 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:28.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.221+0000 7f12f9661640 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c39157080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12e40a9ee0 tx=0x7f12e40ac4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2748f789b1ed629 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:28.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.221+0000 7f12fa663640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e00b6590 0x7f12e00b8aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006010 tx=0x7f12ec009440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:28.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.221+0000 7f12dffff640 1 -- 172.21.15.17:0/1670605407 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40b1750 con 0x561c38d8eb60 2024-09-21T06:15:28.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.221+0000 7f12dffff640 1 -- 172.21.15.17:0/1670605407 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e40b6690 con 0x561c38d8eb60 2024-09-21T06:15:28.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.221+0000 7f12dffff640 1 -- 172.21.15.17:0/1670605407 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40b1750 con 0x561c38d8eb60 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 -- 172.21.15.17:0/1670605407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 msgr2=0x561c39157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c39157080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12e40a9ee0 tx=0x7f12e40ac4a0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 -- 172.21.15.17:0/1670605407 shutdown_connections 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c39157080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 --2- 172.21.15.17:0/1670605407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38daf840 0x561c39156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.222+0000 7f130263a740 1 -- 172.21.15.17:0/1670605407 >> 172.21.15.17:0/1670605407 conn(0x561c38da3990 msgr2=0x561c391544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.223+0000 7f130263a740 1 -- 172.21.15.17:0/1670605407 shutdown_connections 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.223+0000 7f130263a740 1 -- 172.21.15.17:0/1670605407 wait complete. 2024-09-21T06:15:28.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.223+0000 7f130263a740 1 -- start start 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.223+0000 7f130263a740 1 Processor -- start 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f130263a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d86980 0x561c391621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f130263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c391626e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f130263a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38daf840 0x561c3916e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d86980 0x561c391621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d86980 0x561c391621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54504/0 (socket says 172.21.15.17:54504) 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f12fa663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38daf840 0x561c3916e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f12fa663640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38daf840 0x561c3916e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56418/0 (socket says 172.21.15.17:56418) 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f12f9e62640 1 -- 172.21.15.17:0/2804160471 learned_addr learned my addr 172.21.15.17:0/2804160471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f12f9661640 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c391626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561c38f1d7a0 con 0x561c38daf840 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561c390610a0 con 0x561c38d8eb60 2024-09-21T06:15:28.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.224+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561c39164d80 con 0x561c38d86980 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f130263a740 10 client.0 _ll_register_callbacks cb 0x561c3903e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12f9661640 1 -- 172.21.15.17:0/2804160471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d86980 msgr2=0x561c391621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12f9661640 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d86980 0x561c391621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12f9661640 1 -- 172.21.15.17:0/2804160471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38daf840 msgr2=0x561c3916e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12f9661640 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38daf840 0x561c3916e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12f9661640 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3904f880 con 0x561c38d8eb60 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e40b6690 con 0x561c38d8eb60 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12f9661640 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c391626e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12e40b1910 tx=0x7f12e40ac510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbbd50c445110621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12dd7fa640 10 client.25448 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2804160471 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40b1750 con 0x561c38d8eb60 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.225+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2804160471 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f12e40d41d0 con 0x561c38d8eb60 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2804160471 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12e40a8ee0 con 0x561c38d8eb60 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 10 client.25448 fetch_fsmap learned FSMap version 28 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561c38e29b90 con 0x561c38d8eb60 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2804160471 <== mon.2 v2:172.21.15.81:3300/0 4 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f12e40d00d0 con 0x561c38d8eb60 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 10 client.25448 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 10 client.25448 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 20 client.25448 populate_metadata read hostname 'smithi017' 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38d6e1c0 0x561c39173d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 4 client.25448 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c390ceae0 con 0x561c38d6e1c0 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.226+0000 7f12f9e62640 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38d6e1c0 0x561c39173d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.227+0000 7f12f9e62640 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38d6e1c0 0x561c39173d30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=209c7805fea6687c server_cookie=f9a2828d51cbf79a in_seq=0 out_seq=0 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.227+0000 7f12dd7fa640 10 client.25448 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2804160471 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c390ceae0 con 0x561c38d6e1c0 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f12dd7fa640 10 client.25448 handle_command_reply: tid=0 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 client.25448 shutdown 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 msgr2=0x561c391626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c391626e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12e40b1910 tx=0x7f12e40ac510 comp rx=0 tx=0).stop 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 shutdown_connections 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38d6e1c0 0x561c39173d30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38daf840 0x561c3916e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f12dd7fa640 0 client.25448 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c391626e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 --2- 172.21.15.17:0/2804160471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d86980 0x561c391621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.228+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 >> 172.21.15.17:0/2804160471 conn(0x561c38da3990 msgr2=0x561c39159790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.229+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 shutdown_connections 2024-09-21T06:15:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.229+0000 7f130263a740 1 -- 172.21.15.17:0/2804160471 wait complete. 2024-09-21T06:15:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.229+0000 7f130263a740 20 client.25448 trim_cache size 0 max 16384 2024-09-21T06:15:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.265+0000 7f130263a740 1 Processor -- start 2024-09-21T06:15:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.265+0000 7f130263a740 1 -- start start 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f130263a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f130263a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39163e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f130263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c3915f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54514/0 (socket says 172.21.15.17:54514) 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f12f9661640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39163e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f12f9661640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39163e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56432/0 (socket says 172.21.15.17:56432) 2024-09-21T06:15:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f130263a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41b98f0 con 0x561c38d86980 2024-09-21T06:15:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f12fa663640 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c3915f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.266+0000 7f12f9e62640 1 -- 172.21.15.17:0/2478432018 learned_addr learned my addr 172.21.15.17:0/2478432018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41b7190 con 0x561c38d8eb60 2024-09-21T06:15:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41b4fe0 con 0x561c38d6e1c0 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9661640 1 -- 172.21.15.17:0/2478432018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 msgr2=0x561c39157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9661640 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9661640 1 -- 172.21.15.17:0/2478432018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 msgr2=0x561c3915f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9661640 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c3915f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9661640 1 -- 172.21.15.17:0/2478432018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c39158e90 con 0x561c38d86980 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9e62640 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12fa663640 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c3915f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.267+0000 7f12f9661640 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39163e80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f12e40acc00 tx=0x7f12e401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700499cdbc0a590c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.268+0000 7f12df7fe640 1 -- 172.21.15.17:0/2478432018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40a9080 con 0x561c38d86980 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.268+0000 7f12df7fe640 1 -- 172.21.15.17:0/2478432018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e40b6690 con 0x561c38d86980 2024-09-21T06:15:28.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.268+0000 7f12df7fe640 1 -- 172.21.15.17:0/2478432018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40d00d0 con 0x561c38d86980 2024-09-21T06:15:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 msgr2=0x561c39163e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39163e80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f12e40acc00 tx=0x7f12e401f000 comp rx=0 tx=0).stop 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 shutdown_connections 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d86980 0x561c39163e80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d8eb60 0x561c3915f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 --2- 172.21.15.17:0/2478432018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 >> 172.21.15.17:0/2478432018 conn(0x561c38da3990 msgr2=0x561c3916cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 shutdown_connections 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.269+0000 7f130263a740 1 -- 172.21.15.17:0/2478432018 wait complete. 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 -- start start 2024-09-21T06:15:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 Processor -- start 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39177790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d86980 0x561c39175cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d8eb60 0x561c39176400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41b5650 con 0x561c38d8eb60 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41b6ac0 con 0x561c38d86980 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f12f41b5d20 con 0x561c38d6e1c0 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.270+0000 7f130263a740 10 client.0 _ll_register_callbacks cb 0x7f12e40b1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39177790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9e62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39177790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:54520/0 (socket says 172.21.15.17:54520) 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9e62640 1 -- 172.21.15.17:0/2550604656 learned_addr learned my addr 172.21.15.17:0/2550604656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12fa663640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d8eb60 0x561c39176400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9661640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d86980 0x561c39175cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9661640 1 -- 172.21.15.17:0/2550604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 msgr2=0x561c39177790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9661640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39177790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9661640 1 -- 172.21.15.17:0/2550604656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d8eb60 msgr2=0x561c39176400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9661640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d8eb60 0x561c39176400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12f9661640 1 -- 172.21.15.17:0/2550604656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c391de4c0 con 0x561c38d86980 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.271+0000 7f12fa663640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d8eb60 0x561c39176400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f12f9661640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d86980 0x561c39175cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12e40ac970 tx=0x7f12e4004dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61fa4bd0e7274883 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f12dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2550604656 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e40a9080 con 0x561c38d86980 2024-09-21T06:15:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12e40b6690 con 0x561c38d86980 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2550604656 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f12e40abed0 con 0x561c38d86980 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2550604656 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12e40a92c0 con 0x561c38d86980 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f130263a740 10 client.25454 fetch_fsmap learned FSMap version 28 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c391de4c0 con 0x561c38d86980 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.272+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2550604656 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12e40b6690 con 0x561c38d86980 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2550604656 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f12e40ab940 con 0x561c38d86980 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f130263a740 10 client.25454 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f130263a740 10 client.25454 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f130263a740 20 client.25454 populate_metadata read hostname 'smithi017' 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f130263a740 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38daf840 0x561c391e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f130263a740 4 client.25454 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x561c390ca590 con 0x561c38daf840 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f12f9e62640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38daf840 0x561c391e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.273+0000 7f12dd7fa640 10 client.25454 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:28.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.274+0000 7f12f9e62640 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38daf840 0x561c391e19b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53c1b4c9d582fce7 server_cookie=3e308bf951a9e5b6 in_seq=0 out_seq=0 2024-09-21T06:15:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.998+0000 7f12dd7fa640 1 -- 172.21.15.17:0/2550604656 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561c390ca590 con 0x561c38daf840 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.998+0000 7f12dd7fa640 10 client.25454 handle_command_reply: tid=0 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.998+0000 7f130263a740 1 client.25454 shutdown 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d86980 msgr2=0x561c39175cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d86980 0x561c39175cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12e40ac970 tx=0x7f12e4004dd0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 shutdown_connections 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561c38daf840 0x561c391e19b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561c38d8eb60 0x561c39176400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c38d86980 0x561c39175cf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f12dd7fa640 0 client.25454 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 --2- 172.21.15.17:0/2550604656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561c38d6e1c0 0x561c39177790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 >> 172.21.15.17:0/2550604656 conn(0x561c38da3990 msgr2=0x561c3916cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 shutdown_connections 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 1 -- 172.21.15.17:0/2550604656 wait complete. 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:28.999+0000 7f130263a740 20 client.25454 trim_cache size 0 max 16384 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 28, 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 14, 2024-09-21T06:15:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "eca8b863": { 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 14, 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 147.8, 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:15:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:15:29.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e00b6590 msgr2=0x7f12e00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e00b6590 0x7f12e00b8aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12ec006010 tx=0x7f12ec009440 comp rx=0 tx=0).stop 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 msgr2=0x7f12f4197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f4197f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f12e40097d0 tx=0x7f12e4009c90 comp rx=0 tx=0).stop 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 shutdown_connections 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f12e00b6590 0x7f12e00b8aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12f4108d10 0x7f12f4198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12f41083c0 0x7f12f4197f30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 --2- 172.21.15.17:0/2875982047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f4102a80 0x7f12f419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 >> 172.21.15.17:0/2875982047 conn(0x7f12f4079760 msgr2=0x7f12f41043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 shutdown_connections 2024-09-21T06:15:29.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:29.000+0000 7f12fc0c6640 1 -- 172.21.15.17:0/2875982047 wait complete. 2024-09-21T06:15:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:28 smithi089 ceph-mon[33879]: pgmap v455: 129 pgs: 129 active+clean; 39 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T06:15:29.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:28 smithi017 ceph-mon[31080]: pgmap v455: 129 pgs: 129 active+clean; 39 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T06:15:29.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:28 smithi081 ceph-mon[33870]: pgmap v455: 129 pgs: 129 active+clean; 39 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T06:15:29.880 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eca8b863', quiesce took 4.8 seconds. Will release after: 23.0 2024-09-21T06:15:30.467 INFO:tasks.workunit.client.0.smithi017.stdout: 5 5725 37 3775 67 855 63 2024-09-21T06:15:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:30 smithi089 ceph-mon[33879]: pgmap v456: 129 pgs: 129 active+clean; 42 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 319 KiB/s wr, 16 op/s 2024-09-21T06:15:31.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:30 smithi017 ceph-mon[31080]: pgmap v456: 129 pgs: 129 active+clean; 42 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 319 KiB/s wr, 16 op/s 2024-09-21T06:15:31.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:30 smithi081 ceph-mon[33870]: pgmap v456: 129 pgs: 129 active+clean; 42 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 319 KiB/s wr, 16 op/s 2024-09-21T06:15:33.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:32 smithi089 ceph-mon[33879]: pgmap v457: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 409 KiB/s wr, 22 op/s 2024-09-21T06:15:33.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:32 smithi017 ceph-mon[31080]: pgmap v457: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 409 KiB/s wr, 22 op/s 2024-09-21T06:15:33.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:32 smithi081 ceph-mon[33870]: pgmap v457: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 409 KiB/s wr, 22 op/s 2024-09-21T06:15:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:34 smithi089 ceph-mon[33879]: pgmap v458: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 439 KiB/s wr, 22 op/s 2024-09-21T06:15:35.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:34 smithi017 ceph-mon[31080]: pgmap v458: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 439 KiB/s wr, 22 op/s 2024-09-21T06:15:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:34 smithi081 ceph-mon[33870]: pgmap v458: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 439 KiB/s wr, 22 op/s 2024-09-21T06:15:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:36 smithi089 ceph-mon[33879]: pgmap v459: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 527 KiB/s wr, 38 op/s 2024-09-21T06:15:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:36 smithi017 ceph-mon[31080]: pgmap v459: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 527 KiB/s wr, 38 op/s 2024-09-21T06:15:37.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:36 smithi081 ceph-mon[33870]: pgmap v459: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 527 KiB/s wr, 38 op/s 2024-09-21T06:15:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:38 smithi089 ceph-mon[33879]: pgmap v460: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 523 KiB/s wr, 39 op/s 2024-09-21T06:15:39.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:38 smithi017 ceph-mon[31080]: pgmap v460: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 523 KiB/s wr, 39 op/s 2024-09-21T06:15:39.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:38 smithi081 ceph-mon[33870]: pgmap v460: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 523 KiB/s wr, 39 op/s 2024-09-21T06:15:40.467 INFO:tasks.workunit.client.0.smithi017.stdout: 5 239 0 171 0 184 0 2024-09-21T06:15:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:40 smithi089 ceph-mon[33879]: pgmap v461: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 476 KiB/s wr, 35 op/s 2024-09-21T06:15:41.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:40 smithi017 ceph-mon[31080]: pgmap v461: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 476 KiB/s wr, 35 op/s 2024-09-21T06:15:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:40 smithi081 ceph-mon[33870]: pgmap v461: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 476 KiB/s wr, 35 op/s 2024-09-21T06:15:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:42 smithi089 ceph-mon[33879]: pgmap v462: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 209 KiB/s wr, 29 op/s 2024-09-21T06:15:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:42 smithi017 ceph-mon[31080]: pgmap v462: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 209 KiB/s wr, 29 op/s 2024-09-21T06:15:43.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:42 smithi081 ceph-mon[33870]: pgmap v462: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 209 KiB/s wr, 29 op/s 2024-09-21T06:15:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:44 smithi089 ceph-mon[33879]: pgmap v463: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 119 KiB/s wr, 22 op/s 2024-09-21T06:15:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:44 smithi017 ceph-mon[31080]: pgmap v463: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 119 KiB/s wr, 22 op/s 2024-09-21T06:15:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:44 smithi081 ceph-mon[33870]: pgmap v463: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 119 KiB/s wr, 22 op/s 2024-09-21T06:15:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:46 smithi017 ceph-mon[31080]: pgmap v464: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-09-21T06:15:47.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:46 smithi081 ceph-mon[33870]: pgmap v464: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-09-21T06:15:47.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:46 smithi089 ceph-mon[33879]: pgmap v464: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-09-21T06:15:49.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:48 smithi017 ceph-mon[31080]: pgmap v465: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T06:15:49.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:48 smithi081 ceph-mon[33870]: pgmap v465: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T06:15:49.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:48 smithi089 ceph-mon[33879]: pgmap v465: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T06:15:50.467 INFO:tasks.workunit.client.0.smithi017.stdout: 5 0 0 0 0 0 0 2024-09-21T06:15:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:50 smithi017 ceph-mon[31080]: pgmap v466: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T06:15:51.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:50 smithi081 ceph-mon[33870]: pgmap v466: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T06:15:51.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:50 smithi089 ceph-mon[33879]: pgmap v466: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T06:15:52.881 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:15:53.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:52 smithi017 ceph-mon[31080]: pgmap v467: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T06:15:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:53.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:52 smithi081 ceph-mon[33870]: pgmap v467: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T06:15:53.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:52 smithi089 ceph-mon[33879]: pgmap v467: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T06:15:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.641+0000 7fba1a5c5640 1 -- 172.21.15.17:0/808831760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba14108d20 msgr2=0x7fba1410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.641+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/808831760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba14108d20 0x7fba1410f550 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009ca0 tx=0x7fba0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 -- 172.21.15.17:0/808831760 shutdown_connections 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/808831760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba14108d20 0x7fba1410f550 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/808831760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba141083d0 0x7fba141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/808831760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba14102ae0 0x7fba14102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 -- 172.21.15.17:0/808831760 >> 172.21.15.17:0/808831760 conn(0x7fba140797b0 msgr2=0x7fba14079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 -- 172.21.15.17:0/808831760 shutdown_connections 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 -- 172.21.15.17:0/808831760 wait complete. 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 Processor -- start 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.642+0000 7fba1a5c5640 1 -- start start 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba1a5c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba14102ae0 0x7fba1419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba1a5c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 0x7fba1419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba1a5c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba14108d20 0x7fba1419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba1a5c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba141128e0 con 0x7fba141083d0 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba1a5c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba14112760 con 0x7fba14108d20 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba1a5c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fba14112a60 con 0x7fba14102ae0 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 0x7fba1419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 0x7fba1419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56884/0 (socket says 172.21.15.17:56884) 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 -- 172.21.15.17:0/3851526109 learned_addr learned my addr 172.21.15.17:0/3851526109 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba13fff640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba14102ae0 0x7fba1419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba18b62640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba14108d20 0x7fba1419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 -- 172.21.15.17:0/3851526109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba14102ae0 msgr2=0x7fba1419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba14102ae0 0x7fba1419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 -- 172.21.15.17:0/3851526109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba14108d20 msgr2=0x7fba1419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba14108d20 0x7fba1419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 -- 172.21.15.17:0/3851526109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba141a02d0 con 0x7fba141083d0 2024-09-21T06:15:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.643+0000 7fba0bfff640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 0x7fba1419a9c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c970 tx=0x7fb9fc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.644+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc004220 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.644+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9fc007e40 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.644+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba141a05c0 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.644+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0047a0 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.644+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a6de0 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.645+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14102ef0 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.646+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb9fc0079b0 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.647+0000 7fba11ffb640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fba000b6540 0x7fba000b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.647+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fb9fc0e76c0 con 0x7fba141083d0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.647+0000 7fba13fff640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fba000b6540 0x7fba000b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.648+0000 7fba13fff640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fba000b6540 0x7fba000b8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba0400abe0 tx=0x7fba0400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.651+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9fc014030 con 0x7fba141083d0 2024-09-21T06:15:53.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.878+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba1419b550 con 0x7fba141083d0 2024-09-21T06:15:53.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.879+0000 7fba11ffb640 1 -- 172.21.15.17:0/3851526109 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11889 (secure 0 0 0) 0x7fba1419b550 con 0x7fba141083d0 2024-09-21T06:15:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:15:53.882 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-21T06:14:42:761166+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:14:42.746390+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24656,24649,24631]},"id":1}]} 2024-09-21T06:15:53.882 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fba000b6540 msgr2=0x7fba000b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fba000b6540 0x7fba000b8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba0400abe0 tx=0x7fba0400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 msgr2=0x7fba1419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 0x7fba1419a9c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00c970 tx=0x7fb9fc00cd70 comp rx=0 tx=0).stop 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 shutdown_connections 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fba000b6540 0x7fba000b8a50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba141083d0 0x7fba1419a9c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba14108d20 0x7fba1419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 --2- 172.21.15.17:0/3851526109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba14102ae0 0x7fba1419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:53.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 >> 172.21.15.17:0/3851526109 conn(0x7fba140797b0 msgr2=0x7fba14101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:53.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 shutdown_connections 2024-09-21T06:15:53.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:53.882+0000 7fba1a5c5640 1 -- 172.21.15.17:0/3851526109 wait complete. 2024-09-21T06:15:54.704 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id eca8b863 --release --await' 2024-09-21T06:15:54.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id eca8b863 --release --await 2024-09-21T06:15:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:55.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:54 smithi017 ceph-mon[31080]: pgmap v468: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T06:15:55.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:54 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3851526109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:55.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:54 smithi081 ceph-mon[33870]: pgmap v468: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T06:15:55.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:54 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3851526109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:55.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:54 smithi089 ceph-mon[33879]: pgmap v468: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T06:15:55.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:54 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3851526109' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 -- 172.21.15.17:0/704229810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d4105300 msgr2=0x7f19d410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 --2- 172.21.15.17:0/704229810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d4105300 0x7f19d410d850 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009900 tx=0x7f19bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 -- 172.21.15.17:0/704229810 shutdown_connections 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 --2- 172.21.15.17:0/704229810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d4105300 0x7f19d410d850 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 --2- 172.21.15.17:0/704229810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d410de10 0x7f19d4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 --2- 172.21.15.17:0/704229810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d41049b0 0x7f19d4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 -- 172.21.15.17:0/704229810 >> 172.21.15.17:0/704229810 conn(0x7f19d4079730 msgr2=0x7f19d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 -- 172.21.15.17:0/704229810 shutdown_connections 2024-09-21T06:15:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.459+0000 7f19da0e3640 1 -- 172.21.15.17:0/704229810 wait complete. 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 Processor -- start 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 -- start start 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d41049b0 0x7f19d419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 0x7f19d419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d410de10 0x7f19d419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19d4113920 con 0x7f19d410de10 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41137a0 con 0x7f19d41049b0 2024-09-21T06:15:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19da0e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f19d4113aa0 con 0x7f19d4105300 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 0x7f19d419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d41049b0 0x7f19d419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d410de10 0x7f19d419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 0x7f19d419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:49898/0 (socket says 172.21.15.17:49898) 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.460+0000 7f19cbfff640 1 -- 172.21.15.17:0/4119422320 learned_addr learned my addr 172.21.15.17:0/4119422320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d3fff640 1 -- 172.21.15.17:0/4119422320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 msgr2=0x7f19d419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d3fff640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 0x7f19d419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d3fff640 1 -- 172.21.15.17:0/4119422320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d41049b0 msgr2=0x7f19d419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d3fff640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d41049b0 0x7f19d419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d3fff640 1 -- 172.21.15.17:0/4119422320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d41a03c0 con 0x7f19d410de10 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19cbfff640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 0x7f19d419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d37fe640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d41049b0 0x7f19d419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d3fff640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d410de10 0x7f19d419fc90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00e940 tx=0x7f19cc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d17fa640 1 -- 172.21.15.17:0/4119422320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc004d20 con 0x7f19d410de10 2024-09-21T06:15:55.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d41a06b0 con 0x7f19d410de10 2024-09-21T06:15:55.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d17fa640 1 -- 172.21.15.17:0/4119422320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19cc005020 con 0x7f19d410de10 2024-09-21T06:15:55.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19d17fa640 1 -- 172.21.15.17:0/4119422320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0116d0 con 0x7f19d410de10 2024-09-21T06:15:55.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.461+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d41a6e10 con 0x7f19d410de10 2024-09-21T06:15:55.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.464+0000 7f19e0657740 1 Processor -- start 2024-09-21T06:15:55.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.464+0000 7f19d17fa640 1 -- 172.21.15.17:0/4119422320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f19cc00cb20 con 0x7f19d410de10 2024-09-21T06:15:55.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.464+0000 7f19e0657740 1 -- start start 2024-09-21T06:15:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19e0657740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aeb5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19e0657740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aeb5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19e0657740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aeb5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19e0657740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56006ada0dc0 con 0x56006aaee840 2024-09-21T06:15:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19e0657740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56006ae2d1f0 con 0x56006ab0f520 2024-09-21T06:15:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19e0657740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56006ae1c620 con 0x56006aae6660 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aeb5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aeb5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aeb5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56900/0 (socket says 172.21.15.17:56900) 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19cbfff640 1 -- 172.21.15.17:0/3444594494 learned_addr learned my addr 172.21.15.17:0/3444594494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19cbfff640 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aeb5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d17fa640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f19c00b6590 0x7f19c00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d37fe640 1 -- 172.21.15.17:0/3444594494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 msgr2=0x56006aeb5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d37fe640 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aeb5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d37fe640 1 -- 172.21.15.17:0/3444594494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 msgr2=0x56006aeb5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d37fe640 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aeb5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.465+0000 7f19d37fe640 1 -- 172.21.15.17:0/3444594494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56006ade4fd0 con 0x56006aae6660 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19d3fff640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f19c00b6590 0x7f19c00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19d17fa640 1 -- 172.21.15.17:0/4119422320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f19cc0e75f0 con 0x7f19d410de10 2024-09-21T06:15:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19d37fe640 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aeb5a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19c40103d0 tx=0x7f19c4010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502cf98bb0b3dda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19c9ffb640 1 -- 172.21.15.17:0/3444594494 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4004220 con 0x56006aae6660 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19d3fff640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f19c00b6590 0x7f19c00b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0e50d0 tx=0x7f19cc00ef30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19c9ffb640 1 -- 172.21.15.17:0/3444594494 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19c40043c0 con 0x56006aae6660 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.466+0000 7f19c9ffb640 1 -- 172.21.15.17:0/3444594494 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4011940 con 0x56006aae6660 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 -- 172.21.15.17:0/3444594494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 msgr2=0x56006aeb5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aeb5a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19c40103d0 tx=0x7f19c4010890 comp rx=0 tx=0).stop 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 -- 172.21.15.17:0/3444594494 shutdown_connections 2024-09-21T06:15:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aeb5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aeb5a50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 --2- 172.21.15.17:0/3444594494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aeb5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 -- 172.21.15.17:0/3444594494 >> 172.21.15.17:0/3444594494 conn(0x56006ab03910 msgr2=0x56006aeb3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 -- 172.21.15.17:0/3444594494 shutdown_connections 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.467+0000 7f19e0657740 1 -- 172.21.15.17:0/3444594494 wait complete. 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 -- start start 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 Processor -- start 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aaee840 0x56006aec5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aec59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56006adb7300 con 0x56006aae6660 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56006ae20430 con 0x56006ab0f520 2024-09-21T06:15:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56006ac7dbb0 con 0x56006aaee840 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19e0657740 10 client.0 _ll_register_callbacks cb 0x56006add1120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56908/0 (socket says 172.21.15.17:56908) 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.468+0000 7f19cbfff640 1 -- 172.21.15.17:0/528015846 learned_addr learned my addr 172.21.15.17:0/528015846 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19d37fe640 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aaee840 0x56006aec5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19cbfff640 1 -- 172.21.15.17:0/528015846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aaee840 msgr2=0x56006aec5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19cbfff640 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aaee840 0x56006aec5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19cbfff640 1 -- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 msgr2=0x56006aec59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19cbfff640 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aec59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19cbfff640 1 -- 172.21.15.17:0/528015846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56006ada6780 con 0x56006aae6660 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19cbfff640 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec4f40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19bc000c00 tx=0x7f19bc005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845d2c8cf0bd5b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19b2ffd640 1 -- 172.21.15.17:0/528015846 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc035040 con 0x56006aae6660 2024-09-21T06:15:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19b2ffd640 1 -- 172.21.15.17:0/528015846 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f19bc004450 con 0x56006aae6660 2024-09-21T06:15:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c40043c0 con 0x56006aae6660 2024-09-21T06:15:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19b2ffd640 1 -- 172.21.15.17:0/528015846 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19bc0035f0 con 0x56006aae6660 2024-09-21T06:15:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19e0657740 10 client.15681 fetch_fsmap learned FSMap version 28 2024-09-21T06:15:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.469+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56006ab7ab00 con 0x56006aae6660 2024-09-21T06:15:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19b2ffd640 1 -- 172.21.15.17:0/528015846 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19c40043c0 con 0x56006aae6660 2024-09-21T06:15:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19b2ffd640 1 -- 172.21.15.17:0/528015846 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f19bc047070 con 0x56006aae6660 2024-09-21T06:15:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19e0657740 10 client.15681 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:15:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19e0657740 10 client.15681 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:15:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19e0657740 20 client.15681 populate_metadata read hostname 'smithi017' 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19e0657740 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aacdea0 0x56006aed71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19e0657740 4 client.15681 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56006ae2f140 con 0x56006aacdea0 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.470+0000 7f19d37fe640 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aacdea0 0x56006aed71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.471+0000 7f19b2ffd640 10 client.15681 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.471+0000 7f19d37fe640 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aacdea0 0x56006aed71d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de85e2a655b22c5f server_cookie=7ecb98ccd60cdc90 in_seq=0 out_seq=0 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19b2ffd640 1 -- 172.21.15.17:0/528015846 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56006ae2f140 con 0x56006aacdea0 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19b2ffd640 10 client.15681 handle_command_reply: tid=0 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 client.15681 shutdown 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 msgr2=0x56006aec4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec4f40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f19bc000c00 tx=0x7f19bc005d50 comp rx=0 tx=0).stop 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 shutdown_connections 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aacdea0 0x56006aed71d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aec59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aaee840 0x56006aec5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 --2- 172.21.15.17:0/528015846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec4f40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 >> 172.21.15.17:0/528015846 conn(0x56006ab03910 msgr2=0x56006aeb86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19b2ffd640 0 client.15681 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 shutdown_connections 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 1 -- 172.21.15.17:0/528015846 wait complete. 2024-09-21T06:15:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.472+0000 7f19e0657740 20 client.15681 trim_cache size 0 max 16384 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.489+0000 7f19e0657740 1 Processor -- start 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.489+0000 7f19e0657740 1 -- start start 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19e0657740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aec2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19e0657740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aec2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19e0657740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aedc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19e0657740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41b11d0 con 0x56006aaee840 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19e0657740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41aea70 con 0x56006ab0f520 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19e0657740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41ac8e0 con 0x56006aae6660 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aec2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aec2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56918/0 (socket says 172.21.15.17:56918) 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 -- 172.21.15.17:0/3418280346 learned_addr learned my addr 172.21.15.17:0/3418280346 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19cbfff640 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aedc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19cbfff640 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aec2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 -- 172.21.15.17:0/3418280346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 msgr2=0x56006aec2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aec2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 -- 172.21.15.17:0/3418280346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 msgr2=0x56006aedc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aedc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 -- 172.21.15.17:0/3418280346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56006abf1960 con 0x56006aaee840 2024-09-21T06:15:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.490+0000 7f19d37fe640 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aec2670 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19c400b620 tx=0x7f19c40115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5d552b09924f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.491+0000 7f19c97fa640 1 -- 172.21.15.17:0/3418280346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4005330 con 0x56006aaee840 2024-09-21T06:15:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.491+0000 7f19c97fa640 1 -- 172.21.15.17:0/3418280346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19c40054d0 con 0x56006aaee840 2024-09-21T06:15:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.491+0000 7f19c97fa640 1 -- 172.21.15.17:0/3418280346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c40118b0 con 0x56006aaee840 2024-09-21T06:15:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 -- 172.21.15.17:0/3418280346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 msgr2=0x56006aec2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aec2670 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19c400b620 tx=0x7f19c40115e0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 -- 172.21.15.17:0/3418280346 shutdown_connections 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aaee840 0x56006aec2670 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006ab0f520 0x56006aedc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 --2- 172.21.15.17:0/3418280346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006aae6660 0x56006aec2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 -- 172.21.15.17:0/3418280346 >> 172.21.15.17:0/3418280346 conn(0x56006ab03910 msgr2=0x56006aeb8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 -- 172.21.15.17:0/3418280346 shutdown_connections 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 -- 172.21.15.17:0/3418280346 wait complete. 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 -- start start 2024-09-21T06:15:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.492+0000 7f19e0657740 1 Processor -- start 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006aaee840 0x56006aec9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006ab0f520 0x56006af40bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41acf30 con 0x56006aae6660 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41ae3a0 con 0x56006aaee840 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f19d41ad600 con 0x56006ab0f520 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19e0657740 10 client.0 _ll_register_callbacks cb 0x7f19bc031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:15:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56922/0 (socket says 172.21.15.17:56922) 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 -- 172.21.15.17:0/1318136525 learned_addr learned my addr 172.21.15.17:0/1318136525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19d37fe640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006aaee840 0x56006aec9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006ab0f520 0x56006af40bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 -- 172.21.15.17:0/1318136525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006ab0f520 msgr2=0x56006af40bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006ab0f520 0x56006af40bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 -- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006aaee840 msgr2=0x56006aec9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006aaee840 0x56006aec9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.493+0000 7f19cbfff640 1 -- 172.21.15.17:0/1318136525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56006af41110 con 0x56006aae6660 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19cbfff640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec98d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009340 tx=0x7f19bc0092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65202d9932a42933 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1318136525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc035040 con 0x56006aae6660 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1318136525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f19bc031c20 con 0x56006aae6660 2024-09-21T06:15:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c40054d0 con 0x56006aae6660 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1318136525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19bc031e20 con 0x56006aae6660 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19e0657740 10 client.15687 fetch_fsmap learned FSMap version 28 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56006af423d0 con 0x56006aae6660 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1318136525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19c40054d0 con 0x56006aae6660 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1318136525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f19bc047070 con 0x56006aae6660 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19e0657740 10 client.15687 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19e0657740 10 client.15687 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.494+0000 7f19e0657740 20 client.15687 populate_metadata read hostname 'smithi017' 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.495+0000 7f19e0657740 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aaa3250 0x56006af44b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.495+0000 7f19e0657740 4 client.15687 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eca8b863", "release": true, "await": true}] 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.495+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eca8b863", "release": true, "await": true}) -- 0x56006ae2abf0 con 0x56006aaa3250 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.495+0000 7f19d37fe640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aaa3250 0x56006af44b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.495+0000 7f19d37fe640 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aaa3250 0x56006af44b90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d126402f07ea019c server_cookie=316316cb7b4f6f48 in_seq=0 out_seq=0 2024-09-21T06:15:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.495+0000 7f19b2ffd640 10 client.15687 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19b2ffd640 1 -- 172.21.15.17:0/1318136525 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56006ae2abf0 con 0x56006aaa3250 2024-09-21T06:15:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19b2ffd640 10 client.15687 handle_command_reply: tid=0 2024-09-21T06:15:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 client.15687 shutdown 2024-09-21T06:15:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 msgr2=0x56006aec98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec98d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009340 tx=0x7f19bc0092b0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 shutdown_connections 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56006aaa3250 0x56006af44b90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56006ab0f520 0x56006af40bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56006aaee840 0x56006aec9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 --2- 172.21.15.17:0/1318136525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56006aae6660 0x56006aec98d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 >> 172.21.15.17:0/1318136525 conn(0x56006ab03910 msgr2=0x56006aeb8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19b2ffd640 0 client.15687 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 shutdown_connections 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.574+0000 7f19e0657740 1 -- 172.21.15.17:0/1318136525 wait complete. 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19e0657740 20 client.15687 trim_cache size 0 max 16384 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:15:55.578 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 28, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 16, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "eca8b863": { 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 16, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 147.8, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:15:55.579 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:15:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f19c00b6590 msgr2=0x7f19c00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f19c00b6590 0x7f19c00b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0e50d0 tx=0x7f19cc00ef30 comp rx=0 tx=0).stop 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d410de10 msgr2=0x7f19d419fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d410de10 0x7f19d419fc90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00e940 tx=0x7f19cc00ee00 comp rx=0 tx=0).stop 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 shutdown_connections 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f19c00b6590 0x7f19c00b8aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19d410de10 0x7f19d419fc90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19d4105300 0x7f19d419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 --2- 172.21.15.17:0/4119422320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d41049b0 0x7f19d419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 >> 172.21.15.17:0/4119422320 conn(0x7f19d4079730 msgr2=0x7f19d40ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.575+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 shutdown_connections 2024-09-21T06:15:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:15:55.576+0000 7f19da0e3640 1 -- 172.21.15.17:0/4119422320 wait complete. 2024-09-21T06:15:56.421 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eca8b863', total seconds elapsed: 31.4 2024-09-21T06:15:57.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:56 smithi017 ceph-mon[31080]: pgmap v469: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-21T06:15:57.167 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:56 smithi089 ceph-mon[33879]: pgmap v469: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-21T06:15:57.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:56 smithi081 ceph-mon[33870]: pgmap v469: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-21T06:15:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:58 smithi017 ceph-mon[31080]: pgmap v470: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T06:15:59.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:58 smithi081 ceph-mon[33870]: pgmap v470: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T06:15:59.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:58 smithi089 ceph-mon[33879]: pgmap v470: 129 pgs: 129 active+clean; 44 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T06:16:00.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:15:59 smithi081 ceph-mon[33870]: pgmap v471: 129 pgs: 129 active+clean; 47 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 273 KiB/s wr, 18 op/s 2024-09-21T06:16:00.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:15:59 smithi089 ceph-mon[33879]: pgmap v471: 129 pgs: 129 active+clean; 47 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 273 KiB/s wr, 18 op/s 2024-09-21T06:16:00.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:15:59 smithi017 ceph-mon[31080]: pgmap v471: 129 pgs: 129 active+clean; 47 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 273 KiB/s wr, 18 op/s 2024-09-21T06:16:00.467 INFO:tasks.workunit.client.0.smithi017.stdout: 8 5000 93 3089 187 676 110 2024-09-21T06:16:02.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:02 smithi089 ceph-mon[33879]: pgmap v472: 129 pgs: 129 active+clean; 51 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 633 KiB/s wr, 34 op/s 2024-09-21T06:16:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:02 smithi017 ceph-mon[31080]: pgmap v472: 129 pgs: 129 active+clean; 51 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 633 KiB/s wr, 34 op/s 2024-09-21T06:16:02.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:02 smithi081 ceph-mon[33870]: pgmap v472: 129 pgs: 129 active+clean; 51 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 633 KiB/s wr, 34 op/s 2024-09-21T06:16:04.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:04 smithi089 ceph-mon[33879]: pgmap v473: 129 pgs: 129 active+clean; 59 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-09-21T06:16:04.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:04 smithi017 ceph-mon[31080]: pgmap v473: 129 pgs: 129 active+clean; 59 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-09-21T06:16:04.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:04 smithi081 ceph-mon[33870]: pgmap v473: 129 pgs: 129 active+clean; 59 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-09-21T06:16:06.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:06 smithi089 ceph-mon[33879]: pgmap v474: 129 pgs: 129 active+clean; 63 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.6 MiB/s wr, 61 op/s 2024-09-21T06:16:06.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:06 smithi017 ceph-mon[31080]: pgmap v474: 129 pgs: 129 active+clean; 63 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.6 MiB/s wr, 61 op/s 2024-09-21T06:16:06.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:06 smithi081 ceph-mon[33870]: pgmap v474: 129 pgs: 129 active+clean; 63 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.6 MiB/s wr, 61 op/s 2024-09-21T06:16:08.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:08 smithi089 ceph-mon[33879]: pgmap v475: 129 pgs: 129 active+clean; 68 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 2.1 MiB/s wr, 89 op/s 2024-09-21T06:16:08.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:08 smithi017 ceph-mon[31080]: pgmap v475: 129 pgs: 129 active+clean; 68 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 2.1 MiB/s wr, 89 op/s 2024-09-21T06:16:08.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:08 smithi081 ceph-mon[33870]: pgmap v475: 129 pgs: 129 active+clean; 68 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 2.1 MiB/s wr, 89 op/s 2024-09-21T06:16:10.467 INFO:tasks.workunit.client.0.smithi017.stdout: 16 10030 416 6437 337 1708 374 2024-09-21T06:16:10.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:10 smithi089 ceph-mon[33879]: pgmap v476: 129 pgs: 129 active+clean; 73 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2024-09-21T06:16:10.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:10 smithi017 ceph-mon[31080]: pgmap v476: 129 pgs: 129 active+clean; 73 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2024-09-21T06:16:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:10 smithi081 ceph-mon[33870]: pgmap v476: 129 pgs: 129 active+clean; 73 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 2.5 MiB/s wr, 109 op/s 2024-09-21T06:16:12.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:12 smithi089 ceph-mon[33879]: pgmap v477: 129 pgs: 129 active+clean; 85 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 135 op/s 2024-09-21T06:16:12.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:12 smithi017 ceph-mon[31080]: pgmap v477: 129 pgs: 129 active+clean; 85 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 135 op/s 2024-09-21T06:16:12.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:12 smithi081 ceph-mon[33870]: pgmap v477: 129 pgs: 129 active+clean; 85 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 135 op/s 2024-09-21T06:16:14.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:14 smithi089 ceph-mon[33879]: pgmap v478: 129 pgs: 129 active+clean; 88 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-21T06:16:14.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:14 smithi017 ceph-mon[31080]: pgmap v478: 129 pgs: 129 active+clean; 88 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-21T06:16:14.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:14 smithi081 ceph-mon[33870]: pgmap v478: 129 pgs: 129 active+clean; 88 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-21T06:16:16.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:16 smithi089 ceph-mon[33879]: pgmap v479: 129 pgs: 129 active+clean; 96 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.3 MiB/s wr, 157 op/s 2024-09-21T06:16:16.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:16 smithi017 ceph-mon[31080]: pgmap v479: 129 pgs: 129 active+clean; 96 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.3 MiB/s wr, 157 op/s 2024-09-21T06:16:16.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:16 smithi081 ceph-mon[33870]: pgmap v479: 129 pgs: 129 active+clean; 96 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.3 MiB/s wr, 157 op/s 2024-09-21T06:16:18.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:18 smithi089 ceph-mon[33879]: pgmap v480: 129 pgs: 129 active+clean; 102 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 174 op/s 2024-09-21T06:16:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:18 smithi017 ceph-mon[31080]: pgmap v480: 129 pgs: 129 active+clean; 102 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 174 op/s 2024-09-21T06:16:18.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:18 smithi081 ceph-mon[33870]: pgmap v480: 129 pgs: 129 active+clean; 102 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 174 op/s 2024-09-21T06:16:19.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:19 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:19.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:19 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:19.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:19 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:20.467 INFO:tasks.workunit.client.0.smithi017.stdout: 22 11894 310 7911 218 2744 91 2024-09-21T06:16:20.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:20 smithi089 ceph-mon[33879]: pgmap v481: 129 pgs: 129 active+clean; 105 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-09-21T06:16:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:20 smithi017 ceph-mon[31080]: pgmap v481: 129 pgs: 129 active+clean; 105 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-09-21T06:16:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:20 smithi081 ceph-mon[33870]: pgmap v481: 129 pgs: 129 active+clean; 105 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2024-09-21T06:16:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:22 smithi089 ceph-mon[33879]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 165 op/s 2024-09-21T06:16:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:22 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:22 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:22 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:22 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:16:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:22 smithi017 ceph-mon[31080]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 165 op/s 2024-09-21T06:16:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:22 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:22 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:22 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:22 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:16:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:22 smithi081 ceph-mon[33870]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 165 op/s 2024-09-21T06:16:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:22 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:22 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:22 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:22 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:16:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:24 smithi089 ceph-mon[33879]: pgmap v483: 129 pgs: 129 active+clean; 111 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2024-09-21T06:16:24.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:24 smithi017 ceph-mon[31080]: pgmap v483: 129 pgs: 129 active+clean; 111 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2024-09-21T06:16:24.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:24 smithi081 ceph-mon[33870]: pgmap v483: 129 pgs: 129 active+clean; 111 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 2.3 MiB/s wr, 141 op/s 2024-09-21T06:16:26.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:26 smithi089 ceph-mon[33879]: pgmap v484: 129 pgs: 129 active+clean; 115 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 149 op/s 2024-09-21T06:16:26.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:26 smithi017 ceph-mon[31080]: pgmap v484: 129 pgs: 129 active+clean; 115 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 149 op/s 2024-09-21T06:16:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:26 smithi081 ceph-mon[33870]: pgmap v484: 129 pgs: 129 active+clean; 115 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 149 op/s 2024-09-21T06:16:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:28 smithi089 ceph-mon[33879]: pgmap v485: 129 pgs: 129 active+clean; 117 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-09-21T06:16:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:28 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:28 smithi017 ceph-mon[31080]: pgmap v485: 129 pgs: 129 active+clean; 117 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-09-21T06:16:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:28 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:28.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:28 smithi081 ceph-mon[33870]: pgmap v485: 129 pgs: 129 active+clean; 117 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-09-21T06:16:28.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:28 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:30.467 INFO:tasks.workunit.client.0.smithi017.stdout: 25 12005 190 7671 108 2633 176 2024-09-21T06:16:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:30 smithi089 ceph-mon[33879]: pgmap v486: 129 pgs: 129 active+clean; 121 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.8 MiB/s wr, 143 op/s 2024-09-21T06:16:30.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:30 smithi017 ceph-mon[31080]: pgmap v486: 129 pgs: 129 active+clean; 121 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.8 MiB/s wr, 143 op/s 2024-09-21T06:16:30.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:30 smithi081 ceph-mon[33870]: pgmap v486: 129 pgs: 129 active+clean; 121 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.8 MiB/s wr, 143 op/s 2024-09-21T06:16:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:32 smithi089 ceph-mon[33879]: pgmap v487: 129 pgs: 129 active+clean; 123 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.7 MiB/s wr, 157 op/s 2024-09-21T06:16:32.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:32 smithi017 ceph-mon[31080]: pgmap v487: 129 pgs: 129 active+clean; 123 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.7 MiB/s wr, 157 op/s 2024-09-21T06:16:32.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:32 smithi081 ceph-mon[33870]: pgmap v487: 129 pgs: 129 active+clean; 123 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.7 MiB/s wr, 157 op/s 2024-09-21T06:16:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:34 smithi089 ceph-mon[33879]: pgmap v488: 129 pgs: 129 active+clean; 127 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-21T06:16:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:34 smithi017 ceph-mon[31080]: pgmap v488: 129 pgs: 129 active+clean; 127 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-21T06:16:34.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:34 smithi081 ceph-mon[33870]: pgmap v488: 129 pgs: 129 active+clean; 127 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-21T06:16:36.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:36 smithi089 ceph-mon[33879]: pgmap v489: 129 pgs: 129 active+clean; 130 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-21T06:16:36.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:36 smithi017 ceph-mon[31080]: pgmap v489: 129 pgs: 129 active+clean; 130 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-21T06:16:36.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:36 smithi081 ceph-mon[33870]: pgmap v489: 129 pgs: 129 active+clean; 130 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-21T06:16:38.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:38 smithi017 ceph-mon[31080]: pgmap v490: 129 pgs: 129 active+clean; 138 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 202 op/s 2024-09-21T06:16:38.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:38 smithi089 ceph-mon[33879]: pgmap v490: 129 pgs: 129 active+clean; 138 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 202 op/s 2024-09-21T06:16:38.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:38 smithi081 ceph-mon[33870]: pgmap v490: 129 pgs: 129 active+clean; 138 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 202 op/s 2024-09-21T06:16:40.467 INFO:tasks.workunit.client.0.smithi017.stdout: 31 11308 223 6985 199 2368 154 2024-09-21T06:16:40.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:40 smithi089 ceph-mon[33879]: pgmap v491: 129 pgs: 129 active+clean; 140 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-09-21T06:16:40.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:40 smithi017 ceph-mon[31080]: pgmap v491: 129 pgs: 129 active+clean; 140 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-09-21T06:16:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:40 smithi081 ceph-mon[33870]: pgmap v491: 129 pgs: 129 active+clean; 140 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-09-21T06:16:42.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:42 smithi089 ceph-mon[33879]: pgmap v492: 129 pgs: 129 active+clean; 147 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 196 op/s 2024-09-21T06:16:42.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:42 smithi017 ceph-mon[31080]: pgmap v492: 129 pgs: 129 active+clean; 147 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 196 op/s 2024-09-21T06:16:42.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:42 smithi081 ceph-mon[33870]: pgmap v492: 129 pgs: 129 active+clean; 147 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 196 op/s 2024-09-21T06:16:44.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:44 smithi089 ceph-mon[33879]: pgmap v493: 129 pgs: 129 active+clean; 148 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 174 op/s 2024-09-21T06:16:44.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:44 smithi017 ceph-mon[31080]: pgmap v493: 129 pgs: 129 active+clean; 148 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 174 op/s 2024-09-21T06:16:44.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:44 smithi081 ceph-mon[33870]: pgmap v493: 129 pgs: 129 active+clean; 148 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 174 op/s 2024-09-21T06:16:46.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:46 smithi089 ceph-mon[33879]: pgmap v494: 129 pgs: 129 active+clean; 151 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 2.1 MiB/s wr, 169 op/s 2024-09-21T06:16:46.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:46 smithi017 ceph-mon[31080]: pgmap v494: 129 pgs: 129 active+clean; 151 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 2.1 MiB/s wr, 169 op/s 2024-09-21T06:16:46.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:46 smithi081 ceph-mon[33870]: pgmap v494: 129 pgs: 129 active+clean; 151 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 2.1 MiB/s wr, 169 op/s 2024-09-21T06:16:48.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:48 smithi089 ceph-mon[33879]: pgmap v495: 129 pgs: 129 active+clean; 159 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 211 op/s 2024-09-21T06:16:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:48 smithi017 ceph-mon[31080]: pgmap v495: 129 pgs: 129 active+clean; 159 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 211 op/s 2024-09-21T06:16:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:48 smithi081 ceph-mon[33870]: pgmap v495: 129 pgs: 129 active+clean; 159 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 211 op/s 2024-09-21T06:16:50.467 INFO:tasks.workunit.client.0.smithi017.stdout: 37 11015 217 7001 188 2802 139 2024-09-21T06:16:50.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:50 smithi089 ceph-mon[33879]: pgmap v496: 129 pgs: 129 active+clean; 165 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 180 op/s 2024-09-21T06:16:50.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:50 smithi017 ceph-mon[31080]: pgmap v496: 129 pgs: 129 active+clean; 165 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 180 op/s 2024-09-21T06:16:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:50 smithi081 ceph-mon[33870]: pgmap v496: 129 pgs: 129 active+clean; 165 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 180 op/s 2024-09-21T06:16:52.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:52 smithi089 ceph-mon[33879]: pgmap v497: 129 pgs: 129 active+clean; 168 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 191 op/s 2024-09-21T06:16:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:52 smithi017 ceph-mon[31080]: pgmap v497: 129 pgs: 129 active+clean; 168 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 191 op/s 2024-09-21T06:16:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:52 smithi081 ceph-mon[33870]: pgmap v497: 129 pgs: 129 active+clean; 168 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 191 op/s 2024-09-21T06:16:53.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:53 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:53.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:53 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:53.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:53 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:16:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:54 smithi017 ceph-mon[31080]: pgmap v498: 129 pgs: 129 active+clean; 171 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.1 MiB/s wr, 164 op/s 2024-09-21T06:16:54.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:54 smithi081 ceph-mon[33870]: pgmap v498: 129 pgs: 129 active+clean; 171 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.1 MiB/s wr, 164 op/s 2024-09-21T06:16:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:54 smithi089 ceph-mon[33879]: pgmap v498: 129 pgs: 129 active+clean; 171 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 2.1 MiB/s wr, 164 op/s 2024-09-21T06:16:56.638 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:56 smithi017 ceph-mon[31080]: pgmap v499: 129 pgs: 129 active+clean; 176 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 192 op/s 2024-09-21T06:16:56.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:56 smithi081 ceph-mon[33870]: pgmap v499: 129 pgs: 129 active+clean; 176 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 192 op/s 2024-09-21T06:16:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:56 smithi089 ceph-mon[33879]: pgmap v499: 129 pgs: 129 active+clean; 176 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 192 op/s 2024-09-21T06:16:58.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:16:58 smithi017 ceph-mon[31080]: pgmap v500: 129 pgs: 129 active+clean; 180 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 207 op/s 2024-09-21T06:16:58.667 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:16:58 smithi089 ceph-mon[33879]: pgmap v500: 129 pgs: 129 active+clean; 180 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 207 op/s 2024-09-21T06:16:58.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:16:58 smithi081 ceph-mon[33870]: pgmap v500: 129 pgs: 129 active+clean; 180 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 207 op/s 2024-09-21T06:17:00.468 INFO:tasks.workunit.client.0.smithi017.stdout: 39 11747 54 7334 189 2469 154 2024-09-21T06:17:00.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:00 smithi017 ceph-mon[31080]: pgmap v501: 129 pgs: 129 active+clean; 184 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-09-21T06:17:00.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:00 smithi081 ceph-mon[33870]: pgmap v501: 129 pgs: 129 active+clean; 184 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-09-21T06:17:00.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:00 smithi089 ceph-mon[33879]: pgmap v501: 129 pgs: 129 active+clean; 184 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-09-21T06:17:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:02 smithi017 ceph-mon[31080]: pgmap v502: 129 pgs: 129 active+clean; 186 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-21T06:17:02.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:02 smithi081 ceph-mon[33870]: pgmap v502: 129 pgs: 129 active+clean; 186 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-21T06:17:02.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:02 smithi089 ceph-mon[33879]: pgmap v502: 129 pgs: 129 active+clean; 186 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.8 MiB/s wr, 161 op/s 2024-09-21T06:17:04.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:04 smithi017 ceph-mon[31080]: pgmap v503: 129 pgs: 129 active+clean; 191 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 172 op/s 2024-09-21T06:17:04.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:04 smithi081 ceph-mon[33870]: pgmap v503: 129 pgs: 129 active+clean; 191 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 172 op/s 2024-09-21T06:17:04.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:04 smithi089 ceph-mon[33879]: pgmap v503: 129 pgs: 129 active+clean; 191 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 172 op/s 2024-09-21T06:17:06.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:06 smithi017 ceph-mon[31080]: pgmap v504: 129 pgs: 129 active+clean; 193 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-21T06:17:06.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:06 smithi081 ceph-mon[33870]: pgmap v504: 129 pgs: 129 active+clean; 193 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-21T06:17:06.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:06 smithi089 ceph-mon[33879]: pgmap v504: 129 pgs: 129 active+clean; 193 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-21T06:17:08.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:08 smithi017 ceph-mon[31080]: pgmap v505: 129 pgs: 129 active+clean; 197 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.9 MiB/s wr, 172 op/s 2024-09-21T06:17:08.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:08 smithi081 ceph-mon[33870]: pgmap v505: 129 pgs: 129 active+clean; 197 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.9 MiB/s wr, 172 op/s 2024-09-21T06:17:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:08 smithi089 ceph-mon[33879]: pgmap v505: 129 pgs: 129 active+clean; 197 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.9 MiB/s wr, 172 op/s 2024-09-21T06:17:10.467 INFO:tasks.workunit.client.0.smithi017.stdout: 43 11479 194 7327 111 2885 120 2024-09-21T06:17:10.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:10 smithi017 ceph-mon[31080]: pgmap v506: 129 pgs: 129 active+clean; 200 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 1.9 MiB/s wr, 167 op/s 2024-09-21T06:17:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:10 smithi081 ceph-mon[33870]: pgmap v506: 129 pgs: 129 active+clean; 200 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 1.9 MiB/s wr, 167 op/s 2024-09-21T06:17:10.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:10 smithi089 ceph-mon[33879]: pgmap v506: 129 pgs: 129 active+clean; 200 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 1.9 MiB/s wr, 167 op/s 2024-09-21T06:17:12.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:12 smithi081 ceph-mon[33870]: pgmap v507: 129 pgs: 129 active+clean; 205 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.9 MiB/s wr, 156 op/s 2024-09-21T06:17:12.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:12 smithi089 ceph-mon[33879]: pgmap v507: 129 pgs: 129 active+clean; 205 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.9 MiB/s wr, 156 op/s 2024-09-21T06:17:12.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:12 smithi017 ceph-mon[31080]: pgmap v507: 129 pgs: 129 active+clean; 205 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.9 MiB/s wr, 156 op/s 2024-09-21T06:17:14.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:14 smithi081 ceph-mon[33870]: pgmap v508: 129 pgs: 129 active+clean; 206 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-21T06:17:14.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:14 smithi089 ceph-mon[33879]: pgmap v508: 129 pgs: 129 active+clean; 206 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-21T06:17:14.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:14 smithi017 ceph-mon[31080]: pgmap v508: 129 pgs: 129 active+clean; 206 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-21T06:17:16.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:16 smithi081 ceph-mon[33870]: pgmap v509: 129 pgs: 129 active+clean; 212 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 158 op/s 2024-09-21T06:17:16.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:16 smithi089 ceph-mon[33879]: pgmap v509: 129 pgs: 129 active+clean; 212 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 158 op/s 2024-09-21T06:17:16.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:16 smithi017 ceph-mon[31080]: pgmap v509: 129 pgs: 129 active+clean; 212 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 158 op/s 2024-09-21T06:17:18.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:18 smithi081 ceph-mon[33870]: pgmap v510: 129 pgs: 129 active+clean; 215 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-21T06:17:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:18 smithi089 ceph-mon[33879]: pgmap v510: 129 pgs: 129 active+clean; 215 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-21T06:17:18.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:18 smithi017 ceph-mon[31080]: pgmap v510: 129 pgs: 129 active+clean; 215 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.9 MiB/s wr, 153 op/s 2024-09-21T06:17:20.468 INFO:tasks.workunit.client.0.smithi017.stdout: 43 11094 59 7081 180 3524 153 2024-09-21T06:17:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:20 smithi081 ceph-mon[33870]: pgmap v511: 129 pgs: 129 active+clean; 222 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 163 op/s 2024-09-21T06:17:20.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:20 smithi089 ceph-mon[33879]: pgmap v511: 129 pgs: 129 active+clean; 222 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 163 op/s 2024-09-21T06:17:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:20 smithi017 ceph-mon[31080]: pgmap v511: 129 pgs: 129 active+clean; 222 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 163 op/s 2024-09-21T06:17:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:22 smithi081 ceph-mon[33870]: pgmap v512: 129 pgs: 129 active+clean; 223 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 148 op/s 2024-09-21T06:17:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:22 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:22.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:22 smithi089 ceph-mon[33879]: pgmap v512: 129 pgs: 129 active+clean; 223 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 148 op/s 2024-09-21T06:17:22.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:22 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:22 smithi017 ceph-mon[31080]: pgmap v512: 129 pgs: 129 active+clean; 223 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 148 op/s 2024-09-21T06:17:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:22 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:23.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:23.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:23.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:17:23.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:23.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:23.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:17:23.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:23.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:23.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:17:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:24 smithi089 ceph-mon[33879]: pgmap v513: 129 pgs: 129 active+clean; 229 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 164 op/s 2024-09-21T06:17:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:24 smithi017 ceph-mon[31080]: pgmap v513: 129 pgs: 129 active+clean; 229 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 164 op/s 2024-09-21T06:17:25.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:24 smithi081 ceph-mon[33870]: pgmap v513: 129 pgs: 129 active+clean; 229 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 164 op/s 2024-09-21T06:17:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:26 smithi089 ceph-mon[33879]: pgmap v514: 129 pgs: 129 active+clean; 233 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 174 op/s 2024-09-21T06:17:27.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:26 smithi017 ceph-mon[31080]: pgmap v514: 129 pgs: 129 active+clean; 233 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 174 op/s 2024-09-21T06:17:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:26 smithi081 ceph-mon[33870]: pgmap v514: 129 pgs: 129 active+clean; 233 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 174 op/s 2024-09-21T06:17:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:28 smithi089 ceph-mon[33879]: pgmap v515: 129 pgs: 129 active+clean; 236 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-21T06:17:29.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:28 smithi017 ceph-mon[31080]: pgmap v515: 129 pgs: 129 active+clean; 236 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-21T06:17:29.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:28 smithi081 ceph-mon[33870]: pgmap v515: 129 pgs: 129 active+clean; 236 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-09-21T06:17:30.468 INFO:tasks.workunit.client.0.smithi017.stdout: 47 10945 142 7065 161 3030 144 2024-09-21T06:17:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:30 smithi089 ceph-mon[33879]: pgmap v516: 129 pgs: 129 active+clean; 239 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 162 op/s 2024-09-21T06:17:31.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:30 smithi017 ceph-mon[31080]: pgmap v516: 129 pgs: 129 active+clean; 239 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 162 op/s 2024-09-21T06:17:31.317 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:30 smithi081 ceph-mon[33870]: pgmap v516: 129 pgs: 129 active+clean; 239 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 162 op/s 2024-09-21T06:17:33.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:32 smithi089 ceph-mon[33879]: pgmap v517: 129 pgs: 129 active+clean; 244 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-09-21T06:17:33.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:32 smithi017 ceph-mon[31080]: pgmap v517: 129 pgs: 129 active+clean; 244 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-09-21T06:17:33.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:32 smithi081 ceph-mon[33870]: pgmap v517: 129 pgs: 129 active+clean; 244 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 150 op/s 2024-09-21T06:17:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:34 smithi089 ceph-mon[33879]: pgmap v518: 129 pgs: 129 active+clean; 250 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 166 op/s 2024-09-21T06:17:35.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:34 smithi017 ceph-mon[31080]: pgmap v518: 129 pgs: 129 active+clean; 250 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 166 op/s 2024-09-21T06:17:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:34 smithi081 ceph-mon[33870]: pgmap v518: 129 pgs: 129 active+clean; 250 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 166 op/s 2024-09-21T06:17:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:36 smithi089 ceph-mon[33879]: pgmap v519: 129 pgs: 129 active+clean; 253 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 146 op/s 2024-09-21T06:17:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:36 smithi017 ceph-mon[31080]: pgmap v519: 129 pgs: 129 active+clean; 253 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 146 op/s 2024-09-21T06:17:37.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:36 smithi081 ceph-mon[33870]: pgmap v519: 129 pgs: 129 active+clean; 253 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 146 op/s 2024-09-21T06:17:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:38 smithi089 ceph-mon[33879]: pgmap v520: 129 pgs: 129 active+clean; 258 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 150 op/s 2024-09-21T06:17:39.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:38 smithi017 ceph-mon[31080]: pgmap v520: 129 pgs: 129 active+clean; 258 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 150 op/s 2024-09-21T06:17:39.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:38 smithi081 ceph-mon[33870]: pgmap v520: 129 pgs: 129 active+clean; 258 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 150 op/s 2024-09-21T06:17:39.679 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T06:17:39.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:40.468 INFO:tasks.workunit.client.0.smithi017.stdout: 49 10517 190 6809 166 3728 192 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 -- 172.21.15.17:0/548089643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 msgr2=0x7ff5b0110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 --2- 172.21.15.17:0/548089643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 0x7ff5b0110310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009be0 tx=0x7ff5a802a6c0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 -- 172.21.15.17:0/548089643 shutdown_connections 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 --2- 172.21.15.17:0/548089643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 0x7ff5b0110310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 --2- 172.21.15.17:0/548089643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b0105310 0x7ff5b010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 --2- 172.21.15.17:0/548089643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b01049c0 0x7ff5b0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 -- 172.21.15.17:0/548089643 >> 172.21.15.17:0/548089643 conn(0x7ff5b0079730 msgr2=0x7ff5b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 -- 172.21.15.17:0/548089643 shutdown_connections 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.611+0000 7ff5b8554640 1 -- 172.21.15.17:0/548089643 wait complete. 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.612+0000 7ff5b8554640 1 Processor -- start 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 -- start start 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b01049c0 0x7ff5b019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b0105310 0x7ff5b019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 0x7ff5b01a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0113930 con 0x7ff5b0105310 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b01137b0 con 0x7ff5b010de20 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b8554640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0113ab0 con 0x7ff5b01049c0 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b5aef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b0105310 0x7ff5b019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b5aef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b0105310 0x7ff5b019cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57284/0 (socket says 172.21.15.17:57284) 2024-09-21T06:17:40.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b5aef640 1 -- 172.21.15.17:0/1910825804 learned_addr learned my addr 172.21.15.17:0/1910825804 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b62f0640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b01049c0 0x7ff5b019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.613+0000 7ff5b6af1640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 0x7ff5b01a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b62f0640 1 -- 172.21.15.17:0/1910825804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 msgr2=0x7ff5b01a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b62f0640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 0x7ff5b01a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b62f0640 1 -- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b0105310 msgr2=0x7ff5b019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b62f0640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b0105310 0x7ff5b019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b62f0640 1 -- 172.21.15.17:0/1910825804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b01a24d0 con 0x7ff5b01049c0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b62f0640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b01049c0 0x7ff5b019c560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006c8e0 tx=0x7ff5ac00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac004440 con 0x7ff5b01049c0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5ac00cd50 con 0x7ff5b01049c0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac019480 con 0x7ff5b01049c0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.614+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b01a27c0 con 0x7ff5b01049c0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.615+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b01a8f20 con 0x7ff5b01049c0 2024-09-21T06:17:40.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.616+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b006c1e0 con 0x7ff5b01049c0 2024-09-21T06:17:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.618+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff5ac003680 con 0x7ff5b01049c0 2024-09-21T06:17:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.619+0000 7ff5a77fe640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff59c0b6660 0x7ff59c0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.619+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff5ac0e7e70 con 0x7ff5b01049c0 2024-09-21T06:17:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.619+0000 7ff5b5aef640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff59c0b6660 0x7ff59c0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.620+0000 7ff5b5aef640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff59c0b6660 0x7ff59c0b8b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff5b010fc20 tx=0x7ff5a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:40.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.622+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5ac009510 con 0x7ff5b01049c0 2024-09-21T06:17:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.983+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5b01a9150 con 0x7ff5b01049c0 2024-09-21T06:17:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.984+0000 7ff5a77fe640 1 -- 172.21.15.17:0/1910825804 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7ff5ac0ae390 con 0x7ff5b01049c0 2024-09-21T06:17:40.987 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:17:40.989 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.986+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff59c0b6660 msgr2=0x7ff59c0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.986+0000 7ff5b8554640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff59c0b6660 0x7ff59c0b8b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff5b010fc20 tx=0x7ff5a0005f90 comp rx=0 tx=0).stop 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b01049c0 msgr2=0x7ff5b019c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b01049c0 0x7ff5b019c560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006c8e0 tx=0x7ff5ac00ee50 comp rx=0 tx=0).stop 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 shutdown_connections 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff59c0b6660 0x7ff59c0b8b70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b0105310 0x7ff5b019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5b010de20 0x7ff5b01a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 --2- 172.21.15.17:0/1910825804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b01049c0 0x7ff5b019c560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 >> 172.21.15.17:0/1910825804 conn(0x7ff5b0079730 msgr2=0x7ff5b0100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 shutdown_connections 2024-09-21T06:17:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:40.987+0000 7ff5b8554640 1 -- 172.21.15.17:0/1910825804 wait complete. 2024-09-21T06:17:41.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:40 smithi089 ceph-mon[33879]: pgmap v521: 129 pgs: 129 active+clean; 265 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 153 op/s 2024-09-21T06:17:41.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:40 smithi017 ceph-mon[31080]: pgmap v521: 129 pgs: 129 active+clean; 265 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 153 op/s 2024-09-21T06:17:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:40 smithi081 ceph-mon[33870]: pgmap v521: 129 pgs: 129 active+clean; 265 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 153 op/s 2024-09-21T06:17:41.974 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T06:17:41.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T06:17:42.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:41 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1910825804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:42.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:41 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1910825804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:42.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:41 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1910825804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 -- 172.21.15.17:0/2426465061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf810a590 msgr2=0x7ffaf810a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 --2- 172.21.15.17:0/2426465061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf810a590 0x7ffaf810a9a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009900 tx=0x7ffaec02a480 comp rx=0 tx=0).stop 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 -- 172.21.15.17:0/2426465061 shutdown_connections 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 --2- 172.21.15.17:0/2426465061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaf8116620 0x7ffaf8118b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 --2- 172.21.15.17:0/2426465061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 0x7ffaf8115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 --2- 172.21.15.17:0/2426465061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf810a590 0x7ffaf810a9a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 -- 172.21.15.17:0/2426465061 >> 172.21.15.17:0/2426465061 conn(0x7ffaf8070e80 msgr2=0x7ffaf8071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 -- 172.21.15.17:0/2426465061 shutdown_connections 2024-09-21T06:17:42.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.902+0000 7ffaff58a640 1 -- 172.21.15.17:0/2426465061 wait complete. 2024-09-21T06:17:42.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.903+0000 7ffaff58a640 1 Processor -- start 2024-09-21T06:17:42.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.903+0000 7ffaff58a640 1 -- start start 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffaff58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaf810a590 0x7ffaf81a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffaff58a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 0x7ffaf81a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffaff58a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf8116620 0x7ffaf81a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffaff58a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf811c0f0 con 0x7ffaf8116620 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffaff58a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf811bf70 con 0x7ffaf810aee0 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffaff58a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf811c270 con 0x7ffaf810a590 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffafd326640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaf810a590 0x7ffaf81a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffafdb27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf8116620 0x7ffaf81a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffafdb27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf8116620 0x7ffaf81a8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57304/0 (socket says 172.21.15.17:57304) 2024-09-21T06:17:42.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffafdb27640 1 -- 172.21.15.17:0/4177027471 learned_addr learned my addr 172.21.15.17:0/4177027471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:42.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.904+0000 7ffafcb25640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 0x7ffaf81a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffafcb25640 1 -- 172.21.15.17:0/4177027471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaf810a590 msgr2=0x7ffaf81a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffafcb25640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaf810a590 0x7ffaf81a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffafcb25640 1 -- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf8116620 msgr2=0x7ffaf81a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffafcb25640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf8116620 0x7ffaf81a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffafcb25640 1 -- 172.21.15.17:0/4177027471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf81a8b30 con 0x7ffaf810aee0 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffafcb25640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 0x7ffaf81a3160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005fd0 tx=0x7ffae800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffaf67fc640 1 -- 172.21.15.17:0/4177027471 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8009c30 con 0x7ffaf810aee0 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf81a8e20 con 0x7ffaf810aee0 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffaf67fc640 1 -- 172.21.15.17:0/4177027471 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffae80044c0 con 0x7ffaf810aee0 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.905+0000 7ffaf67fc640 1 -- 172.21.15.17:0/4177027471 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8009c30 con 0x7ffaf810aee0 2024-09-21T06:17:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.906+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf810bd60 con 0x7ffaf810aee0 2024-09-21T06:17:42.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.908+0000 7ffaf67fc640 1 -- 172.21.15.17:0/4177027471 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ffae8003b80 con 0x7ffaf810aee0 2024-09-21T06:17:42.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.909+0000 7ffaf67fc640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffae00b6710 0x7ffae00b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.909+0000 7ffaf67fc640 1 -- 172.21.15.17:0/4177027471 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ffae80e6980 con 0x7ffaf810aee0 2024-09-21T06:17:42.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.909+0000 7ffafd326640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffae00b6710 0x7ffae00b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.910+0000 7ffafd326640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffae00b6710 0x7ffae00b8c20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006010 tx=0x7ffaec0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:42.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.911+0000 7ffb05afe740 1 Processor -- start 2024-09-21T06:17:42.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.911+0000 7ffb05afe740 1 -- start start 2024-09-21T06:17:42.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.911+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187021600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 0x563187021b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafcb25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 0x563187021b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffb05afe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563186f97b90 con 0x563186c51980 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafd326640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187021600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafcb25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 0x563187021b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57316/0 (socket says 172.21.15.17:57316) 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafcb25640 1 -- 172.21.15.17:0/1770956739 learned_addr learned my addr 172.21.15.17:0/1770956739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563186f86fc0 con 0x563186c7a840 2024-09-21T06:17:42.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x563186f8add0 con 0x563186c59b60 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafdb27640 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafd326640 1 -- 172.21.15.17:0/1770956739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 msgr2=0x563187022080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafd326640 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafd326640 1 -- 172.21.15.17:0/1770956739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 msgr2=0x563187021b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafd326640 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 0x563187021b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafd326640 1 -- 172.21.15.17:0/1770956739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563186f0e060 con 0x563186c7a840 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafdb27640 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.912+0000 7ffafcb25640 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 0x563187021b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:17:42.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.913+0000 7ffafd326640 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187021600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffaec005940 tx=0x7ffaec040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0e29881b5aa274 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.913+0000 7ffadf7fe640 1 -- 172.21.15.17:0/1770956739 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035040 con 0x563186c7a840 2024-09-21T06:17:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.913+0000 7ffadf7fe640 1 -- 172.21.15.17:0/1770956739 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaec04ccb0 con 0x563186c7a840 2024-09-21T06:17:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.913+0000 7ffadf7fe640 1 -- 172.21.15.17:0/1770956739 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035040 con 0x563186c7a840 2024-09-21T06:17:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.914+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 msgr2=0x563187021600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.914+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187021600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffaec005940 tx=0x7ffaec040000 comp rx=0 tx=0).stop 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 shutdown_connections 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c51980 0x563187021b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1770956739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187021600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 >> 172.21.15.17:0/1770956739 conn(0x563186c6e990 msgr2=0x56318701f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 shutdown_connections 2024-09-21T06:17:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.915+0000 7ffb05afe740 1 -- 172.21.15.17:0/1770956739 wait complete. 2024-09-21T06:17:42.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.916+0000 7ffb05afe740 1 -- start start 2024-09-21T06:17:42.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.916+0000 7ffb05afe740 1 Processor -- start 2024-09-21T06:17:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c51980 0x56318702d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c59b60 0x56318702d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187039070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563186de87a0 con 0x563186c59b60 2024-09-21T06:17:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563186f2c0a0 con 0x563186c7a840 2024-09-21T06:17:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56318702fd80 con 0x563186c51980 2024-09-21T06:17:42.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffb05afe740 10 client.0 _ll_register_callbacks cb 0x563186f093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187039070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:53896/0 (socket says 172.21.15.17:53896) 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 -- 172.21.15.17:0/67603936 learned_addr learned my addr 172.21.15.17:0/67603936 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafcb25640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c59b60 0x56318702d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafd326640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c51980 0x56318702d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 -- 172.21.15.17:0/67603936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c51980 msgr2=0x56318702d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c51980 0x56318702d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 -- 172.21.15.17:0/67603936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c59b60 msgr2=0x56318702d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c59b60 0x56318702d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.917+0000 7ffafdb27640 1 -- 172.21.15.17:0/67603936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563186f1a880 con 0x563186c7a840 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffafdb27640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187039070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00109a0 tx=0x7ffaf0010da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6687550ae5896 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffadcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:17:42.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffadcff9640 1 -- 172.21.15.17:0/67603936 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000ed40 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffadcff9640 1 -- 172.21.15.17:0/67603936 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ffaf001c480 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec04ccb0 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffadcff9640 1 -- 172.21.15.17:0/67603936 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffaf0003970 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffb05afe740 10 client.25490 fetch_fsmap learned FSMap version 31 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.918+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563186cf4b90 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffadcff9640 1 -- 172.21.15.17:0/67603936 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaec04ccb0 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffadcff9640 1 -- 172.21.15.17:0/67603936 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7ffaf0004020 con 0x563186c7a840 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffb05afe740 10 client.25490 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffb05afe740 10 client.25490 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffb05afe740 20 client.25490 populate_metadata read hostname 'smithi017' 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffb05afe740 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c391c0 0x56318703f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffb05afe740 4 client.25490 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:17:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563186f99ae0 con 0x563186c391c0 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.919+0000 7ffafd326640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c391c0 0x56318703f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.920+0000 7ffadcff9640 10 client.25490 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.920+0000 7ffafd326640 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c391c0 0x56318703f190 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80962aea03607515 server_cookie=51d068cacbdf8633 in_seq=0 out_seq=0 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffadcff9640 1 -- 172.21.15.17:0/67603936 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563186f99ae0 con 0x563186c391c0 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffadcff9640 10 client.25490 handle_command_reply: tid=0 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 client.25490 shutdown 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 msgr2=0x563187039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187039070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00109a0 tx=0x7ffaf0010da0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 shutdown_connections 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c391c0 0x56318703f190 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c59b60 0x56318702d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c7a840 0x563187039070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 --2- 172.21.15.17:0/67603936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c51980 0x56318702d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 >> 172.21.15.17:0/67603936 conn(0x563186c6e990 msgr2=0x5631870247e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffadcff9640 0 client.25490 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 shutdown_connections 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.921+0000 7ffb05afe740 1 -- 172.21.15.17:0/67603936 wait complete. 2024-09-21T06:17:42.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.922+0000 7ffb05afe740 20 client.25490 trim_cache size 0 max 16384 2024-09-21T06:17:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.949+0000 7ffb05afe740 1 Processor -- start 2024-09-21T06:17:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.949+0000 7ffb05afe740 1 -- start start 2024-09-21T06:17:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.949+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870250c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.949+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.949+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x56318702a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffb05afe740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf81b9a30 con 0x563186c7a840 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffb05afe740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf81b72a0 con 0x563186c51980 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffb05afe740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf81b50f0 con 0x563186c59b60 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870250c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:53900/0 (socket says 172.21.15.17:53900) 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 -- 172.21.15.17:0/2811701370 learned_addr learned my addr 172.21.15.17:0/2811701370 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafdb27640 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x56318702a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafcb25640 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 -- 172.21.15.17:0/2811701370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 msgr2=0x563187022d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 -- 172.21.15.17:0/2811701370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 msgr2=0x56318702a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x56318702a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 -- 172.21.15.17:0/2811701370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318701f720 con 0x563186c51980 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.950+0000 7ffafd326640 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870250c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02a9a0 tx=0x7ffaec000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ad000f210b60d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.951+0000 7ffadeffd640 1 -- 172.21.15.17:0/2811701370 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035040 con 0x563186c51980 2024-09-21T06:17:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.951+0000 7ffadeffd640 1 -- 172.21.15.17:0/2811701370 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaec003970 con 0x563186c51980 2024-09-21T06:17:42.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.951+0000 7ffadeffd640 1 -- 172.21.15.17:0/2811701370 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec03d700 con 0x563186c51980 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 -- 172.21.15.17:0/2811701370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 msgr2=0x5631870250c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870250c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02a9a0 tx=0x7ffaec000bc0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 -- 172.21.15.17:0/2811701370 shutdown_connections 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x56318702a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x563187022d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 --2- 172.21.15.17:0/2811701370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870250c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 -- 172.21.15.17:0/2811701370 >> 172.21.15.17:0/2811701370 conn(0x563186c6e990 msgr2=0x563187022630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 -- 172.21.15.17:0/2811701370 shutdown_connections 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.952+0000 7ffb05afe740 1 -- 172.21.15.17:0/2811701370 wait complete. 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.953+0000 7ffb05afe740 1 -- start start 2024-09-21T06:17:42.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.953+0000 7ffb05afe740 1 Processor -- start 2024-09-21T06:17:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x5631870325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafd326640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafd326640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:53916/0 (socket says 172.21.15.17:53916) 2024-09-21T06:17:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffb05afe740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x563187032b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafcb25640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x5631870325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafcb25640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x5631870325f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:60558/0 (socket says 172.21.15.17:60558) 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafdb27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x563187032b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafdb27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x563187032b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57336/0 (socket says 172.21.15.17:57336) 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.954+0000 7ffafd326640 1 -- 172.21.15.17:0/1085297814 learned_addr learned my addr 172.21.15.17:0/1085297814 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf81b5760 con 0x563186c7a840 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf81b6bd0 con 0x563186c51980 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf81b5e30 con 0x563186c59b60 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffb05afe740 10 client.0 _ll_register_callbacks cb 0x7ffaf0007880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafd326640 1 -- 172.21.15.17:0/1085297814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 msgr2=0x5631870325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafd326640 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x5631870325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafd326640 1 -- 172.21.15.17:0/1085297814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 msgr2=0x563187032b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafd326640 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x563187032b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafd326640 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631870a9c60 con 0x563186c51980 2024-09-21T06:17:42.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafcb25640 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x5631870325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:17:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffafd326640 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870320b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02a4c0 tx=0x7ffaec03c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9ab30d8457eba51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.955+0000 7ffadcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:17:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffadcff9640 1 -- 172.21.15.17:0/1085297814 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035040 con 0x563186c51980 2024-09-21T06:17:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffadcff9640 1 -- 172.21.15.17:0/1085297814 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ffaec003b20 con 0x563186c51980 2024-09-21T06:17:42.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec003970 con 0x563186c51980 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffadcff9640 1 -- 172.21.15.17:0/1085297814 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffaec003d20 con 0x563186c51980 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffb05afe740 10 client.25496 fetch_fsmap learned FSMap version 31 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5631870aae60 con 0x563186c51980 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffadcff9640 1 -- 172.21.15.17:0/1085297814 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffaec003970 con 0x563186c51980 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.956+0000 7ffadcff9640 1 -- 172.21.15.17:0/1085297814 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7ffaec077030 con 0x563186c51980 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffb05afe740 10 client.25496 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffb05afe740 10 client.25496 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffb05afe740 20 client.25496 populate_metadata read hostname 'smithi017' 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c0e570 0x5631870ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:42.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffb05afe740 4 client.25496 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T06:17:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x563186f95590 con 0x563186c0e570 2024-09-21T06:17:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffafcb25640 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c0e570 0x5631870ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffadcff9640 10 client.25496 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:42.957+0000 7ffafcb25640 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c0e570 0x5631870ad1b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a5bc2bd132d5e52 server_cookie=e86f46c8a166d003 in_seq=0 out_seq=0 2024-09-21T06:17:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:42 smithi089 ceph-mon[33879]: pgmap v522: 129 pgs: 129 active+clean; 271 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 166 op/s 2024-09-21T06:17:43.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:42 smithi017 ceph-mon[31080]: pgmap v522: 129 pgs: 129 active+clean; 271 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 166 op/s 2024-09-21T06:17:43.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:42 smithi081 ceph-mon[33870]: pgmap v522: 129 pgs: 129 active+clean; 271 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 166 op/s 2024-09-21T06:17:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:44 smithi089 ceph-mon[33879]: pgmap v523: 129 pgs: 129 active+clean; 272 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 145 op/s 2024-09-21T06:17:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:44 smithi017 ceph-mon[31080]: pgmap v523: 129 pgs: 129 active+clean; 272 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 145 op/s 2024-09-21T06:17:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:44 smithi081 ceph-mon[33870]: pgmap v523: 129 pgs: 129 active+clean; 272 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 145 op/s 2024-09-21T06:17:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffadcff9640 1 -- 172.21.15.17:0/1085297814 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563186f95590 con 0x563186c0e570 2024-09-21T06:17:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffadcff9640 10 client.25496 handle_command_reply: tid=0 2024-09-21T06:17:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 client.25496 shutdown 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 msgr2=0x5631870320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870320b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaec02a4c0 tx=0x7ffaec03c650 comp rx=0 tx=0).stop 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 shutdown_connections 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x563186c0e570 0x5631870ad1b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563186c7a840 0x563187032b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffadcff9640 0 client.25496 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563186c59b60 0x5631870325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 --2- 172.21.15.17:0/1085297814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563186c51980 0x5631870320b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 >> 172.21.15.17:0/1085297814 conn(0x563186c6e990 msgr2=0x563187022ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 shutdown_connections 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.507+0000 7ffb05afe740 1 -- 172.21.15.17:0/1085297814 wait complete. 2024-09-21T06:17:45.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.508+0000 7ffb05afe740 20 client.25496 trim_cache size 0 max 16384 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 18, 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "186d763b": { 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 18, 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:17:45.512 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 130.0, 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:45.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:45.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:45.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:45.514 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:17:45.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.508+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffae00b6710 msgr2=0x7ffae00b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:45.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.508+0000 7ffaff58a640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffae00b6710 0x7ffae00b8c20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006010 tx=0x7ffaec0058d0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.508+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 msgr2=0x7ffaf81a3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.508+0000 7ffaff58a640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 0x7ffaf81a3160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005fd0 tx=0x7ffae800dde0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 shutdown_connections 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffae00b6710 0x7ffae00b8c20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaf8116620 0x7ffaf81a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf810aee0 0x7ffaf81a3160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 --2- 172.21.15.17:0/4177027471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaf810a590 0x7ffaf81a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 >> 172.21.15.17:0/4177027471 conn(0x7ffaf8070e80 msgr2=0x7ffaf8072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 shutdown_connections 2024-09-21T06:17:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:45.509+0000 7ffaff58a640 1 -- 172.21.15.17:0/4177027471 wait complete. 2024-09-21T06:17:46.750 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '186d763b', quiesce took 7.1 seconds. Will release after: 2.9000000000000004 2024-09-21T06:17:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:46 smithi089 ceph-mon[33879]: pgmap v524: 129 pgs: 129 active+clean; 274 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 132 op/s 2024-09-21T06:17:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:46 smithi017 ceph-mon[31080]: pgmap v524: 129 pgs: 129 active+clean; 274 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 132 op/s 2024-09-21T06:17:47.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:46 smithi081 ceph-mon[33870]: pgmap v524: 129 pgs: 129 active+clean; 274 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 132 op/s 2024-09-21T06:17:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:48 smithi089 ceph-mon[33879]: pgmap v525: 129 pgs: 129 active+clean; 277 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 167 op/s 2024-09-21T06:17:49.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:48 smithi017 ceph-mon[31080]: pgmap v525: 129 pgs: 129 active+clean; 277 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 167 op/s 2024-09-21T06:17:49.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:48 smithi081 ceph-mon[33870]: pgmap v525: 129 pgs: 129 active+clean; 277 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 167 op/s 2024-09-21T06:17:49.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:50.007 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:50.468 INFO:tasks.workunit.client.0.smithi017.stdout: 50 7727 21 4903 47 2710 36 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 -- 172.21.15.17:0/2304152371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 msgr2=0x7fb8c4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2304152371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c4102e80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009900 tx=0x7fb8b402a410 comp rx=0 tx=0).stop 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 -- 172.21.15.17:0/2304152371 shutdown_connections 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2304152371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2304152371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c41083b0 0x7fb8c41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2304152371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c4102e80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 -- 172.21.15.17:0/2304152371 >> 172.21.15.17:0/2304152371 conn(0x7fb8c4079730 msgr2=0x7fb8c4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:50.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 -- 172.21.15.17:0/2304152371 shutdown_connections 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.582+0000 7fb8c9530640 1 -- 172.21.15.17:0/2304152371 wait complete. 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 Processor -- start 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 -- start start 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c41083b0 0x7fb8c419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4112820 con 0x7fb8c4102a70 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41126a0 con 0x7fb8c41083b0 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c9530640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41129a0 con 0x7fb8c4108d00 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c419fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:42870/0 (socket says 172.21.15.17:42870) 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c37fe640 1 -- 172.21.15.17:0/2881547042 learned_addr learned my addr 172.21.15.17:0/2881547042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8ba7fc640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c41083b0 0x7fb8c419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:50.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.583+0000 7fb8c2ffd640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60444/0 (socket says 172.21.15.17:60444) 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c37fe640 1 -- 172.21.15.17:0/2881547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c41083b0 msgr2=0x7fb8c419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c37fe640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c41083b0 0x7fb8c419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c37fe640 1 -- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 msgr2=0x7fb8c419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c37fe640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c37fe640 1 -- 172.21.15.17:0/2881547042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c41a02b0 con 0x7fb8c4108d00 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c2ffd640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c37fe640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c419fb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00eb10 tx=0x7fb8bc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc004b20 con 0x7fb8c4108d00 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.584+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c41a05a0 con 0x7fb8c4108d00 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.585+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8bc004cc0 con 0x7fb8c4108d00 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.585+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc010690 con 0x7fb8c4108d00 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.585+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c4104140 con 0x7fb8c4108d00 2024-09-21T06:17:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.586+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c4103cf0 con 0x7fb8c4108d00 2024-09-21T06:17:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.588+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb8bc005020 con 0x7fb8c4108d00 2024-09-21T06:17:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.589+0000 7fb8c0ff9640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8b00b6510 0x7fb8b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.589+0000 7fb8c2ffd640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8b00b6510 0x7fb8b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.589+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fb8bc0e7f70 con 0x7fb8c4108d00 2024-09-21T06:17:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.590+0000 7fb8c2ffd640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8b00b6510 0x7fb8b00b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40057c0 tx=0x7fb8b40058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.591+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8bc0ae470 con 0x7fb8c4108d00 2024-09-21T06:17:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.969+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8c4102e80 con 0x7fb8c4108d00 2024-09-21T06:17:50.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.970+0000 7fb8c0ff9640 1 -- 172.21.15.17:0/2881547042 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7fb8c4102e80 con 0x7fb8c4108d00 2024-09-21T06:17:50.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:17:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:17:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:17:50.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8b00b6510 msgr2=0x7fb8b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8b00b6510 0x7fb8b00b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40057c0 tx=0x7fb8b40058d0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 msgr2=0x7fb8c419fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c419fb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00eb10 tx=0x7fb8bc00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 shutdown_connections 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb8b00b6510 0x7fb8b00b8a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8c4108d00 0x7fb8c419fb80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c41083b0 0x7fb8c419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 --2- 172.21.15.17:0/2881547042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8c4102a70 0x7fb8c419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 >> 172.21.15.17:0/2881547042 conn(0x7fb8c4079730 msgr2=0x7fb8c4101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 shutdown_connections 2024-09-21T06:17:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:50.973+0000 7fb8c9530640 1 -- 172.21.15.17:0/2881547042 wait complete. 2024-09-21T06:17:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:50 smithi089 ceph-mon[33879]: pgmap v526: 129 pgs: 129 active+clean; 280 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 230 op/s 2024-09-21T06:17:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:50 smithi017 ceph-mon[31080]: pgmap v526: 129 pgs: 129 active+clean; 280 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 230 op/s 2024-09-21T06:17:51.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:50 smithi081 ceph-mon[33870]: pgmap v526: 129 pgs: 129 active+clean; 280 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 230 op/s 2024-09-21T06:17:52.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:51 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2881547042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:52.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:51 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2881547042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:52.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:51 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2881547042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:53.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:52 smithi017 ceph-mon[31080]: pgmap v527: 129 pgs: 129 active+clean; 280 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-09-21T06:17:53.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:52 smithi081 ceph-mon[33870]: pgmap v527: 129 pgs: 129 active+clean; 280 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-09-21T06:17:53.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:52 smithi089 ceph-mon[33879]: pgmap v527: 129 pgs: 129 active+clean; 280 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 1.4 MiB/s wr, 208 op/s 2024-09-21T06:17:53.797 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id 186d763b --release --await' 2024-09-21T06:17:53.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id 186d763b --release --await 2024-09-21T06:17:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:55.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:54 smithi017 ceph-mon[31080]: pgmap v528: 129 pgs: 129 active+clean; 282 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 1.0 MiB/s wr, 175 op/s 2024-09-21T06:17:55.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:54 smithi081 ceph-mon[33870]: pgmap v528: 129 pgs: 129 active+clean; 282 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 1.0 MiB/s wr, 175 op/s 2024-09-21T06:17:55.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:54 smithi089 ceph-mon[33879]: pgmap v528: 129 pgs: 129 active+clean; 282 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 1.0 MiB/s wr, 175 op/s 2024-09-21T06:17:57.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:56 smithi017 ceph-mon[31080]: pgmap v529: 129 pgs: 129 active+clean; 284 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2024-09-21T06:17:57.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:56 smithi081 ceph-mon[33870]: pgmap v529: 129 pgs: 129 active+clean; 284 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2024-09-21T06:17:57.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:56 smithi089 ceph-mon[33879]: pgmap v529: 129 pgs: 129 active+clean; 284 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 170 op/s 2024-09-21T06:17:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 -- 172.21.15.17:0/1734944156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 msgr2=0x7fb058112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 --2- 172.21.15.17:0/1734944156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb058112620 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb050009ca0 tx=0x7fb05002a950 comp rx=0 tx=0).stop 2024-09-21T06:17:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 -- 172.21.15.17:0/1734944156 shutdown_connections 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 --2- 172.21.15.17:0/1734944156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb058112620 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 --2- 172.21.15.17:0/1734944156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb058102fa0 0x7fb05810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 --2- 172.21.15.17:0/1734944156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb058102650 0x7fb058102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 -- 172.21.15.17:0/1734944156 >> 172.21.15.17:0/1734944156 conn(0x7fb058079730 msgr2=0x7fb058079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 -- 172.21.15.17:0/1734944156 shutdown_connections 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.521+0000 7fb05df3f640 1 -- 172.21.15.17:0/1734944156 wait complete. 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.522+0000 7fb05df3f640 1 Processor -- start 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.522+0000 7fb05df3f640 1 -- start start 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb05df3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb058102650 0x7fb05819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb05df3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb058102fa0 0x7fb05819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb05df3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb0581a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb05df3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb058115b20 con 0x7fb058110200 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb05df3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581159a0 con 0x7fb058102650 2024-09-21T06:17:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb05df3f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb058115ca0 con 0x7fb058102fa0 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb0581a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb0581a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60460/0 (socket says 172.21.15.17:60460) 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 -- 172.21.15.17:0/3689278174 learned_addr learned my addr 172.21.15.17:0/3689278174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb04effd640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb058102fa0 0x7fb05819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb0577fe640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb058102650 0x7fb05819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 -- 172.21.15.17:0/3689278174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb058102fa0 msgr2=0x7fb05819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb058102fa0 0x7fb05819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 -- 172.21.15.17:0/3689278174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb058102650 msgr2=0x7fb05819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb058102650 0x7fb05819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 -- 172.21.15.17:0/3689278174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0581a2400 con 0x7fb058110200 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.523+0000 7fb057fff640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb0581a1d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb05002ae70 tx=0x7fb050003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.524+0000 7fb0557fa640 1 -- 172.21.15.17:0/3689278174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050034040 con 0x7fb058110200 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.524+0000 7fb0557fa640 1 -- 172.21.15.17:0/3689278174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb05002fcf0 con 0x7fb058110200 2024-09-21T06:17:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.524+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0581a2690 con 0x7fb058110200 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.524+0000 7fb0557fa640 1 -- 172.21.15.17:0/3689278174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050004540 con 0x7fb058110200 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.524+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581a2bc0 con 0x7fb058110200 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.527+0000 7fb0557fa640 1 -- 172.21.15.17:0/3689278174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb050037020 con 0x7fb058110200 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.527+0000 7fb0557fa640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0440b65c0 0x7fb0440b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0577fe640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0440b65c0 0x7fb0440b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0557fa640 1 -- 172.21.15.17:0/3689278174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fb0501086b0 con 0x7fb058110200 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 Processor -- start 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 -- start start 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0577fe640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0440b65c0 0x7fb0440b8ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb04800abe0 tx=0x7fb04800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa41510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 0x55b7baa41a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa41f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7ba92cdc0 con 0x55b7ba672660 2024-09-21T06:17:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7ba9b91f0 con 0x55b7ba67a840 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.528+0000 7fb0644b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b7ba9a8620 con 0x55b7ba69b520 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 0x55b7baa41a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 0x55b7baa41a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60462/0 (socket says 172.21.15.17:60462) 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 -- 172.21.15.17:0/218278289 learned_addr learned my addr 172.21.15.17:0/218278289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb0577fe640 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa41510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb057fff640 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa41f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 -- 172.21.15.17:0/218278289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 msgr2=0x55b7baa41510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa41510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 -- 172.21.15.17:0/218278289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 msgr2=0x55b7baa41f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa41f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 -- 172.21.15.17:0/218278289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ba970fd0 con 0x55b7ba672660 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04effd640 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 0x55b7baa41a50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb04000abf0 tx=0x7fb04000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37000ae8ebd395f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04dffb640 1 -- 172.21.15.17:0/218278289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04001d070 con 0x55b7ba672660 2024-09-21T06:17:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04dffb640 1 -- 172.21.15.17:0/218278289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb040018ad0 con 0x55b7ba672660 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.529+0000 7fb04dffb640 1 -- 172.21.15.17:0/218278289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0400109c0 con 0x55b7ba672660 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 -- 172.21.15.17:0/218278289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 msgr2=0x55b7baa41a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 0x55b7baa41a50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb04000abf0 tx=0x7fb04000f790 comp rx=0 tx=0).stop 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 -- 172.21.15.17:0/218278289 shutdown_connections 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba672660 0x55b7baa41a50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa41f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 --2- 172.21.15.17:0/218278289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa41510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.530+0000 7fb0644b3740 1 -- 172.21.15.17:0/218278289 >> 172.21.15.17:0/218278289 conn(0x55b7ba68f910 msgr2=0x55b7baa3f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.531+0000 7fb0644b3740 1 -- 172.21.15.17:0/218278289 shutdown_connections 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.531+0000 7fb0644b3740 1 -- 172.21.15.17:0/218278289 wait complete. 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.531+0000 7fb0644b3740 1 -- start start 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.531+0000 7fb0644b3740 1 Processor -- start 2024-09-21T06:17:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa4d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa58e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7ba943300 con 0x55b7ba69b520 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b7ba9ac430 con 0x55b7ba67a840 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b7ba809bb0 con 0x55b7ba672660 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0644b3740 10 client.0 _ll_register_callbacks cb 0x55b7ba95d120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa58e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa58e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60476/0 (socket says 172.21.15.17:60476) 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 -- 172.21.15.17:0/284370346 learned_addr learned my addr 172.21.15.17:0/284370346 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb04effd640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa4d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb0577fe640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 -- 172.21.15.17:0/284370346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 msgr2=0x55b7baa4cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa4cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 -- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 msgr2=0x55b7baa4d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa4d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 -- 172.21.15.17:0/284370346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ba932780 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb04effd640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa4d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb057fff640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa58e90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb05002f800 tx=0x7fb0500cdce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38e17957d280d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.532+0000 7fb036ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb036ffd640 1 -- 172.21.15.17:0/284370346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05002c040 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb036ffd640 1 -- 172.21.15.17:0/284370346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fb050030740 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb040018ad0 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb036ffd640 1 -- 172.21.15.17:0/284370346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0500d7ed0 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 10 client.15729 fetch_fsmap learned FSMap version 31 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b7ba706b00 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb036ffd640 1 -- 172.21.15.17:0/284370346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb040018ad0 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb036ffd640 1 -- 172.21.15.17:0/284370346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fb0500d7a40 con 0x55b7ba69b520 2024-09-21T06:17:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 10 client.15729 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 10 client.15729 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 20 client.15729 populate_metadata read hostname 'smithi017' 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba659ea0 0x55b7baa5ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 4 client.15729 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.533+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7ba9bb140 con 0x55b7ba659ea0 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.534+0000 7fb0577fe640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba659ea0 0x55b7baa5ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.534+0000 7fb0577fe640 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba659ea0 0x55b7baa5ef00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a304f4ea28c53e0c server_cookie=ca8db68a1162c226 in_seq=0 out_seq=0 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.534+0000 7fb036ffd640 10 client.15729 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb036ffd640 1 -- 172.21.15.17:0/284370346 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7ba9bb140 con 0x55b7ba659ea0 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb036ffd640 10 client.15729 handle_command_reply: tid=0 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 client.15729 shutdown 2024-09-21T06:17:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 msgr2=0x55b7baa58e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa58e90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb05002f800 tx=0x7fb0500cdce0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 shutdown_connections 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba659ea0 0x55b7baa5ef00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa58e90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa4d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 --2- 172.21.15.17:0/284370346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa4cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb036ffd640 0 client.15729 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.535+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 >> 172.21.15.17:0/284370346 conn(0x55b7ba68f910 msgr2=0x55b7baa446a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.536+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 shutdown_connections 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.536+0000 7fb0644b3740 1 -- 172.21.15.17:0/284370346 wait complete. 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.536+0000 7fb0644b3740 20 client.15729 trim_cache size 0 max 16384 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 Processor -- start 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 -- start start 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa58d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa42c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581b54f0 con 0x55b7ba69b520 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581b2d60 con 0x55b7ba67a840 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb0644b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581b0bb0 con 0x55b7ba672660 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb057fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb057fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60486/0 (socket says 172.21.15.17:60486) 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.553+0000 7fb057fff640 1 -- 172.21.15.17:0/2863816695 learned_addr learned my addr 172.21.15.17:0/2863816695 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb0577fe640 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa58d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb04effd640 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb057fff640 1 -- 172.21.15.17:0/2863816695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 msgr2=0x55b7baa58d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb057fff640 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa58d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb057fff640 1 -- 172.21.15.17:0/2863816695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 msgr2=0x55b7baa42c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb057fff640 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa42c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb057fff640 1 -- 172.21.15.17:0/2863816695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ba77d960 con 0x55b7ba69b520 2024-09-21T06:17:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb057fff640 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa465a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb0501089d0 tx=0x7fb05002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fc4b8aff96b2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb04d7fa640 1 -- 172.21.15.17:0/2863816695 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500cab00 con 0x55b7ba69b520 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb04d7fa640 1 -- 172.21.15.17:0/2863816695 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0500ed070 con 0x55b7ba69b520 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.554+0000 7fb04d7fa640 1 -- 172.21.15.17:0/2863816695 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0500ca720 con 0x55b7ba69b520 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 -- 172.21.15.17:0/2863816695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 msgr2=0x55b7baa465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa465a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb0501089d0 tx=0x7fb05002a950 comp rx=0 tx=0).stop 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 -- 172.21.15.17:0/2863816695 shutdown_connections 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba69b520 0x55b7baa465a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba67a840 0x55b7baa42c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 --2- 172.21.15.17:0/2863816695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba672660 0x55b7baa58d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 -- 172.21.15.17:0/2863816695 >> 172.21.15.17:0/2863816695 conn(0x55b7ba68f910 msgr2=0x55b7baa424f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 -- 172.21.15.17:0/2863816695 shutdown_connections 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 -- 172.21.15.17:0/2863816695 wait complete. 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 -- start start 2024-09-21T06:17:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.555+0000 7fb0644b3740 1 Processor -- start 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba672660 0x55b7baa54e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 0x55b7baa55340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa4fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581b1220 con 0x55b7ba67a840 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581b2690 con 0x55b7ba672660 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581b18f0 con 0x55b7ba69b520 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0644b3740 10 client.0 _ll_register_callbacks cb 0x7fb0500ce370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 0x55b7baa55340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 0x55b7baa55340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60490/0 (socket says 172.21.15.17:60490) 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 -- 172.21.15.17:0/3243922047 learned_addr learned my addr 172.21.15.17:0/3243922047 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb057fff640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa4fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb0577fe640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba672660 0x55b7baa54e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 -- 172.21.15.17:0/3243922047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 msgr2=0x55b7baa4fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa4fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 -- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba672660 msgr2=0x55b7baa54e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba672660 0x55b7baa54e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.556+0000 7fb04effd640 1 -- 172.21.15.17:0/3243922047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7baa55980 con 0x55b7ba67a840 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb04effd640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 0x55b7baa55340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb04000fc90 tx=0x7fb0400056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c913f31f5542f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb036ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb036ffd640 1 -- 172.21.15.17:0/3243922047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04001d040 con 0x55b7ba67a840 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0500ed070 con 0x55b7ba67a840 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb036ffd640 1 -- 172.21.15.17:0/3243922047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fb040004660 con 0x55b7ba67a840 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb036ffd640 1 -- 172.21.15.17:0/3243922047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb040031050 con 0x55b7ba67a840 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb0644b3740 10 client.15735 fetch_fsmap learned FSMap version 31 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b7baac9cc0 con 0x55b7ba67a840 2024-09-21T06:17:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb036ffd640 1 -- 172.21.15.17:0/3243922047 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0500ed070 con 0x55b7ba67a840 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb036ffd640 1 -- 172.21.15.17:0/3243922047 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fb040023770 con 0x55b7ba67a840 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb0644b3740 10 client.15735 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.557+0000 7fb0644b3740 10 client.15735 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb0644b3740 20 client.15735 populate_metadata read hostname 'smithi017' 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb0644b3740 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba62f250 0x55b7baacc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb0644b3740 4 client.15735 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "186d763b", "release": true, "await": true}] 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "186d763b", "release": true, "await": true}) -- 0x55b7ba9b6bf0 con 0x55b7ba62f250 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb0577fe640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba62f250 0x55b7baacc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb036ffd640 10 client.15735 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.558+0000 7fb0577fe640 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba62f250 0x55b7baacc0b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15132aa9e65faa69 server_cookie=e20dc43d6369aaa4 in_seq=0 out_seq=0 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.760+0000 7fb036ffd640 1 -- 172.21.15.17:0/3243922047 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b7ba9b6bf0 con 0x55b7ba62f250 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.760+0000 7fb036ffd640 10 client.15735 handle_command_reply: tid=0 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.760+0000 7fb0644b3740 1 client.15735 shutdown 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 msgr2=0x55b7baa55340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 0x55b7baa55340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb04000fc90 tx=0x7fb0400056e0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 shutdown_connections 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b7ba62f250 0x55b7baacc0b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb036ffd640 0 client.15735 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7ba67a840 0x55b7baa55340 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b7ba69b520 0x55b7baa4fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 --2- 172.21.15.17:0/3243922047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b7ba672660 0x55b7baa54e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.761+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 >> 172.21.15.17:0/3243922047 conn(0x55b7ba68f910 msgr2=0x55b7baa4e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.762+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 shutdown_connections 2024-09-21T06:17:58.393 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 20, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "186d763b": { 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 20, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 130.0, 2024-09-21T06:17:58.394 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:17:58.395 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.762+0000 7fb0644b3740 1 -- 172.21.15.17:0/3243922047 wait complete. 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.762+0000 7fb0644b3740 20 client.15735 trim_cache size 0 max 16384 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0440b65c0 msgr2=0x7fb0440b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0440b65c0 0x7fb0440b8ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb04800abe0 tx=0x7fb04800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 msgr2=0x7fb0581a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb0581a1d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb05002ae70 tx=0x7fb050003f10 comp rx=0 tx=0).stop 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 shutdown_connections 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb0440b65c0 0x7fb0440b8ad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb058110200 0x7fb0581a1d90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb058102fa0 0x7fb05819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 --2- 172.21.15.17:0/3689278174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb058102650 0x7fb05819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 >> 172.21.15.17:0/3689278174 conn(0x7fb058079730 msgr2=0x7fb0581007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 shutdown_connections 2024-09-21T06:17:58.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:17:57.763+0000 7fb05df3f640 1 -- 172.21.15.17:0/3689278174 wait complete. 2024-09-21T06:17:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:17:58 smithi017 ceph-mon[31080]: pgmap v530: 129 pgs: 129 active+clean; 284 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 1012 KiB/s wr, 156 op/s 2024-09-21T06:17:59.167 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:17:58 smithi089 ceph-mon[33879]: pgmap v530: 129 pgs: 129 active+clean; 284 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 1012 KiB/s wr, 156 op/s 2024-09-21T06:17:59.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:17:58 smithi081 ceph-mon[33870]: pgmap v530: 129 pgs: 129 active+clean; 284 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 1012 KiB/s wr, 156 op/s 2024-09-21T06:18:00.105 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '186d763b', total seconds elapsed: 20.4 2024-09-21T06:18:00.468 INFO:tasks.workunit.client.0.smithi017.stdout: 50 5277 21 3814 24 1240 41 2024-09-21T06:18:01.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:00 smithi017 ceph-mon[31080]: pgmap v531: 129 pgs: 129 active+clean; 285 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 742 KiB/s wr, 108 op/s 2024-09-21T06:18:01.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:00 smithi081 ceph-mon[33870]: pgmap v531: 129 pgs: 129 active+clean; 285 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 742 KiB/s wr, 108 op/s 2024-09-21T06:18:01.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:00 smithi089 ceph-mon[33879]: pgmap v531: 129 pgs: 129 active+clean; 285 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 742 KiB/s wr, 108 op/s 2024-09-21T06:18:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:02 smithi017 ceph-mon[31080]: pgmap v532: 129 pgs: 129 active+clean; 286 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 552 KiB/s wr, 31 op/s 2024-09-21T06:18:03.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:02 smithi081 ceph-mon[33870]: pgmap v532: 129 pgs: 129 active+clean; 286 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 552 KiB/s wr, 31 op/s 2024-09-21T06:18:03.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:02 smithi089 ceph-mon[33879]: pgmap v532: 129 pgs: 129 active+clean; 286 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 552 KiB/s wr, 31 op/s 2024-09-21T06:18:05.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:04 smithi081 ceph-mon[33870]: pgmap v533: 129 pgs: 129 active+clean; 287 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 589 KiB/s wr, 33 op/s 2024-09-21T06:18:05.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:04 smithi089 ceph-mon[33879]: pgmap v533: 129 pgs: 129 active+clean; 287 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 589 KiB/s wr, 33 op/s 2024-09-21T06:18:05.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:04 smithi017 ceph-mon[31080]: pgmap v533: 129 pgs: 129 active+clean; 287 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 589 KiB/s wr, 33 op/s 2024-09-21T06:18:07.188 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:06 smithi017 ceph-mon[31080]: pgmap v534: 129 pgs: 129 active+clean; 292 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 912 KiB/s wr, 64 op/s 2024-09-21T06:18:07.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:06 smithi081 ceph-mon[33870]: pgmap v534: 129 pgs: 129 active+clean; 292 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 912 KiB/s wr, 64 op/s 2024-09-21T06:18:07.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:06 smithi089 ceph-mon[33879]: pgmap v534: 129 pgs: 129 active+clean; 292 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 912 KiB/s wr, 64 op/s 2024-09-21T06:18:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:08 smithi081 ceph-mon[33870]: pgmap v535: 129 pgs: 129 active+clean; 296 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.2 MiB/s wr, 103 op/s 2024-09-21T06:18:09.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:08 smithi089 ceph-mon[33879]: pgmap v535: 129 pgs: 129 active+clean; 296 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.2 MiB/s wr, 103 op/s 2024-09-21T06:18:09.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:08 smithi017 ceph-mon[31080]: pgmap v535: 129 pgs: 129 active+clean; 296 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.2 MiB/s wr, 103 op/s 2024-09-21T06:18:10.468 INFO:tasks.workunit.client.0.smithi017.stdout: 54 10198 173 6558 100 3064 175 2024-09-21T06:18:11.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:10 smithi081 ceph-mon[33870]: pgmap v536: 129 pgs: 129 active+clean; 300 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-09-21T06:18:11.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:10 smithi089 ceph-mon[33879]: pgmap v536: 129 pgs: 129 active+clean; 300 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-09-21T06:18:11.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:10 smithi017 ceph-mon[31080]: pgmap v536: 129 pgs: 129 active+clean; 300 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-09-21T06:18:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:12 smithi081 ceph-mon[33870]: pgmap v537: 129 pgs: 129 active+clean; 305 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-09-21T06:18:13.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:12 smithi089 ceph-mon[33879]: pgmap v537: 129 pgs: 129 active+clean; 305 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-09-21T06:18:13.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:12 smithi017 ceph-mon[31080]: pgmap v537: 129 pgs: 129 active+clean; 305 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-09-21T06:18:15.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:14 smithi081 ceph-mon[33870]: pgmap v538: 129 pgs: 129 active+clean; 308 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 140 op/s 2024-09-21T06:18:15.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:14 smithi089 ceph-mon[33879]: pgmap v538: 129 pgs: 129 active+clean; 308 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 140 op/s 2024-09-21T06:18:15.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:14 smithi017 ceph-mon[31080]: pgmap v538: 129 pgs: 129 active+clean; 308 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 140 op/s 2024-09-21T06:18:16.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:15 smithi081 ceph-mon[33870]: pgmap v539: 129 pgs: 129 active+clean; 310 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-09-21T06:18:16.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:15 smithi089 ceph-mon[33879]: pgmap v539: 129 pgs: 129 active+clean; 310 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-09-21T06:18:16.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:15 smithi017 ceph-mon[31080]: pgmap v539: 129 pgs: 129 active+clean; 310 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-09-21T06:18:18.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:18 smithi089 ceph-mon[33879]: pgmap v540: 129 pgs: 129 active+clean; 316 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-21T06:18:18.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:18 smithi017 ceph-mon[31080]: pgmap v540: 129 pgs: 129 active+clean; 316 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-21T06:18:18.677 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T06:18:18.677 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T06:18:18.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:18:18.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:18 smithi081 ceph-mon[33870]: pgmap v540: 129 pgs: 129 active+clean; 316 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-21T06:18:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:19.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 -- 172.21.15.17:0/853507878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c108d10 msgr2=0x7fb70c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:19.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 --2- 172.21.15.17:0/853507878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c108d10 0x7fb70c10f540 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb704009ca0 tx=0x7fb70402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:19.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 -- 172.21.15.17:0/853507878 shutdown_connections 2024-09-21T06:18:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 --2- 172.21.15.17:0/853507878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c108d10 0x7fb70c10f540 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 --2- 172.21.15.17:0/853507878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c1083c0 0x7fb70c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 --2- 172.21.15.17:0/853507878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c102a80 0x7fb70c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 -- 172.21.15.17:0/853507878 >> 172.21.15.17:0/853507878 conn(0x7fb70c079740 msgr2=0x7fb70c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 -- 172.21.15.17:0/853507878 shutdown_connections 2024-09-21T06:18:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.631+0000 7fb712a9a640 1 -- 172.21.15.17:0/853507878 wait complete. 2024-09-21T06:18:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.632+0000 7fb712a9a640 1 Processor -- start 2024-09-21T06:18:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.632+0000 7fb712a9a640 1 -- start start 2024-09-21T06:18:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb712a9a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c102a80 0x7fb70c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb712a9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 0x7fb70c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 0x7fb70c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 0x7fb70c19a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42188/0 (socket says 172.21.15.17:42188) 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb712a9a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c108d10 0x7fb70c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 -- 172.21.15.17:0/1232042729 learned_addr learned my addr 172.21.15.17:0/1232042729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c113980 con 0x7fb70c1083c0 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c113800 con 0x7fb70c102a80 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c113b00 con 0x7fb70c108d10 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb711037640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c108d10 0x7fb70c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 -- 172.21.15.17:0/1232042729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c108d10 msgr2=0x7fb70c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c108d10 0x7fb70c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 -- 172.21.15.17:0/1232042729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c102a80 msgr2=0x7fb70c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c102a80 0x7fb70c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.633+0000 7fb70bfff640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c1a02a0 con 0x7fb70c1083c0 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.634+0000 7fb70bfff640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 0x7fb70c19a8d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e9f0 tx=0x7fb6f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.634+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800ccc0 con 0x7fb70c1083c0 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.634+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6f80054b0 con 0x7fb70c1083c0 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.634+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c1a0590 con 0x7fb70c1083c0 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.635+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c1a6cf0 con 0x7fb70c1083c0 2024-09-21T06:18:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.635+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8010430 con 0x7fb70c1083c0 2024-09-21T06:18:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.636+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c102e90 con 0x7fb70c1083c0 2024-09-21T06:18:19.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.638+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb6f80046c0 con 0x7fb70c1083c0 2024-09-21T06:18:19.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.639+0000 7fb709ffb640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb6fc0b6660 0x7fb6fc0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:19.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.639+0000 7fb710836640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb6fc0b6660 0x7fb6fc0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:19.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.639+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fb6f80e79e0 con 0x7fb70c1083c0 2024-09-21T06:18:19.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.640+0000 7fb710836640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb6fc0b6660 0x7fb6fc0b8b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb7000058c0 tx=0x7fb700005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:19.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.646+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6f80adee0 con 0x7fb70c1083c0 2024-09-21T06:18:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.998+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb70c02e640 con 0x7fb70c1083c0 2024-09-21T06:18:20.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:19.999+0000 7fb709ffb640 1 -- 172.21.15.17:0/1232042729 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7fb6f80b22c0 con 0x7fb70c1083c0 2024-09-21T06:18:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:18:20.001 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:18:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:18:20.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.002+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb6fc0b6660 msgr2=0x7fb6fc0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.002+0000 7fb712a9a640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb6fc0b6660 0x7fb6fc0b8b70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb7000058c0 tx=0x7fb700005850 comp rx=0 tx=0).stop 2024-09-21T06:18:20.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.002+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 msgr2=0x7fb70c19a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.002+0000 7fb712a9a640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 0x7fb70c19a8d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e9f0 tx=0x7fb6f800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.004+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 shutdown_connections 2024-09-21T06:18:20.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.004+0000 7fb712a9a640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fb6fc0b6660 0x7fb6fc0b8b70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.004+0000 7fb712a9a640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c1083c0 0x7fb70c19a8d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.004+0000 7fb712a9a640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb70c108d10 0x7fb70c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.004+0000 7fb712a9a640 1 --2- 172.21.15.17:0/1232042729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c102a80 0x7fb70c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.004+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 >> 172.21.15.17:0/1232042729 conn(0x7fb70c079740 msgr2=0x7fb70c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:20.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.005+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 shutdown_connections 2024-09-21T06:18:20.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:20.005+0000 7fb712a9a640 1 -- 172.21.15.17:0/1232042729 wait complete. 2024-09-21T06:18:20.468 INFO:tasks.workunit.client.0.smithi017.stdout: 56 11258 27 7398 124 2982 139 2024-09-21T06:18:20.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:20 smithi089 ceph-mon[33879]: pgmap v541: 129 pgs: 129 active+clean; 318 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 125 op/s 2024-09-21T06:18:20.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:20 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1232042729' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:20 smithi017 ceph-mon[31080]: pgmap v541: 129 pgs: 129 active+clean; 318 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 125 op/s 2024-09-21T06:18:20.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:20 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1232042729' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:20 smithi081 ceph-mon[33870]: pgmap v541: 129 pgs: 129 active+clean; 318 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 125 op/s 2024-09-21T06:18:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:20 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1232042729' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:21.029 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T06:18:21.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T06:18:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 -- 172.21.15.17:0/1998696644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 msgr2=0x7f47f4108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/1998696644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 0x7f47f4108800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 -- 172.21.15.17:0/1998696644 shutdown_connections 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/1998696644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4108d40 0x7f47f410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/1998696644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 0x7f47f4108800 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/1998696644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4102ab0 0x7f47f4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 -- 172.21.15.17:0/1998696644 >> 172.21.15.17:0/1998696644 conn(0x7f47f4079870 msgr2=0x7f47f4079c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.012+0000 7f47fb5f4640 1 -- 172.21.15.17:0/1998696644 shutdown_connections 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.013+0000 7f47fb5f4640 1 -- 172.21.15.17:0/1998696644 wait complete. 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.013+0000 7f47fb5f4640 1 Processor -- start 2024-09-21T06:18:22.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 -- start start 2024-09-21T06:18:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4102ab0 0x7f47f4101040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 0x7f47f40ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4108d40 0x7f47f40ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41128b0 con 0x7f47f4102ab0 2024-09-21T06:18:22.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4112730 con 0x7f47f4108d40 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47fb5f4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4112a30 con 0x7f47f41083f0 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47f9390640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4102ab0 0x7f47f4101040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47f9390640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4102ab0 0x7f47f4101040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42194/0 (socket says 172.21.15.17:42194) 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47f9390640 1 -- 172.21.15.17:0/2613163526 learned_addr learned my addr 172.21.15.17:0/2613163526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47f9b91640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4108d40 0x7f47f40ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.014+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 0x7f47f40ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47f9b91640 1 -- 172.21.15.17:0/2613163526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 msgr2=0x7f47f40ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47f9b91640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 0x7f47f40ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47f9b91640 1 -- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4102ab0 msgr2=0x7f47f4101040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47f9b91640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4102ab0 0x7f47f4101040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47f9b91640 1 -- 172.21.15.17:0/2613163526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4100390 con 0x7f47f4108d40 2024-09-21T06:18:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47f9b91640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4108d40 0x7f47f40ffb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009fd0 tx=0x7f47ec00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47ea7fc640 1 -- 172.21.15.17:0/2613163526 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00ce20 con 0x7f47f4108d40 2024-09-21T06:18:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47ea7fc640 1 -- 172.21.15.17:0/2613163526 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47ec005020 con 0x7f47f4108d40 2024-09-21T06:18:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47ea7fc640 1 -- 172.21.15.17:0/2613163526 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec010690 con 0x7f47f4108d40 2024-09-21T06:18:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f41acd70 con 0x7f47f4108d40 2024-09-21T06:18:22.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.015+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41ad1d0 con 0x7f47f4108d40 2024-09-21T06:18:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.019+0000 7f4801b68740 1 Processor -- start 2024-09-21T06:18:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f47ea7fc640 1 -- 172.21.15.17:0/2613163526 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f47ec004a40 con 0x7f47f4108d40 2024-09-21T06:18:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 -- start start 2024-09-21T06:18:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447f4990 0x562044bc43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447fcb70 0x562044bc48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562044b3abb0 con 0x5620447fcb70 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562044b29fe0 con 0x5620447f4990 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.020+0000 7f4801b68740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562044b2ddf0 con 0x56204481d850 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:49140/0 (socket says 172.21.15.17:49140) 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 -- 172.21.15.17:0/41169901 learned_addr learned my addr 172.21.15.17:0/41169901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f9390640 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447f4990 0x562044bc43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447fcb70 0x562044bc48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 -- 172.21.15.17:0/41169901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447f4990 msgr2=0x562044bc43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447f4990 0x562044bc43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 -- 172.21.15.17:0/41169901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447fcb70 msgr2=0x562044bc48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447fcb70 0x562044bc48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47f8b8f640 1 -- 172.21.15.17:0/41169901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562044897ba0 con 0x56204481d850 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.021+0000 7f47ea7fc640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f47e00b6610 0x7f47e00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.022+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc3e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47e40096c0 tx=0x7f47e40058b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68cd1f2f4276565 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.022+0000 7f47ea7fc640 1 -- 172.21.15.17:0/2613163526 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f47ec0e7e10 con 0x7f47f4108d40 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.022+0000 7f47f9390640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f47e00b6610 0x7f47e00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.022+0000 7f47df7fe640 1 -- 172.21.15.17:0/41169901 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035040 con 0x56204481d850 2024-09-21T06:18:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.022+0000 7f47df7fe640 1 -- 172.21.15.17:0/41169901 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e40044c0 con 0x56204481d850 2024-09-21T06:18:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.022+0000 7f47df7fe640 1 -- 172.21.15.17:0/41169901 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4003b80 con 0x56204481d850 2024-09-21T06:18:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 -- 172.21.15.17:0/41169901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 msgr2=0x562044bc3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f47f9390640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f47e00b6610 0x7f47e00b8b20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562044bc2af0 tx=0x7f47f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc3e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47e40096c0 tx=0x7f47e40058b0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 -- 172.21.15.17:0/41169901 shutdown_connections 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447fcb70 0x562044bc48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447f4990 0x562044bc43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 --2- 172.21.15.17:0/41169901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc3e70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 -- 172.21.15.17:0/41169901 >> 172.21.15.17:0/41169901 conn(0x562044811c40 msgr2=0x562044bc1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 -- 172.21.15.17:0/41169901 shutdown_connections 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.023+0000 7f4801b68740 1 -- 172.21.15.17:0/41169901 wait complete. 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.024+0000 7f4801b68740 1 -- start start 2024-09-21T06:18:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.024+0000 7f4801b68740 1 Processor -- start 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 0x562044bcfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bcfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56204481d850 0x562044bdb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56204498b7b0 con 0x56204481d850 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562044ac4e90 con 0x5620447fcb70 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562044bd25f0 con 0x5620447f4990 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f9390640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 0x562044bcfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f9390640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 0x562044bcfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:49154/0 (socket says 172.21.15.17:49154) 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f4801b68740 10 client.0 _ll_register_callbacks cb 0x562044b27710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:18:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f9390640 1 -- 172.21.15.17:0/1045767488 learned_addr learned my addr 172.21.15.17:0/1045767488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:22.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bcfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f9b91640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56204481d850 0x562044bdb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f8b8f640 1 -- 172.21.15.17:0/1045767488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 msgr2=0x562044bcfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 0x562044bcfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f8b8f640 1 -- 172.21.15.17:0/1045767488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56204481d850 msgr2=0x562044bdb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56204481d850 0x562044bdb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f8b8f640 1 -- 172.21.15.17:0/1045767488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562044bdbf20 con 0x5620447fcb70 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.025+0000 7f47f9390640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 0x562044bcfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bcfff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47e40096c0 tx=0x7f47e40042c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cbbf0907a6ee0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f47dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f47dcff9640 1 -- 172.21.15.17:0/1045767488 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e404d030 con 0x5620447fcb70 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f47dcff9640 1 -- 172.21.15.17:0/1045767488 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f47e4003800 con 0x5620447fcb70 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562044b3cb00 con 0x5620447fcb70 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f47dcff9640 1 -- 172.21.15.17:0/1045767488 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f47e405a050 con 0x5620447fcb70 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f4801b68740 10 client.25529 fetch_fsmap learned FSMap version 31 2024-09-21T06:18:22.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.026+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562044bde830 con 0x5620447fcb70 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f47dcff9640 1 -- 172.21.15.17:0/1045767488 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e40035f0 con 0x5620447fcb70 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f47dcff9640 1 -- 172.21.15.17:0/1045767488 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f47e403a040 con 0x5620447fcb70 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f4801b68740 10 client.25529 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f4801b68740 10 client.25529 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f4801b68740 20 client.25529 populate_metadata read hostname 'smithi017' 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f4801b68740 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447dc1d0 0x562044be1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f4801b68740 4 client.25529 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562044b3cb00 con 0x5620447dc1d0 2024-09-21T06:18:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.027+0000 7f47f9390640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447dc1d0 0x562044be1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.028+0000 7f47dcff9640 10 client.25529 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.028+0000 7f47f9390640 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447dc1d0 0x562044be1b90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83174c3cd0c150ff server_cookie=3e03e81dece9b8f in_seq=0 out_seq=0 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.028+0000 7f47dcff9640 1 -- 172.21.15.17:0/1045767488 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562044b3cb00 con 0x5620447dc1d0 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f47dcff9640 10 client.25529 handle_command_reply: tid=0 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 client.25529 shutdown 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 msgr2=0x562044bcfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bcfff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47e40096c0 tx=0x7f47e40042c0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 shutdown_connections 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447dc1d0 0x562044be1b90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56204481d850 0x562044bdb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bcfff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f47dcff9640 0 client.25529 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 --2- 172.21.15.17:0/1045767488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447f4990 0x562044bcfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 >> 172.21.15.17:0/1045767488 conn(0x562044811c40 msgr2=0x562044bc7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:22.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 shutdown_connections 2024-09-21T06:18:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 1 -- 172.21.15.17:0/1045767488 wait complete. 2024-09-21T06:18:22.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.029+0000 7f4801b68740 20 client.25529 trim_cache size 0 max 16384 2024-09-21T06:18:22.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.053+0000 7f4801b68740 1 Processor -- start 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 -- start start 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044bdb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bc1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41b9950 con 0x5620447f4990 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f9390640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044bdb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41b71c0 con 0x5620447fcb70 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f4801b68740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41b5010 con 0x56204481d850 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bc1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bc1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:47144/0 (socket says 172.21.15.17:47144) 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f9390640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044bdb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42202/0 (socket says 172.21.15.17:42202) 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 -- 172.21.15.17:0/381604875 learned_addr learned my addr 172.21.15.17:0/381604875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f9b91640 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 -- 172.21.15.17:0/381604875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 msgr2=0x562044bc8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 -- 172.21.15.17:0/381604875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 msgr2=0x562044bdb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.054+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044bdb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.055+0000 7f47f8b8f640 1 -- 172.21.15.17:0/381604875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562044bc5db0 con 0x5620447fcb70 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.055+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bc1db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47e4005d00 tx=0x7f47e402aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6dc760dac40be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.055+0000 7f47deffd640 1 -- 172.21.15.17:0/381604875 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e404d070 con 0x5620447fcb70 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.055+0000 7f47deffd640 1 -- 172.21.15.17:0/381604875 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e4031dc0 con 0x5620447fcb70 2024-09-21T06:18:22.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.055+0000 7f47deffd640 1 -- 172.21.15.17:0/381604875 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035050 con 0x5620447fcb70 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 -- 172.21.15.17:0/381604875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 msgr2=0x562044bc1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bc1db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47e4005d00 tx=0x7f47e402aaf0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 -- 172.21.15.17:0/381604875 shutdown_connections 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56204481d850 0x562044bc8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5620447fcb70 0x562044bc1db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 --2- 172.21.15.17:0/381604875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044bdb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 -- 172.21.15.17:0/381604875 >> 172.21.15.17:0/381604875 conn(0x562044811c40 msgr2=0x562044bc16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:22.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 -- 172.21.15.17:0/381604875 shutdown_connections 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.056+0000 7f4801b68740 1 -- 172.21.15.17:0/381604875 wait complete. 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.057+0000 7f4801b68740 1 -- start start 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.057+0000 7f4801b68740 1 Processor -- start 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.057+0000 7f4801b68740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044be5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f4801b68740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447fcb70 0x562044be1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f4801b68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56204481d850 0x562044be1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f4801b68740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41b5680 con 0x5620447f4990 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f4801b68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41b6af0 con 0x56204481d850 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f4801b68740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47f41b5d50 con 0x5620447fcb70 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9390640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044be5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f4801b68740 10 client.0 _ll_register_callbacks cb 0x7f47f0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f8b8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447fcb70 0x562044be1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9b91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56204481d850 0x562044be1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9390640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044be5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42204/0 (socket says 172.21.15.17:42204) 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9390640 1 -- 172.21.15.17:0/4181356543 learned_addr learned my addr 172.21.15.17:0/4181356543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9b91640 1 -- 172.21.15.17:0/4181356543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447fcb70 msgr2=0x562044be1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9b91640 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447fcb70 0x562044be1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9b91640 1 -- 172.21.15.17:0/4181356543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 msgr2=0x562044be5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9b91640 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044be5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.058+0000 7f47f9b91640 1 -- 172.21.15.17:0/4181356543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562044be2500 con 0x56204481d850 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47f8b8f640 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447fcb70 0x562044be1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47f9b91640 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56204481d850 0x562044be1d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0ad8b0 tx=0x7f47ec0ad5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4dedfb5d4ea99ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:18:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47dcff9640 1 -- 172.21.15.17:0/4181356543 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0ae2b0 con 0x56204481d850 2024-09-21T06:18:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47dcff9640 1 -- 172.21.15.17:0/4181356543 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f47ec0051d0 con 0x56204481d850 2024-09-21T06:18:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e4031dc0 con 0x56204481d850 2024-09-21T06:18:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47dcff9640 1 -- 172.21.15.17:0/4181356543 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f47ec0b2690 con 0x56204481d850 2024-09-21T06:18:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f4801b68740 10 client.25535 fetch_fsmap learned FSMap version 31 2024-09-21T06:18:22.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562044c4d210 con 0x56204481d850 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.059+0000 7f47dcff9640 1 -- 172.21.15.17:0/4181356543 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47ec0b75d0 con 0x56204481d850 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f47dcff9640 1 -- 172.21.15.17:0/4181356543 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f47ec0cfc50 con 0x56204481d850 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f4801b68740 10 client.25535 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f4801b68740 10 client.25535 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f4801b68740 20 client.25535 populate_metadata read hostname 'smithi017' 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f4801b68740 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447b1580 0x562044c4fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f4801b68740 4 client.25535 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x7f47e4031dc0 con 0x5620447b1580 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f47f9390640 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447b1580 0x562044c4fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f47dcff9640 10 client.25535 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:22.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:22.060+0000 7f47f9390640 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447b1580 0x562044c4fa70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f448d00a5f854f3f server_cookie=64f012e58712969f in_seq=0 out_seq=0 2024-09-21T06:18:22.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:22 smithi089 ceph-mon[33879]: pgmap v542: 129 pgs: 129 active+clean; 324 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2024-09-21T06:18:22.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:22 smithi017 ceph-mon[31080]: pgmap v542: 129 pgs: 129 active+clean; 324 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2024-09-21T06:18:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:22 smithi081 ceph-mon[33870]: pgmap v542: 129 pgs: 129 active+clean; 324 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2024-09-21T06:18:23.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:23 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:23.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:23 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:23.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:23 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:24.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f47dcff9640 1 -- 172.21.15.17:0/4181356543 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f47e4031dc0 con 0x5620447b1580 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f47dcff9640 10 client.25535 handle_command_reply: tid=0 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 client.25535 shutdown 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56204481d850 msgr2=0x562044be1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56204481d850 0x562044be1d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0ad8b0 tx=0x7f47ec0ad5c0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 shutdown_connections 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x5620447b1580 0x562044c4fa70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56204481d850 0x562044be1d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5620447fcb70 0x562044be1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f47dcff9640 0 client.25535 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 --2- 172.21.15.17:0/4181356543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620447f4990 0x562044be5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.161+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 >> 172.21.15.17:0/4181356543 conn(0x562044811c40 msgr2=0x562044bc4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 shutdown_connections 2024-09-21T06:18:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f4801b68740 1 -- 172.21.15.17:0/4181356543 wait complete. 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f4801b68740 20 client.25535 trim_cache size 0 max 16384 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 22, 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ceafa6e5": { 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 22, 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:18:24.165 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 139.2, 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:24.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f47e00b6610 msgr2=0x7f47e00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f47e00b6610 0x7f47e00b8b20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562044bc2af0 tx=0x7f47f0005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4108d40 msgr2=0x7f47f40ffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.162+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4108d40 0x7f47f40ffb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009fd0 tx=0x7f47ec00ef10 comp rx=0 tx=0).stop 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 shutdown_connections 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f47e00b6610 0x7f47e00b8b20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47f4108d40 0x7f47f40ffb70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f41083f0 0x7f47f40ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 --2- 172.21.15.17:0/2613163526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47f4102ab0 0x7f47f4101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 >> 172.21.15.17:0/2613163526 conn(0x7f47f4079870 msgr2=0x7f47f406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 shutdown_connections 2024-09-21T06:18:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:24.163+0000 7f47fb5f4640 1 -- 172.21.15.17:0/2613163526 wait complete. 2024-09-21T06:18:24.482 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:24 smithi017 ceph-mon[31080]: pgmap v543: 129 pgs: 129 active+clean; 324 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-09-21T06:18:24.482 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:24.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:24.483 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:18:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:24 smithi089 ceph-mon[33879]: pgmap v543: 129 pgs: 129 active+clean; 324 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-09-21T06:18:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:24.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:18:24.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:24 smithi081 ceph-mon[33870]: pgmap v543: 129 pgs: 129 active+clean; 324 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-09-21T06:18:24.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:24.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:24.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:18:24.904 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ceafa6e5', quiesce took 6.2 seconds. Will release after: 13.05 2024-09-21T06:18:26.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:26 smithi089 ceph-mon[33879]: pgmap v544: 129 pgs: 129 active+clean; 326 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-21T06:18:26.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:26 smithi017 ceph-mon[31080]: pgmap v544: 129 pgs: 129 active+clean; 326 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-21T06:18:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:26 smithi081 ceph-mon[33870]: pgmap v544: 129 pgs: 129 active+clean; 326 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-09-21T06:18:28.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:28 smithi089 ceph-mon[33879]: pgmap v545: 129 pgs: 129 active+clean; 329 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 150 op/s 2024-09-21T06:18:28.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:28 smithi017 ceph-mon[31080]: pgmap v545: 129 pgs: 129 active+clean; 329 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 150 op/s 2024-09-21T06:18:28.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:28 smithi081 ceph-mon[33870]: pgmap v545: 129 pgs: 129 active+clean; 329 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 150 op/s 2024-09-21T06:18:30.468 INFO:tasks.workunit.client.0.smithi017.stdout: 57 8794 27 5797 6 2568 20 2024-09-21T06:18:30.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:30 smithi089 ceph-mon[33879]: pgmap v546: 129 pgs: 129 active+clean; 329 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-09-21T06:18:30.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:30 smithi017 ceph-mon[31080]: pgmap v546: 129 pgs: 129 active+clean; 329 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-09-21T06:18:30.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:30 smithi081 ceph-mon[33870]: pgmap v546: 129 pgs: 129 active+clean; 329 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-09-21T06:18:32.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:32 smithi089 ceph-mon[33879]: pgmap v547: 129 pgs: 129 active+clean; 331 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.1 MiB/s wr, 108 op/s 2024-09-21T06:18:32.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:32 smithi017 ceph-mon[31080]: pgmap v547: 129 pgs: 129 active+clean; 331 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.1 MiB/s wr, 108 op/s 2024-09-21T06:18:32.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:32 smithi081 ceph-mon[33870]: pgmap v547: 129 pgs: 129 active+clean; 331 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.1 MiB/s wr, 108 op/s 2024-09-21T06:18:34.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:34 smithi089 ceph-mon[33879]: pgmap v548: 129 pgs: 129 active+clean; 331 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 652 KiB/s wr, 73 op/s 2024-09-21T06:18:34.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:34 smithi017 ceph-mon[31080]: pgmap v548: 129 pgs: 129 active+clean; 331 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 652 KiB/s wr, 73 op/s 2024-09-21T06:18:34.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:34 smithi081 ceph-mon[33870]: pgmap v548: 129 pgs: 129 active+clean; 331 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 652 KiB/s wr, 73 op/s 2024-09-21T06:18:36.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:36 smithi089 ceph-mon[33879]: pgmap v549: 129 pgs: 129 active+clean; 333 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 803 KiB/s wr, 92 op/s 2024-09-21T06:18:36.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:36 smithi017 ceph-mon[31080]: pgmap v549: 129 pgs: 129 active+clean; 333 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 803 KiB/s wr, 92 op/s 2024-09-21T06:18:36.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:36 smithi081 ceph-mon[33870]: pgmap v549: 129 pgs: 129 active+clean; 333 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 803 KiB/s wr, 92 op/s 2024-09-21T06:18:37.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:18:38.365 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:38.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:38 smithi089 ceph-mon[33879]: pgmap v550: 129 pgs: 129 active+clean; 336 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 883 KiB/s wr, 103 op/s 2024-09-21T06:18:38.632 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:38 smithi017 ceph-mon[31080]: pgmap v550: 129 pgs: 129 active+clean; 336 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 883 KiB/s wr, 103 op/s 2024-09-21T06:18:38.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:38 smithi081 ceph-mon[33870]: pgmap v550: 129 pgs: 129 active+clean; 336 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 883 KiB/s wr, 103 op/s 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.928+0000 7f3b04975640 1 -- 172.21.15.17:0/2655069055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00102ae0 msgr2=0x7f3b00102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.928+0000 7f3b04975640 1 --2- 172.21.15.17:0/2655069055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00102ae0 0x7f3b00102ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009900 tx=0x7f3af002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 -- 172.21.15.17:0/2655069055 shutdown_connections 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 --2- 172.21.15.17:0/2655069055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00108d20 0x7f3b0010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 --2- 172.21.15.17:0/2655069055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b001083d0 0x7f3b001087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 --2- 172.21.15.17:0/2655069055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00102ae0 0x7f3b00102ef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 -- 172.21.15.17:0/2655069055 >> 172.21.15.17:0/2655069055 conn(0x7f3b00079790 msgr2=0x7f3b00079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 -- 172.21.15.17:0/2655069055 shutdown_connections 2024-09-21T06:18:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.929+0000 7f3b04975640 1 -- 172.21.15.17:0/2655069055 wait complete. 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 Processor -- start 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 -- start start 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ae0 0x7f3b0019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b001083d0 0x7f3b0019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00108d20 0x7f3b001a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001117d0 con 0x7f3b00102ae0 2024-09-21T06:18:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00111650 con 0x7f3b001083d0 2024-09-21T06:18:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3b04975640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00111950 con 0x7f3b00108d20 2024-09-21T06:18:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.930+0000 7f3afe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ae0 0x7f3b0019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00108d20 0x7f3b001a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ae0 0x7f3b0019c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60076/0 (socket says 172.21.15.17:60076) 2024-09-21T06:18:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afe59c640 1 -- 172.21.15.17:0/2522998846 learned_addr learned my addr 172.21.15.17:0/2522998846 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afdd9b640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b001083d0 0x7f3b0019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 -- 172.21.15.17:0/2522998846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b001083d0 msgr2=0x7f3b0019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b001083d0 0x7f3b0019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 -- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ae0 msgr2=0x7f3b0019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ae0 0x7f3b0019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 -- 172.21.15.17:0/2522998846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001a2550 con 0x7f3b00108d20 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3afed9d640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00108d20 0x7f3b001a1e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009fd0 tx=0x7f3af800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800ce20 con 0x7f3b00108d20 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3af8005020 con 0x7f3b00108d20 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.931+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b001a2840 con 0x7f3b00108d20 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.932+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b001a8fa0 con 0x7f3b00108d20 2024-09-21T06:18:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.932+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8010690 con 0x7f3b00108d20 2024-09-21T06:18:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.933+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae00052c0 con 0x7f3b00108d20 2024-09-21T06:18:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.935+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3af8004a40 con 0x7f3b00108d20 2024-09-21T06:18:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.936+0000 7f3aef7fe640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3ae80b6590 0x7f3ae80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.936+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f3af80e7aa0 con 0x7f3b00108d20 2024-09-21T06:18:38.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.936+0000 7f3afe59c640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3ae80b6590 0x7f3ae80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.937+0000 7f3afe59c640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3ae80b6590 0x7f3ae80b8aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3af00096c0 tx=0x7f3af0005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:38.940+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3af80adfa0 con 0x7f3b00108d20 2024-09-21T06:18:39.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.298+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ae00055b0 con 0x7f3b00108d20 2024-09-21T06:18:39.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.299+0000 7f3aef7fe640 1 -- 172.21.15.17:0/2522998846 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7f3af80b2380 con 0x7f3b00108d20 2024-09-21T06:18:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:18:39.302 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:18:39.302 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:18:39.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3ae80b6590 msgr2=0x7f3ae80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3ae80b6590 0x7f3ae80b8aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3af00096c0 tx=0x7f3af0005e80 comp rx=0 tx=0).stop 2024-09-21T06:18:39.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00108d20 msgr2=0x7f3b001a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00108d20 0x7f3b001a1e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009fd0 tx=0x7f3af800ef10 comp rx=0 tx=0).stop 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 shutdown_connections 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f3ae80b6590 0x7f3ae80b8aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b00108d20 0x7f3b001a1e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b001083d0 0x7f3b0019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 --2- 172.21.15.17:0/2522998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ae0 0x7f3b0019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 >> 172.21.15.17:0/2522998846 conn(0x7f3b00079790 msgr2=0x7f3b00106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:39.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 shutdown_connections 2024-09-21T06:18:39.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:39.303+0000 7f3b04975640 1 -- 172.21.15.17:0/2522998846 wait complete. 2024-09-21T06:18:39.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:39 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2522998846' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:39.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:39 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2522998846' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:39.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:39 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2522998846' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:40.086 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id ceafa6e5 --release --await' 2024-09-21T06:18:40.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id ceafa6e5 --release --await 2024-09-21T06:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:40.468 INFO:tasks.workunit.client.0.smithi017.stdout: 57 11664 0 7861 0 3460 0 2024-09-21T06:18:40.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:40 smithi089 ceph-mon[33879]: pgmap v551: 129 pgs: 129 active+clean; 339 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 924 KiB/s wr, 156 op/s 2024-09-21T06:18:40.625 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:40 smithi017 ceph-mon[31080]: pgmap v551: 129 pgs: 129 active+clean; 339 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 924 KiB/s wr, 156 op/s 2024-09-21T06:18:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:40 smithi081 ceph-mon[33870]: pgmap v551: 129 pgs: 129 active+clean; 339 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 924 KiB/s wr, 156 op/s 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 -- 172.21.15.17:0/2487431508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928109e20 msgr2=0x7fd928110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 --2- 172.21.15.17:0/2487431508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928109e20 0x7fd928110650 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd920009900 tx=0x7fd92002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 -- 172.21.15.17:0/2487431508 shutdown_connections 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 --2- 172.21.15.17:0/2487431508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928109e20 0x7fd928110650 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 --2- 172.21.15.17:0/2487431508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9281094d0 0x7fd9281098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 --2- 172.21.15.17:0/2487431508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd928103b90 0x7fd928103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 -- 172.21.15.17:0/2487431508 >> 172.21.15.17:0/2487431508 conn(0x7fd9280ff600 msgr2=0x7fd928101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 -- 172.21.15.17:0/2487431508 shutdown_connections 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.015+0000 7fd92d375640 1 -- 172.21.15.17:0/2487431508 wait complete. 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.016+0000 7fd92d375640 1 Processor -- start 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.016+0000 7fd92d375640 1 -- start start 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 0x7fd92819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9281094d0 0x7fd92819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd928109e20 0x7fd92819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd928113990 con 0x7fd928103b90 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd928113810 con 0x7fd9281094d0 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd928113b10 con 0x7fd928109e20 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 0x7fd92819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 0x7fd92819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60094/0 (socket says 172.21.15.17:60094) 2024-09-21T06:18:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 -- 172.21.15.17:0/3808780014 learned_addr learned my addr 172.21.15.17:0/3808780014 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd9267fc640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9281094d0 0x7fd92819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd9277fe640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd928109e20 0x7fd92819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 -- 172.21.15.17:0/3808780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd928109e20 msgr2=0x7fd92819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd928109e20 0x7fd92819fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 -- 172.21.15.17:0/3808780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9281094d0 msgr2=0x7fd92819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9281094d0 0x7fd92819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 -- 172.21.15.17:0/3808780014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9281a02f0 con 0x7fd928103b90 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd926ffd640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 0x7fd92819a380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd91800eab0 tx=0x7fd91800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd90ffff640 1 -- 172.21.15.17:0/3808780014 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91800ce40 con 0x7fd928103b90 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9281a05e0 con 0x7fd928103b90 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.017+0000 7fd90ffff640 1 -- 172.21.15.17:0/3808780014 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd918011900 con 0x7fd928103b90 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.018+0000 7fd90ffff640 1 -- 172.21.15.17:0/3808780014 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918010990 con 0x7fd928103b90 2024-09-21T06:18:41.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.018+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9281a6d40 con 0x7fd928103b90 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.020+0000 7fd9338e9740 1 Processor -- start 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.020+0000 7fd9338e9740 1 -- start start 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.020+0000 7fd90ffff640 1 -- 172.21.15.17:0/3808780014 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd918011470 con 0x7fd928103b90 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9b9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9338e9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56229a8a4dc0 con 0x56229a5ea660 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9338e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56229a9311f0 con 0x56229a613520 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9338e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56229a920620 con 0x56229a5f2840 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9b9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60108/0 (socket says 172.21.15.17:60108) 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd926ffd640 1 -- 172.21.15.17:0/2996308903 learned_addr learned my addr 172.21.15.17:0/2996308903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:41.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9277fe640 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 -- 172.21.15.17:0/2996308903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 msgr2=0x56229a9b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9b9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 -- 172.21.15.17:0/2996308903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 msgr2=0x56229a9b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9b9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 -- 172.21.15.17:0/2996308903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229a8e8fd0 con 0x56229a5f2840 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd926ffd640 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9b9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd90ffff640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9100b6510 0x7fd9100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.021+0000 7fd9267fc640 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9b9f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd92806bab0 tx=0x7fd91c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8244bb2253a2cefe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.022+0000 7fd90ffff640 1 -- 172.21.15.17:0/3808780014 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd9180e7bf0 con 0x7fd928103b90 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.022+0000 7fd9277fe640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9100b6510 0x7fd9100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.022+0000 7fd90d7fa640 1 -- 172.21.15.17:0/2996308903 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c004250 con 0x56229a5f2840 2024-09-21T06:18:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.022+0000 7fd90d7fa640 1 -- 172.21.15.17:0/2996308903 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd91c009e10 con 0x56229a5f2840 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.022+0000 7fd90d7fa640 1 -- 172.21.15.17:0/2996308903 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c004c30 con 0x56229a5f2840 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 -- 172.21.15.17:0/2996308903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 msgr2=0x56229a9b9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9b9f90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd92806bab0 tx=0x7fd91c011810 comp rx=0 tx=0).stop 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9277fe640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9100b6510 0x7fd9100b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd920006010 tx=0x7fd920009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 -- 172.21.15.17:0/2996308903 shutdown_connections 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9b9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9b9f90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 --2- 172.21.15.17:0/2996308903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 -- 172.21.15.17:0/2996308903 >> 172.21.15.17:0/2996308903 conn(0x56229a607910 msgr2=0x56229a9b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 -- 172.21.15.17:0/2996308903 shutdown_connections 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 -- 172.21.15.17:0/2996308903 wait complete. 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 -- start start 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.023+0000 7fd9338e9740 1 Processor -- start 2024-09-21T06:18:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56229a8bb300 con 0x56229a5ea660 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56229a924430 con 0x56229a613520 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x56229a781bb0 con 0x56229a5f2840 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9338e9740 10 client.0 _ll_register_callbacks cb 0x56229a8d5120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60124/0 (socket says 172.21.15.17:60124) 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 -- 172.21.15.17:0/1898788211 learned_addr learned my addr 172.21.15.17:0/1898788211 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9267fc640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9277fe640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 -- 172.21.15.17:0/1898788211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 msgr2=0x56229a9c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 -- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 msgr2=0x56229a9c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 -- 172.21.15.17:0/1898788211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229a8aa780 con 0x56229a5ea660 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9267fc640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd9277fe640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd926ffd640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c4bb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd9180094e0 tx=0x7fd9180103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fcd1a7845daa26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd90aff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.024+0000 7fd90aff5640 1 -- 172.21.15.17:0/1898788211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9180ad7c0 con 0x56229a5ea660 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd90aff5640 1 -- 172.21.15.17:0/1898788211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd9180acc50 con 0x56229a5ea660 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd91c009e10 con 0x56229a5ea660 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd90aff5640 1 -- 172.21.15.17:0/1898788211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd9180a9160 con 0x56229a5ea660 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 10 client.15777 fetch_fsmap learned FSMap version 31 2024-09-21T06:18:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56229a67eb00 con 0x56229a5ea660 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd90aff5640 1 -- 172.21.15.17:0/1898788211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd918096070 con 0x56229a5ea660 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd90aff5640 1 -- 172.21.15.17:0/1898788211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fd91800f040 con 0x56229a5ea660 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 10 client.15777 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 10 client.15777 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 20 client.15777 populate_metadata read hostname 'smithi017' 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a5d1ea0 0x56229a9d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 4 client.15777 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56229a933140 con 0x56229a5d1ea0 2024-09-21T06:18:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.025+0000 7fd9267fc640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a5d1ea0 0x56229a9d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.026+0000 7fd9267fc640 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a5d1ea0 0x56229a9d6fd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6677271a97758e82 server_cookie=2c50cc5e27efdded in_seq=0 out_seq=0 2024-09-21T06:18:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.026+0000 7fd90aff5640 10 client.15777 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd90aff5640 1 -- 172.21.15.17:0/1898788211 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56229a933140 con 0x56229a5d1ea0 2024-09-21T06:18:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd90aff5640 10 client.15777 handle_command_reply: tid=0 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 client.15777 shutdown 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 msgr2=0x56229a9c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c4bb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd9180094e0 tx=0x7fd9180103d0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 shutdown_connections 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a5d1ea0 0x56229a9d6fd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd90aff5640 0 client.15777 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a613520 0x56229a9c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5f2840 0x56229a9c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 --2- 172.21.15.17:0/1898788211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c4bb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 >> 172.21.15.17:0/1898788211 conn(0x56229a607910 msgr2=0x56229a9bc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 shutdown_connections 2024-09-21T06:18:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 1 -- 172.21.15.17:0/1898788211 wait complete. 2024-09-21T06:18:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.027+0000 7fd9338e9740 20 client.15777 trim_cache size 0 max 16384 2024-09-21T06:18:41.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 Processor -- start 2024-09-21T06:18:41.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 -- start start 2024-09-21T06:18:41.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5f2840 0x56229a9c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9281b10d0 con 0x56229a5ea660 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9281ae940 con 0x56229a5f2840 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.044+0000 7fd9338e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd9281ac790 con 0x56229a5d1ea0 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60126/0 (socket says 172.21.15.17:60126) 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 -- 172.21.15.17:0/596125763 learned_addr learned my addr 172.21.15.17:0/596125763 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd926ffd640 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9277fe640 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5f2840 0x56229a9c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 -- 172.21.15.17:0/596125763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 msgr2=0x56229a9c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 -- 172.21.15.17:0/596125763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5f2840 msgr2=0x56229a9c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5f2840 0x56229a9c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 -- 172.21.15.17:0/596125763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56229a6f5960 con 0x56229a5ea660 2024-09-21T06:18:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd9267fc640 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c67e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd91c004520 tx=0x7fd91c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b182cde9bf3106ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd90cff9640 1 -- 172.21.15.17:0/596125763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c01e040 con 0x56229a5ea660 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd90cff9640 1 -- 172.21.15.17:0/596125763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd91c01f040 con 0x56229a5ea660 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.045+0000 7fd90cff9640 1 -- 172.21.15.17:0/596125763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c026440 con 0x56229a5ea660 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 -- 172.21.15.17:0/596125763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 msgr2=0x56229a9c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c67e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd91c004520 tx=0x7fd91c0047e0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 -- 172.21.15.17:0/596125763 shutdown_connections 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5ea660 0x56229a9c67e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5f2840 0x56229a9c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 --2- 172.21.15.17:0/596125763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 -- 172.21.15.17:0/596125763 >> 172.21.15.17:0/596125763 conn(0x56229a607910 msgr2=0x56229a9c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 -- 172.21.15.17:0/596125763 shutdown_connections 2024-09-21T06:18:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.046+0000 7fd9338e9740 1 -- 172.21.15.17:0/596125763 wait complete. 2024-09-21T06:18:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 -- start start 2024-09-21T06:18:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 Processor -- start 2024-09-21T06:18:41.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5ea660 0x56229a9c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 0x56229a9c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9281ace00 con 0x56229a5f2840 2024-09-21T06:18:41.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9281ae270 con 0x56229a5ea660 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd9281ad4d0 con 0x56229a5d1ea0 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9338e9740 10 client.0 _ll_register_callbacks cb 0x7fd91800ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 0x56229a9c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 0x56229a9c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60142/0 (socket says 172.21.15.17:60142) 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 -- 172.21.15.17:0/3145568969 learned_addr learned my addr 172.21.15.17:0/3145568969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9267fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5ea660 0x56229a9c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd926ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 -- 172.21.15.17:0/3145568969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 msgr2=0x56229a9cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 -- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5ea660 msgr2=0x56229a9c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5ea660 0x56229a9c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.047+0000 7fd9277fe640 1 -- 172.21.15.17:0/3145568969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56229a9ca1d0 con 0x56229a5f2840 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9277fe640 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 0x56229a9c9c90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd920009900 tx=0x7fd920009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57538d817f918c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd90aff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd90aff5640 1 -- 172.21.15.17:0/3145568969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920035040 con 0x56229a5f2840 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd90aff5640 1 -- 172.21.15.17:0/3145568969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fd9200035f0 con 0x56229a5f2840 2024-09-21T06:18:41.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd91c01f040 con 0x56229a5f2840 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd90aff5640 1 -- 172.21.15.17:0/3145568969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd9200044d0 con 0x56229a5f2840 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 10 client.15783 fetch_fsmap learned FSMap version 31 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56229aa42600 con 0x56229a5f2840 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd90aff5640 1 -- 172.21.15.17:0/3145568969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd91c01f040 con 0x56229a5f2840 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd90aff5640 1 -- 172.21.15.17:0/3145568969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fd920044070 con 0x56229a5f2840 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 10 client.15783 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 10 client.15783 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 20 client.15783 populate_metadata read hostname 'smithi017' 2024-09-21T06:18:41.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.048+0000 7fd9338e9740 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a613520 0x56229aa44d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.049+0000 7fd9338e9740 4 client.15783 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ceafa6e5", "release": true, "await": true}] 2024-09-21T06:18:41.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.049+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ceafa6e5", "release": true, "await": true}) -- 0x56229a92ebf0 con 0x56229a613520 2024-09-21T06:18:41.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.049+0000 7fd926ffd640 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a613520 0x56229aa44d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.049+0000 7fd926ffd640 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a613520 0x56229aa44d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7d912d8396705db server_cookie=7332412703df88ae in_seq=0 out_seq=0 2024-09-21T06:18:41.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.049+0000 7fd90aff5640 10 client.15783 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.234+0000 7fd90aff5640 1 -- 172.21.15.17:0/3145568969 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56229a92ebf0 con 0x56229a613520 2024-09-21T06:18:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.234+0000 7fd90aff5640 10 client.15783 handle_command_reply: tid=0 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.234+0000 7fd9338e9740 1 client.15783 shutdown 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.234+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 msgr2=0x56229a9c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 0x56229a9c9c90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd920009900 tx=0x7fd920009260 comp rx=0 tx=0).stop 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 shutdown_connections 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x56229a613520 0x56229aa44d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56229a5f2840 0x56229a9c9c90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd90aff5640 0 client.15783 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56229a5ea660 0x56229a9c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 --2- 172.21.15.17:0/3145568969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56229a5d1ea0 0x56229a9cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 >> 172.21.15.17:0/3145568969 conn(0x56229a607910 msgr2=0x56229a9c3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 shutdown_connections 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 1 -- 172.21.15.17:0/3145568969 wait complete. 2024-09-21T06:18:41.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.235+0000 7fd9338e9740 20 client.15783 trim_cache size 0 max 16384 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 24, 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "ceafa6e5": { 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 24, 2024-09-21T06:18:41.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 139.2, 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:41.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:41.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:41.240 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:18:41.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9100b6510 msgr2=0x7fd9100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9100b6510 0x7fd9100b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd920006010 tx=0x7fd920009600 comp rx=0 tx=0).stop 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 msgr2=0x7fd92819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 0x7fd92819a380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd91800eab0 tx=0x7fd91800ef70 comp rx=0 tx=0).stop 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 shutdown_connections 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fd9100b6510 0x7fd9100b8a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd928109e20 0x7fd92819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9281094d0 0x7fd92819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 --2- 172.21.15.17:0/3808780014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd928103b90 0x7fd92819a380 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 >> 172.21.15.17:0/3808780014 conn(0x7fd9280ff600 msgr2=0x7fd928101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 shutdown_connections 2024-09-21T06:18:41.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:41.236+0000 7fd92d375640 1 -- 172.21.15.17:0/3808780014 wait complete. 2024-09-21T06:18:41.961 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ceafa6e5', total seconds elapsed: 23.3 2024-09-21T06:18:41.961 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T06:18:41.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:18:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:42.616 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:42 smithi089 ceph-mon[33879]: pgmap v552: 129 pgs: 129 active+clean; 341 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1020 KiB/s wr, 211 op/s 2024-09-21T06:18:42.629 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:42 smithi017 ceph-mon[31080]: pgmap v552: 129 pgs: 129 active+clean; 341 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1020 KiB/s wr, 211 op/s 2024-09-21T06:18:42.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:42 smithi081 ceph-mon[33870]: pgmap v552: 129 pgs: 129 active+clean; 341 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1020 KiB/s wr, 211 op/s 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 -- 172.21.15.17:0/2704049384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 msgr2=0x7f7b881087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2704049384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b881087e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009900 tx=0x7f7b7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 -- 172.21.15.17:0/2704049384 shutdown_connections 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2704049384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88108d20 0x7f7b8810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2704049384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b881087e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2704049384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88102ae0 0x7f7b88102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 -- 172.21.15.17:0/2704049384 >> 172.21.15.17:0/2704049384 conn(0x7f7b88079790 msgr2=0x7f7b88079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 -- 172.21.15.17:0/2704049384 shutdown_connections 2024-09-21T06:18:42.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.927+0000 7f7b8d432640 1 -- 172.21.15.17:0/2704049384 wait complete. 2024-09-21T06:18:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.928+0000 7f7b8d432640 1 Processor -- start 2024-09-21T06:18:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.928+0000 7f7b8d432640 1 -- start start 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b8d432640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88102ae0 0x7f7b8819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b8d432640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b8819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b8d432640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88108d20 0x7f7b8819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b86ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88102ae0 0x7f7b8819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b8819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b8819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:45292/0 (socket says 172.21.15.17:45292) 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b86ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88102ae0 0x7f7b8819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:43684/0 (socket says 172.21.15.17:43684) 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b867fc640 1 -- 172.21.15.17:0/2112605397 learned_addr learned my addr 172.21.15.17:0/2112605397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881128e0 con 0x7f7b88108d20 2024-09-21T06:18:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88112760 con 0x7f7b881083d0 2024-09-21T06:18:42.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88112a60 con 0x7f7b88102ae0 2024-09-21T06:18:42.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.929+0000 7f7b877fe640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88108d20 0x7f7b8819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:42.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b867fc640 1 -- 172.21.15.17:0/2112605397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88102ae0 msgr2=0x7f7b8819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b867fc640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88102ae0 0x7f7b8819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b867fc640 1 -- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88108d20 msgr2=0x7f7b8819fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b867fc640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88108d20 0x7f7b8819fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b867fc640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b881a0130 con 0x7f7b881083d0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b867fc640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b8819a760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c02a930 tx=0x7f7b7c030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c03f070 con 0x7f7b881083d0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b881a03c0 con 0x7f7b881083d0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b88109520 con 0x7f7b881083d0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b7c004460 con 0x7f7b881083d0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.930+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c035030 con 0x7f7b881083d0 2024-09-21T06:18:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.932+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b740052c0 con 0x7f7b881083d0 2024-09-21T06:18:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.933+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7b7c042070 con 0x7f7b881083d0 2024-09-21T06:18:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.934+0000 7f7b6ffff640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7b700b6590 0x7f7b700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.934+0000 7f7b86ffd640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7b700b6590 0x7f7b700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.934+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f7b7c1080c0 con 0x7f7b881083d0 2024-09-21T06:18:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.935+0000 7f7b86ffd640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7b700b6590 0x7f7b700b8aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009bd0 tx=0x7f7b78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:42.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:42.939+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b7c0d29a0 con 0x7f7b881083d0 2024-09-21T06:18:43.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.321+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b740055b0 con 0x7f7b881083d0 2024-09-21T06:18:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:18:43.324 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:18:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:18:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.322+0000 7f7b6ffff640 1 -- 172.21.15.17:0/2112605397 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7f7b7c0d78e0 con 0x7f7b881083d0 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7b700b6590 msgr2=0x7f7b700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7b700b6590 0x7f7b700b8aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009bd0 tx=0x7f7b78005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 msgr2=0x7f7b8819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b8819a760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c02a930 tx=0x7f7b7c030650 comp rx=0 tx=0).stop 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 shutdown_connections 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7b700b6590 0x7f7b700b8aa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88108d20 0x7f7b8819fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b881083d0 0x7f7b8819a760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 --2- 172.21.15.17:0/2112605397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b88102ae0 0x7f7b8819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 >> 172.21.15.17:0/2112605397 conn(0x7f7b88079790 msgr2=0x7f7b88101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:43.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.325+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 shutdown_connections 2024-09-21T06:18:43.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:43.326+0000 7f7b8d432640 1 -- 172.21.15.17:0/2112605397 wait complete. 2024-09-21T06:18:43.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:43 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2112605397' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:43.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:43 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2112605397' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:43.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:43 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2112605397' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:43.999 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T06:18:43.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T06:18:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:44.629 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:44 smithi017 ceph-mon[31080]: pgmap v553: 129 pgs: 129 active+clean; 342 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 971 KiB/s wr, 231 op/s 2024-09-21T06:18:44.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:44 smithi081 ceph-mon[33870]: pgmap v553: 129 pgs: 129 active+clean; 342 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 971 KiB/s wr, 231 op/s 2024-09-21T06:18:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:44 smithi089 ceph-mon[33879]: pgmap v553: 129 pgs: 129 active+clean; 342 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 971 KiB/s wr, 231 op/s 2024-09-21T06:18:45.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 -- 172.21.15.17:0/421549918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 msgr2=0x7f2ca8109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 --2- 172.21.15.17:0/421549918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 0x7f2ca8109900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009860 tx=0x7f2c9c02a340 comp rx=0 tx=0).stop 2024-09-21T06:18:45.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 -- 172.21.15.17:0/421549918 shutdown_connections 2024-09-21T06:18:45.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 --2- 172.21.15.17:0/421549918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 0x7f2ca8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 --2- 172.21.15.17:0/421549918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 0x7f2ca8109900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 --2- 172.21.15.17:0/421549918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.134+0000 7f2cae028640 1 -- 172.21.15.17:0/421549918 >> 172.21.15.17:0/421549918 conn(0x7f2ca80ff5e0 msgr2=0x7f2ca8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.135+0000 7f2cae028640 1 -- 172.21.15.17:0/421549918 shutdown_connections 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.135+0000 7f2cae028640 1 -- 172.21.15.17:0/421549918 wait complete. 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.135+0000 7f2cae028640 1 Processor -- start 2024-09-21T06:18:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 -- start start 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 0x7f2ca819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 0x7f2ca819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81139b0 con 0x7f2ca8103bb0 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8113830 con 0x7f2ca8109e40 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2cae028640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8113b30 con 0x7f2ca81094f0 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60194/0 (socket says 172.21.15.17:60194) 2024-09-21T06:18:45.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2ca77fe640 1 -- 172.21.15.17:0/3985889672 learned_addr learned my addr 172.21.15.17:0/3985889672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 0x7f2ca819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.136+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 0x7f2ca819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca77fe640 1 -- 172.21.15.17:0/3985889672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 msgr2=0x7f2ca819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 0x7f2ca819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca77fe640 1 -- 172.21.15.17:0/3985889672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 msgr2=0x7f2ca819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 0x7f2ca819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca77fe640 1 -- 172.21.15.17:0/3985889672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca81a03f0 con 0x7f2ca8103bb0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 0x7f2ca819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca819a480 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800e9c0 tx=0x7f2c9800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca4ff9640 1 -- 172.21.15.17:0/3985889672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800cde0 con 0x7f2ca8103bb0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca4ff9640 1 -- 172.21.15.17:0/3985889672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c980035f0 con 0x7f2ca8103bb0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca81a06e0 con 0x7f2ca8103bb0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2ca4ff9640 1 -- 172.21.15.17:0/3985889672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98010690 con 0x7f2ca8103bb0 2024-09-21T06:18:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.137+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca81a6e40 con 0x7f2ca8103bb0 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 Processor -- start 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 -- start start 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ed8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ed93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ed98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562d70e4fbb0 con 0x562d70b09990 2024-09-21T06:18:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d70e3efe0 con 0x562d70b11b70 2024-09-21T06:18:45.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.140+0000 7f2cb459c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562d70e42df0 con 0x562d70b32850 2024-09-21T06:18:45.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ed98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ed98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:45326/0 (socket says 172.21.15.17:45326) 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/1653919716 learned_addr learned my addr 172.21.15.17:0/1653919716 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca4ff9640 1 -- 172.21.15.17:0/3985889672 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2c98004020 con 0x7f2ca8103bb0 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ed8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/1653919716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 msgr2=0x562d70ed8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ed8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/1653919716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 msgr2=0x562d70ed93b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ed93b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.141+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/1653919716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d70bacba0 con 0x562d70b11b70 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ed98f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009830 tx=0x7f2c9c005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edb4da2c41ef5aae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2c8dffb640 1 -- 172.21.15.17:0/1653919716 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c043070 con 0x562d70b11b70 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2ca4ff9640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2c900b6510 0x7f2c900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2c8dffb640 1 -- 172.21.15.17:0/1653919716 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c9c0044b0 con 0x562d70b11b70 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2c8dffb640 1 -- 172.21.15.17:0/1653919716 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c037040 con 0x562d70b11b70 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2ca4ff9640 1 -- 172.21.15.17:0/3985889672 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f2c980e7930 con 0x7f2ca8103bb0 2024-09-21T06:18:45.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.142+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2c900b6510 0x7f2c900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 -- 172.21.15.17:0/1653919716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 msgr2=0x562d70ed98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2c900b6510 0x7f2c900b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009fd0 tx=0x7f2ca0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ed98f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009830 tx=0x7f2c9c005e70 comp rx=0 tx=0).stop 2024-09-21T06:18:45.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 -- 172.21.15.17:0/1653919716 shutdown_connections 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ed93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ed98f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1653919716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ed8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 -- 172.21.15.17:0/1653919716 >> 172.21.15.17:0/1653919716 conn(0x562d70b26c40 msgr2=0x562d70ed6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 -- 172.21.15.17:0/1653919716 shutdown_connections 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 -- 172.21.15.17:0/1653919716 wait complete. 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.143+0000 7f2cb459c740 1 -- start start 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 Processor -- start 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ee4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ee5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ef0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562d70ca07b0 con 0x562d70b09990 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d70dd9e90 con 0x562d70b11b70 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562d70ee75f0 con 0x562d70b32850 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2cb459c740 10 client.0 _ll_register_callbacks cb 0x562d70e3c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2ca6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ee5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2ca6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ee5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:45342/0 (socket says 172.21.15.17:45342) 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/992292624 learned_addr learned my addr 172.21.15.17:0/992292624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ee4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.144+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ef0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/992292624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 msgr2=0x562d70ef0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ef0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/992292624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 msgr2=0x562d70ee4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ee4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/992292624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d70ef0ed0 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ee4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ee5000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c02a860 tx=0x7f2c9c030bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24de82768541601 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2c86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2c86ffd640 1 -- 172.21.15.17:0/992292624 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c037030 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2c86ffd640 1 -- 172.21.15.17:0/992292624 <== mon.2 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f2c9c030340 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.145+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9c0044b0 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2c86ffd640 1 -- 172.21.15.17:0/992292624 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c9c054050 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 10 client.25577 fetch_fsmap learned FSMap version 31 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562d70ef3800 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2c86ffd640 1 -- 172.21.15.17:0/992292624 <== mon.2 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c9c0044b0 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2c86ffd640 1 -- 172.21.15.17:0/992292624 <== mon.2 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f2c9c032440 con 0x562d70b11b70 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 10 client.25577 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:18:45.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 10 client.25577 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 20 client.25577 populate_metadata read hostname 'smithi017' 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70af11d0 0x562d70ef6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 4 client.25577 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d70e51b00 con 0x562d70af11d0 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.146+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70af11d0 0x562d70ef6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.147+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70af11d0 0x562d70ef6b60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eae594d7619d035 server_cookie=e86ab28e483a0795 in_seq=0 out_seq=0 2024-09-21T06:18:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.147+0000 7f2c86ffd640 10 client.25577 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.147+0000 7f2c86ffd640 1 -- 172.21.15.17:0/992292624 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d70e51b00 con 0x562d70af11d0 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.147+0000 7f2c86ffd640 10 client.25577 handle_command_reply: tid=0 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 client.25577 shutdown 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 msgr2=0x562d70ee5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ee5000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c02a860 tx=0x7f2c9c030bb0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 shutdown_connections 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70af11d0 0x562d70ef6b60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b32850 0x562d70ef0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b11b70 0x562d70ee5000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 --2- 172.21.15.17:0/992292624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70ee4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 >> 172.21.15.17:0/992292624 conn(0x562d70b26c40 msgr2=0x562d70edc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2c86ffd640 0 client.25577 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 shutdown_connections 2024-09-21T06:18:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 1 -- 172.21.15.17:0/992292624 wait complete. 2024-09-21T06:18:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.148+0000 7f2cb459c740 20 client.25577 trim_cache size 0 max 16384 2024-09-21T06:18:45.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 Processor -- start 2024-09-21T06:18:45.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 -- start start 2024-09-21T06:18:45.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70eda860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 0x562d70ee4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70edc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81b5670 con 0x562d70b09990 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81b2ee0 con 0x562d70b32850 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.173+0000 7f2cb459c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81b0d30 con 0x562d70b11b70 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 0x562d70ee4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 0x562d70ee4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:43712/0 (socket says 172.21.15.17:43712) 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/99655639 learned_addr learned my addr 172.21.15.17:0/99655639 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70eda860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70edc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/99655639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 msgr2=0x562d70edc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70edc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/99655639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 msgr2=0x562d70eda860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70eda860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 -- 172.21.15.17:0/99655639 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d70ee5810 con 0x562d70b11b70 2024-09-21T06:18:45.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca7fff640 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70edc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:45.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 0x562d70ee4150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c035040 tx=0x7f2c9c0096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bea2042a82f9c484 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2c8d7fa640 1 -- 172.21.15.17:0/99655639 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c037040 con 0x562d70b11b70 2024-09-21T06:18:45.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2c8d7fa640 1 -- 172.21.15.17:0/99655639 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c9c032640 con 0x562d70b11b70 2024-09-21T06:18:45.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.174+0000 7f2c8d7fa640 1 -- 172.21.15.17:0/99655639 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c043040 con 0x562d70b11b70 2024-09-21T06:18:45.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 -- 172.21.15.17:0/99655639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 msgr2=0x562d70ee4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 0x562d70ee4150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c035040 tx=0x7f2c9c0096f0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 -- 172.21.15.17:0/99655639 shutdown_connections 2024-09-21T06:18:45.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70edc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b11b70 0x562d70ee4150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 --2- 172.21.15.17:0/99655639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b09990 0x562d70eda860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 -- 172.21.15.17:0/99655639 >> 172.21.15.17:0/99655639 conn(0x562d70b26c40 msgr2=0x562d70ee5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 -- 172.21.15.17:0/99655639 shutdown_connections 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.176+0000 7f2cb459c740 1 -- 172.21.15.17:0/99655639 wait complete. 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.177+0000 7f2cb459c740 1 -- start start 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.177+0000 7f2cb459c740 1 Processor -- start 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.177+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 0x562d70ef7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.177+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b11b70 0x562d70ef82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.177+0000 7f2cb459c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70ef87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2cb459c740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81b13a0 con 0x562d70b11b70 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2cb459c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81b2810 con 0x562d70b32850 2024-09-21T06:18:45.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2cb459c740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81b1a70 con 0x562d70b09990 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2cb459c740 10 client.0 _ll_register_callbacks cb 0x7f2ca0009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 0x562d70ef7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 0x562d70ef7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.17:43720/0 (socket says 172.21.15.17:43720) 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 -- 172.21.15.17:0/1511691648 learned_addr learned my addr 172.21.15.17:0/1511691648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b11b70 0x562d70ef82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 -- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 msgr2=0x562d70ef87e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70ef87e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 -- 172.21.15.17:0/1511691648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b11b70 msgr2=0x562d70ef82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b11b70 0x562d70ef82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 -- 172.21.15.17:0/1511691648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d70f60410 con 0x562d70b09990 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2ca77fe640 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 0x562d70ef7d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2c98005ce0 tx=0x7f2c98003d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e3867c759a557c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2c86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.89:3300/0 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.178+0000 7f2c86ffd640 1 -- 172.21.15.17:0/1511691648 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98009400 con 0x562d70b09990 2024-09-21T06:18:45.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2c86ffd640 1 -- 172.21.15.17:0/1511691648 <== mon.1 v2:172.21.15.89:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f2c98004310 con 0x562d70b09990 2024-09-21T06:18:45.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9c032640 con 0x562d70b09990 2024-09-21T06:18:45.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2c86ffd640 1 -- 172.21.15.17:0/1511691648 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c980a99a0 con 0x562d70b09990 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2cb459c740 10 client.25534 fetch_fsmap learned FSMap version 31 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562d70f616d0 con 0x562d70b09990 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2c86ffd640 1 -- 172.21.15.17:0/1511691648 <== mon.1 v2:172.21.15.89:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c9c032640 con 0x562d70b09990 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.179+0000 7f2c86ffd640 1 -- 172.21.15.17:0/1511691648 <== mon.1 v2:172.21.15.89:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f2c980ac400 con 0x562d70b09990 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2cb459c740 10 client.25534 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2cb459c740 10 client.25534 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2cb459c740 20 client.25534 populate_metadata read hostname 'smithi017' 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70ac6580 0x562d70f63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2cb459c740 4 client.25534 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x562d70e4d5b0 con 0x562d70ac6580 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70ac6580 0x562d70f63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2c86ffd640 10 client.25534 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:45.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:45.180+0000 7f2ca6ffd640 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70ac6580 0x562d70f63eb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef783a4dbed545d server_cookie=597a81598d9b92c0 in_seq=0 out_seq=0 2024-09-21T06:18:46.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:46 smithi017 ceph-mon[31080]: pgmap v554: 129 pgs: 129 active+clean; 345 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-21T06:18:46.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:46 smithi081 ceph-mon[33870]: pgmap v554: 129 pgs: 129 active+clean; 345 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-21T06:18:46.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:46 smithi089 ceph-mon[33879]: pgmap v554: 129 pgs: 129 active+clean; 345 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 254 op/s 2024-09-21T06:18:47.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2c86ffd640 1 -- 172.21.15.17:0/1511691648 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562d70e4d5b0 con 0x562d70ac6580 2024-09-21T06:18:47.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2c86ffd640 10 client.25534 handle_command_reply: tid=0 2024-09-21T06:18:47.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 client.25534 shutdown 2024-09-21T06:18:47.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 msgr2=0x562d70ef7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 0x562d70ef7d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2c98005ce0 tx=0x7f2c98003d70 comp rx=0 tx=0).stop 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 shutdown_connections 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x562d70ac6580 0x562d70f63eb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d70b11b70 0x562d70ef82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2c86ffd640 0 client.25534 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d70b32850 0x562d70ef87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 --2- 172.21.15.17:0/1511691648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d70b09990 0x562d70ef7d60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 >> 172.21.15.17:0/1511691648 conn(0x562d70b26c40 msgr2=0x562d70eda630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 shutdown_connections 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 1 -- 172.21.15.17:0/1511691648 wait complete. 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.383+0000 7f2cb459c740 20 client.25534 trim_cache size 0 max 16384 2024-09-21T06:18:47.386 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 26, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "a26096be": { 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 26, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:18:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 139.2, 2024-09-21T06:18:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:18:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:18:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:18:47.390 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:18:47.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2c900b6510 msgr2=0x7f2c900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2c900b6510 0x7f2c900b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009fd0 tx=0x7f2ca0009500 comp rx=0 tx=0).stop 2024-09-21T06:18:47.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 msgr2=0x7f2ca819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca819a480 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800e9c0 tx=0x7f2c9800ee80 comp rx=0 tx=0).stop 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 shutdown_connections 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2c900b6510 0x7f2c900b8a20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca8109e40 0x7f2ca819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ca81094f0 0x7f2ca819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 --2- 172.21.15.17:0/3985889672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ca8103bb0 0x7f2ca819a480 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 >> 172.21.15.17:0/3985889672 conn(0x7f2ca80ff5e0 msgr2=0x7f2ca8108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.384+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 shutdown_connections 2024-09-21T06:18:47.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:18:47.385+0000 7f2cae028640 1 -- 172.21.15.17:0/3985889672 wait complete. 2024-09-21T06:18:48.238 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a26096be', quiesce took 6.3 seconds. Will release after: 12.95 2024-09-21T06:18:48.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:48 smithi017 ceph-mon[31080]: pgmap v555: 129 pgs: 129 active+clean; 347 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 264 op/s 2024-09-21T06:18:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:48 smithi081 ceph-mon[33870]: pgmap v555: 129 pgs: 129 active+clean; 347 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 264 op/s 2024-09-21T06:18:48.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:48 smithi089 ceph-mon[33879]: pgmap v555: 129 pgs: 129 active+clean; 347 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 264 op/s 2024-09-21T06:18:50.468 INFO:tasks.workunit.client.0.smithi017.stdout: 57 7406 57 5225 19 2791 48 2024-09-21T06:18:50.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:50 smithi017 ceph-mon[31080]: pgmap v556: 129 pgs: 129 active+clean; 349 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 1.1 MiB/s wr, 249 op/s 2024-09-21T06:18:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:50 smithi081 ceph-mon[33870]: pgmap v556: 129 pgs: 129 active+clean; 349 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 1.1 MiB/s wr, 249 op/s 2024-09-21T06:18:50.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:50 smithi089 ceph-mon[33879]: pgmap v556: 129 pgs: 129 active+clean; 349 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 1.1 MiB/s wr, 249 op/s 2024-09-21T06:18:52.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:52 smithi017 ceph-mon[31080]: pgmap v557: 129 pgs: 129 active+clean; 349 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 856 KiB/s wr, 180 op/s 2024-09-21T06:18:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:52 smithi081 ceph-mon[33870]: pgmap v557: 129 pgs: 129 active+clean; 349 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 856 KiB/s wr, 180 op/s 2024-09-21T06:18:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:52 smithi089 ceph-mon[33879]: pgmap v557: 129 pgs: 129 active+clean; 349 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 856 KiB/s wr, 180 op/s 2024-09-21T06:18:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:54 smithi017 ceph-mon[31080]: pgmap v558: 129 pgs: 129 active+clean; 349 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 761 KiB/s wr, 135 op/s 2024-09-21T06:18:54.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:54 smithi081 ceph-mon[33870]: pgmap v558: 129 pgs: 129 active+clean; 349 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 761 KiB/s wr, 135 op/s 2024-09-21T06:18:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:54 smithi089 ceph-mon[33879]: pgmap v558: 129 pgs: 129 active+clean; 349 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 761 KiB/s wr, 135 op/s 2024-09-21T06:18:56.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:56 smithi017 ceph-mon[31080]: pgmap v559: 129 pgs: 129 active+clean; 352 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 912 KiB/s wr, 135 op/s 2024-09-21T06:18:56.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:56 smithi081 ceph-mon[33870]: pgmap v559: 129 pgs: 129 active+clean; 352 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 912 KiB/s wr, 135 op/s 2024-09-21T06:18:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:56 smithi089 ceph-mon[33879]: pgmap v559: 129 pgs: 129 active+clean; 352 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 912 KiB/s wr, 135 op/s 2024-09-21T06:18:58.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:18:58 smithi081 ceph-mon[33870]: pgmap v560: 129 pgs: 129 active+clean; 338 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 787 KiB/s wr, 127 op/s 2024-09-21T06:18:58.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:18:58 smithi089 ceph-mon[33879]: pgmap v560: 129 pgs: 129 active+clean; 338 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 787 KiB/s wr, 127 op/s 2024-09-21T06:18:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:18:58 smithi017 ceph-mon[31080]: pgmap v560: 129 pgs: 129 active+clean; 338 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 787 KiB/s wr, 127 op/s 2024-09-21T06:19:00.469 INFO:tasks.workunit.client.0.smithi017.stdout: 57 10166 0 6684 0 2894 0 2024-09-21T06:19:00.669 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:00 smithi089 ceph-mon[33879]: pgmap v561: 129 pgs: 129 active+clean; 334 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 608 KiB/s wr, 108 op/s 2024-09-21T06:19:00.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:00 smithi081 ceph-mon[33870]: pgmap v561: 129 pgs: 129 active+clean; 334 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 608 KiB/s wr, 108 op/s 2024-09-21T06:19:00.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:00 smithi017 ceph-mon[31080]: pgmap v561: 129 pgs: 129 active+clean; 334 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 608 KiB/s wr, 108 op/s 2024-09-21T06:19:01.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:19:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 -- 172.21.15.17:0/4055752944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 msgr2=0x7f33f41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:01.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 --2- 172.21.15.17:0/4055752944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f41087b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009900 tx=0x7f33e802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 -- 172.21.15.17:0/4055752944 shutdown_connections 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 --2- 172.21.15.17:0/4055752944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f41087b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 --2- 172.21.15.17:0/4055752944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 --2- 172.21.15.17:0/4055752944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f4102a60 0x7f33f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 -- 172.21.15.17:0/4055752944 >> 172.21.15.17:0/4055752944 conn(0x7f33f4079730 msgr2=0x7f33f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 -- 172.21.15.17:0/4055752944 shutdown_connections 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.966+0000 7f33f95fb640 1 -- 172.21.15.17:0/4055752944 wait complete. 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.967+0000 7f33f95fb640 1 Processor -- start 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.967+0000 7f33f95fb640 1 -- start start 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.967+0000 7f33f95fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f4102a60 0x7f33f419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.967+0000 7f33f95fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f95fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f95fb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4112810 con 0x7f33f41083a0 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f95fb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4112690 con 0x7f33f4108cf0 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f95fb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4112990 con 0x7f33f4102a60 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f419b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59796/0 (socket says 172.21.15.17:59796) 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 -- 172.21.15.17:0/1991384542 learned_addr learned my addr 172.21.15.17:0/1991384542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f37fe640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f2ffd640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f4102a60 0x7f33f419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 -- 172.21.15.17:0/1991384542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f4102a60 msgr2=0x7f33f419b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f4102a60 0x7f33f419b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 -- 172.21.15.17:0/1991384542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 msgr2=0x7f33f419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 -- 172.21.15.17:0/1991384542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41a6470 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f37fe640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f27fc640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f419b6a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005940 tx=0x7f33e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e803f030 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.968+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f41a6700 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.969+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e8003c90 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.969+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a6c30 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.969+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8035070 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.970+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4102e70 con 0x7f33f41083a0 2024-09-21T06:19:01.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.971+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f33e8042030 con 0x7f33f41083a0 2024-09-21T06:19:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.973+0000 7f33dbfff640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33dc0b6510 0x7f33dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.973+0000 7f33f2ffd640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33dc0b6510 0x7f33dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.973+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f33e8108030 con 0x7f33f41083a0 2024-09-21T06:19:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.973+0000 7f33f2ffd640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33dc0b6510 0x7f33dc0b8a20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005fd0 tx=0x7f33e4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:01.976+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33e80ce530 con 0x7f33f41083a0 2024-09-21T06:19:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.206+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33f410aaf0 con 0x7f33f41083a0 2024-09-21T06:19:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.206+0000 7f33dbfff640 1 -- 172.21.15.17:0/1991384542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7f33e80d2910 con 0x7f33f41083a0 2024-09-21T06:19:02.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:19:02.208 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:19:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33dc0b6510 msgr2=0x7f33dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33dc0b6510 0x7f33dc0b8a20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005fd0 tx=0x7f33e4005850 comp rx=0 tx=0).stop 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 msgr2=0x7f33f419b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f419b6a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005940 tx=0x7f33e80042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 shutdown_connections 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f33dc0b6510 0x7f33dc0b8a20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33f41083a0 0x7f33f419b6a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 --2- 172.21.15.17:0/1991384542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33f4102a60 0x7f33f419b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 >> 172.21.15.17:0/1991384542 conn(0x7f33f4079730 msgr2=0x7f33f41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 shutdown_connections 2024-09-21T06:19:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:02.209+0000 7f33f95fb640 1 -- 172.21.15.17:0/1991384542 wait complete. 2024-09-21T06:19:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:02 smithi017 ceph-mon[31080]: pgmap v562: 129 pgs: 129 active+clean; 336 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 674 KiB/s wr, 92 op/s 2024-09-21T06:19:02.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:02 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1991384542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:02.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:02 smithi081 ceph-mon[33870]: pgmap v562: 129 pgs: 129 active+clean; 336 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 674 KiB/s wr, 92 op/s 2024-09-21T06:19:02.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:02 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1991384542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:02.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:02 smithi089 ceph-mon[33879]: pgmap v562: 129 pgs: 129 active+clean; 336 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 674 KiB/s wr, 92 op/s 2024-09-21T06:19:02.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:02 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1991384542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:03.124 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id a26096be --release --await' 2024-09-21T06:19:03.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id a26096be --release --await 2024-09-21T06:19:03.386 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:03.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 -- 172.21.15.17:0/2267319202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 msgr2=0x7ff5441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 --2- 172.21.15.17:0/2267319202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff5441087b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009900 tx=0x7ff52c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 -- 172.21.15.17:0/2267319202 shutdown_connections 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 --2- 172.21.15.17:0/2267319202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff5441087b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 --2- 172.21.15.17:0/2267319202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544108cf0 0x7ff54410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 --2- 172.21.15.17:0/2267319202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544102a60 0x7ff544102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 -- 172.21.15.17:0/2267319202 >> 172.21.15.17:0/2267319202 conn(0x7ff544079730 msgr2=0x7ff544079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 -- 172.21.15.17:0/2267319202 shutdown_connections 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.907+0000 7ff5498aa640 1 -- 172.21.15.17:0/2267319202 wait complete. 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 Processor -- start 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 -- start start 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544102a60 0x7ff54419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff54419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544108cf0 0x7ff54419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff544112810 con 0x7ff5441083a0 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff544112690 con 0x7ff544102a60 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.908+0000 7ff5498aa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff544112990 con 0x7ff544108cf0 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff54419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff54419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59818/0 (socket says 172.21.15.17:59818) 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 -- 172.21.15.17:0/378674751 learned_addr learned my addr 172.21.15.17:0/378674751 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff542ffd640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544102a60 0x7ff54419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5437fe640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544108cf0 0x7ff54419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 -- 172.21.15.17:0/378674751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544108cf0 msgr2=0x7ff54419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544108cf0 0x7ff54419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 -- 172.21.15.17:0/378674751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544102a60 msgr2=0x7ff54419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544102a60 0x7ff54419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 -- 172.21.15.17:0/378674751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5441a0380 con 0x7ff5441083a0 2024-09-21T06:19:03.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5427fc640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff54419a9b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005940 tx=0x7ff52c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5488a8640 1 -- 172.21.15.17:0/378674751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c03f030 con 0x7ff5441083a0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5488a8640 1 -- 172.21.15.17:0/378674751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff52c004440 con 0x7ff5441083a0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5441a0610 con 0x7ff5441083a0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.909+0000 7ff5488a8640 1 -- 172.21.15.17:0/378674751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c035070 con 0x7ff5441083a0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.910+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441a6dd0 con 0x7ff5441083a0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 Processor -- start 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 -- start start 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff5488a8640 1 -- 172.21.15.17:0/378674751 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff52c042030 con 0x7ff5441083a0 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a28c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a28ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a28cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55715a177dc0 con 0x557159ebd660 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55715a2041f0 con 0x557159ee6520 2024-09-21T06:19:03.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.912+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55715a1f3620 con 0x557159ec5840 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a28ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a28ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59834/0 (socket says 172.21.15.17:59834) 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 -- 172.21.15.17:0/3247049870 learned_addr learned my addr 172.21.15.17:0/3247049870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff5437fe640 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a28c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff5427fc640 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a28cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 -- 172.21.15.17:0/3247049870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 msgr2=0x55715a28cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a28cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 -- 172.21.15.17:0/3247049870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 msgr2=0x55715a28c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a28c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 -- 172.21.15.17:0/3247049870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715a1bbfd0 con 0x557159ebd660 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff5488a8640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5300b6510 0x7ff5300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff542ffd640 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a28ca50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff5340114f0 tx=0x7ff5340119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2a58f3fbc55eae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:03.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff5437fe640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5300b6510 0x7ff5300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff5488a8640 1 -- 172.21.15.17:0/378674751 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff52c107a70 con 0x7ff5441083a0 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.913+0000 7ff539ffb640 1 -- 172.21.15.17:0/3247049870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534004d20 con 0x557159ebd660 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff539ffb640 1 -- 172.21.15.17:0/3247049870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff534004050 con 0x557159ebd660 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff539ffb640 1 -- 172.21.15.17:0/3247049870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53400f7a0 con 0x557159ebd660 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3247049870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 msgr2=0x55715a28ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a28ca50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff5340114f0 tx=0x7ff5340119b0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff5437fe640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5300b6510 0x7ff5300b8a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b6c0 tx=0x7ff53c00b2e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3247049870 shutdown_connections 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a28ca50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a28cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3247049870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a28c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.914+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3247049870 >> 172.21.15.17:0/3247049870 conn(0x557159eda910 msgr2=0x55715a28a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.915+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3247049870 shutdown_connections 2024-09-21T06:19:03.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.915+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3247049870 wait complete. 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.915+0000 7ff54fe1e740 1 -- start start 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.915+0000 7ff54fe1e740 1 Processor -- start 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a297bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ec5840 0x55715a2980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ee6520 0x55715a298670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55715a18e300 con 0x557159ebd660 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55715a1f7430 con 0x557159ec5840 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55715a054bb0 con 0x557159ee6520 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a297bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a297bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59836/0 (socket says 172.21.15.17:59836) 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 -- 172.21.15.17:0/2014070782 learned_addr learned my addr 172.21.15.17:0/2014070782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff5427fc640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ec5840 0x55715a2980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff54fe1e740 10 client.0 _ll_register_callbacks cb 0x55715a1a8120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff5437fe640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ee6520 0x55715a298670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 -- 172.21.15.17:0/2014070782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ee6520 msgr2=0x55715a298670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ee6520 0x55715a298670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 -- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ec5840 msgr2=0x55715a2980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ec5840 0x55715a2980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 -- 172.21.15.17:0/2014070782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715a17d780 con 0x557159ebd660 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff542ffd640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a297bb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff534006010 tx=0x7ff534004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6bed60cfadb01c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.916+0000 7ff522ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff522ffd640 1 -- 172.21.15.17:0/2014070782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534028020 con 0x557159ebd660 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff522ffd640 1 -- 172.21.15.17:0/2014070782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff534003c40 con 0x557159ebd660 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff534004050 con 0x557159ebd660 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff522ffd640 1 -- 172.21.15.17:0/2014070782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff534033050 con 0x557159ebd660 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 10 client.15822 fetch_fsmap learned FSMap version 31 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557159f51b00 con 0x557159ebd660 2024-09-21T06:19:03.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff522ffd640 1 -- 172.21.15.17:0/2014070782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff534004050 con 0x557159ebd660 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff522ffd640 1 -- 172.21.15.17:0/2014070782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7ff53400fb80 con 0x557159ebd660 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 10 client.15822 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 10 client.15822 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 20 client.15822 populate_metadata read hostname 'smithi017' 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159ea4ea0 0x55715a2a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 4 client.15822 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.917+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55715a206140 con 0x557159ea4ea0 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.918+0000 7ff5427fc640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159ea4ea0 0x55715a2a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.918+0000 7ff5427fc640 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159ea4ea0 0x55715a2a9e80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3dbb87eecef1764 server_cookie=b3c5e7883cb28c8d in_seq=0 out_seq=0 2024-09-21T06:19:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.918+0000 7ff522ffd640 10 client.15822 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:19:03.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff522ffd640 1 -- 172.21.15.17:0/2014070782 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55715a206140 con 0x557159ea4ea0 2024-09-21T06:19:03.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff522ffd640 10 client.15822 handle_command_reply: tid=0 2024-09-21T06:19:03.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 client.15822 shutdown 2024-09-21T06:19:03.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 msgr2=0x55715a297bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:03.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a297bb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff534006010 tx=0x7ff534004c70 comp rx=0 tx=0).stop 2024-09-21T06:19:03.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 shutdown_connections 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159ea4ea0 0x55715a2a9e80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ee6520 0x55715a298670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ec5840 0x55715a2980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2014070782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a297bb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff522ffd640 0 client.15822 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 >> 172.21.15.17:0/2014070782 conn(0x557159eda910 msgr2=0x55715a28f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 shutdown_connections 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2014070782 wait complete. 2024-09-21T06:19:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.919+0000 7ff54fe1e740 20 client.15822 trim_cache size 0 max 16384 2024-09-21T06:19:03.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.937+0000 7ff54fe1e740 1 Processor -- start 2024-09-21T06:19:03.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.937+0000 7ff54fe1e740 1 -- start start 2024-09-21T06:19:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a293350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a294da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a2952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b32f0 con 0x557159ebd660 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b0b60 con 0x557159ee6520 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441ae9b0 con 0x557159ec5840 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a293350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a293350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59840/0 (socket says 172.21.15.17:59840) 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 -- 172.21.15.17:0/3962223262 learned_addr learned my addr 172.21.15.17:0/3962223262 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff5427fc640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a294da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff5437fe640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a2952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 -- 172.21.15.17:0/3962223262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 msgr2=0x55715a294da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a294da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 -- 172.21.15.17:0/3962223262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 msgr2=0x55715a2952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a2952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 -- 172.21.15.17:0/3962223262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557159fc8960 con 0x557159ebd660 2024-09-21T06:19:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff5427fc640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a294da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff5437fe640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a2952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff542ffd640 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a293350 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff534009370 tx=0x7ff534004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bc30fb35784a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.938+0000 7ff5397fa640 1 -- 172.21.15.17:0/3962223262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534028070 con 0x557159ebd660 2024-09-21T06:19:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff5397fa640 1 -- 172.21.15.17:0/3962223262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff534004ce0 con 0x557159ebd660 2024-09-21T06:19:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff5397fa640 1 -- 172.21.15.17:0/3962223262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5340057e0 con 0x557159ebd660 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3962223262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 msgr2=0x55715a293350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a293350 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff534009370 tx=0x7ff534004900 comp rx=0 tx=0).stop 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3962223262 shutdown_connections 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a2952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a294da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/3962223262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a293350 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3962223262 >> 172.21.15.17:0/3962223262 conn(0x557159eda910 msgr2=0x55715a2984e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.939+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3962223262 shutdown_connections 2024-09-21T06:19:03.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.940+0000 7ff54fe1e740 1 -- 172.21.15.17:0/3962223262 wait complete. 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.940+0000 7ff54fe1e740 1 -- start start 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.940+0000 7ff54fe1e740 1 Processor -- start 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a29c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a29c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a3137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441af020 con 0x557159ebd660 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441b0490 con 0x557159ee6520 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5441af6f0 con 0x557159ec5840 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff54fe1e740 10 client.0 _ll_register_callbacks cb 0x7ff53c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a29c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a29c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59856/0 (socket says 172.21.15.17:59856) 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 -- 172.21.15.17:0/2631418214 learned_addr learned my addr 172.21.15.17:0/2631418214 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff5427fc640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a29c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff5437fe640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a3137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 -- 172.21.15.17:0/2631418214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 msgr2=0x55715a29c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a29c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 -- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 msgr2=0x55715a3137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a3137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 -- 172.21.15.17:0/2631418214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715a313d30 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff5437fe640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a3137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff542ffd640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a29c1a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff534005060 tx=0x7ff534009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f5c273fd8e564a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff522ffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.941+0000 7ff522ffd640 1 -- 172.21.15.17:0/2631418214 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534028070 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff522ffd640 1 -- 172.21.15.17:0/2631418214 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ff534003c40 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff534004ce0 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff522ffd640 1 -- 172.21.15.17:0/2631418214 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff53404a050 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 10 client.15828 fetch_fsmap learned FSMap version 31 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55715a314d40 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff522ffd640 1 -- 172.21.15.17:0/2631418214 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff534004ce0 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff522ffd640 1 -- 172.21.15.17:0/2631418214 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7ff53400f560 con 0x557159ebd660 2024-09-21T06:19:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 10 client.15828 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 10 client.15828 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 20 client.15828 populate_metadata read hostname 'smithi017' 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159e7a250 0x55715a317400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 4 client.15828 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a26096be", "release": true, "await": true}] 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.942+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a26096be", "release": true, "await": true}) -- 0x55715a201bf0 con 0x557159e7a250 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.943+0000 7ff5427fc640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159e7a250 0x55715a317400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.943+0000 7ff5427fc640 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159e7a250 0x55715a317400 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3b666778954f4d server_cookie=17999175e7d3c7f8 in_seq=0 out_seq=0 2024-09-21T06:19:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:03.943+0000 7ff522ffd640 10 client.15828 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff522ffd640 1 -- 172.21.15.17:0/2631418214 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55715a201bf0 con 0x557159e7a250 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff522ffd640 10 client.15828 handle_command_reply: tid=0 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 client.15828 shutdown 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 msgr2=0x55715a29c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a29c1a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff534005060 tx=0x7ff534009c80 comp rx=0 tx=0).stop 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 shutdown_connections 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x557159e7a250 0x55715a317400 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff522ffd640 0 client.15828 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557159ee6520 0x55715a3137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557159ec5840 0x55715a29c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 --2- 172.21.15.17:0/2631418214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557159ebd660 0x55715a29c1a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 >> 172.21.15.17:0/2631418214 conn(0x557159eda910 msgr2=0x55715a2a3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 shutdown_connections 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 1 -- 172.21.15.17:0/2631418214 wait complete. 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.165+0000 7ff54fe1e740 20 client.15828 trim_cache size 0 max 16384 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 28, 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:19:04.168 INFO:teuthology.orchestra.run.smithi017.stdout: "a26096be": { 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 28, 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 139.2, 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:19:04.169 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5300b6510 msgr2=0x7ff5300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5300b6510 0x7ff5300b8a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b6c0 tx=0x7ff53c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 msgr2=0x7ff54419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff54419a9b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005940 tx=0x7ff52c004040 comp rx=0 tx=0).stop 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 shutdown_connections 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff5300b6510 0x7ff5300b8a20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5441083a0 0x7ff54419a9b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff544108cf0 0x7ff54419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 --2- 172.21.15.17:0/378674751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff544102a60 0x7ff54419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 >> 172.21.15.17:0/378674751 conn(0x7ff544079730 msgr2=0x7ff544101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 shutdown_connections 2024-09-21T06:19:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:19:04.166+0000 7ff5498aa640 1 -- 172.21.15.17:0/378674751 wait complete. 2024-09-21T06:19:04.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:04 smithi017 ceph-mon[31080]: pgmap v563: 129 pgs: 129 active+clean; 338 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 799 KiB/s wr, 81 op/s 2024-09-21T06:19:04.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:04 smithi081 ceph-mon[33870]: pgmap v563: 129 pgs: 129 active+clean; 338 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 799 KiB/s wr, 81 op/s 2024-09-21T06:19:04.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:04 smithi089 ceph-mon[33879]: pgmap v563: 129 pgs: 129 active+clean; 338 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 799 KiB/s wr, 81 op/s 2024-09-21T06:19:05.937 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a26096be', total seconds elapsed: 24.0 2024-09-21T06:19:06.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:06 smithi081 ceph-mon[33870]: pgmap v564: 129 pgs: 129 active+clean; 339 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 874 KiB/s wr, 73 op/s 2024-09-21T06:19:06.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:06 smithi089 ceph-mon[33879]: pgmap v564: 129 pgs: 129 active+clean; 339 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 874 KiB/s wr, 73 op/s 2024-09-21T06:19:06.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:06 smithi017 ceph-mon[31080]: pgmap v564: 129 pgs: 129 active+clean; 339 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 874 KiB/s wr, 73 op/s 2024-09-21T06:19:08.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:08 smithi017 ceph-mon[31080]: pgmap v565: 129 pgs: 129 active+clean; 341 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 767 KiB/s wr, 64 op/s 2024-09-21T06:19:08.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:08 smithi081 ceph-mon[33870]: pgmap v565: 129 pgs: 129 active+clean; 341 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 767 KiB/s wr, 64 op/s 2024-09-21T06:19:08.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:08 smithi089 ceph-mon[33879]: pgmap v565: 129 pgs: 129 active+clean; 341 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 767 KiB/s wr, 64 op/s 2024-09-21T06:19:10.469 INFO:tasks.workunit.client.0.smithi017.stdout: 57 6509 29 4227 82 2263 100 2024-09-21T06:19:10.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:10 smithi081 ceph-mon[33870]: pgmap v566: 129 pgs: 129 active+clean; 342 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 700 KiB/s wr, 76 op/s 2024-09-21T06:19:10.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:10 smithi089 ceph-mon[33879]: pgmap v566: 129 pgs: 129 active+clean; 342 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 700 KiB/s wr, 76 op/s 2024-09-21T06:19:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:10 smithi017 ceph-mon[31080]: pgmap v566: 129 pgs: 129 active+clean; 342 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 700 KiB/s wr, 76 op/s 2024-09-21T06:19:12.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:12 smithi081 ceph-mon[33870]: pgmap v567: 129 pgs: 129 active+clean; 348 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-09-21T06:19:12.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:12 smithi089 ceph-mon[33879]: pgmap v567: 129 pgs: 129 active+clean; 348 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-09-21T06:19:12.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:12 smithi017 ceph-mon[31080]: pgmap v567: 129 pgs: 129 active+clean; 348 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 1.2 MiB/s wr, 126 op/s 2024-09-21T06:19:14.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:14 smithi081 ceph-mon[33870]: pgmap v568: 129 pgs: 129 active+clean; 351 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-21T06:19:14.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:14 smithi089 ceph-mon[33879]: pgmap v568: 129 pgs: 129 active+clean; 351 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-21T06:19:14.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:14 smithi017 ceph-mon[31080]: pgmap v568: 129 pgs: 129 active+clean; 351 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-21T06:19:16.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:16 smithi081 ceph-mon[33870]: pgmap v569: 129 pgs: 129 active+clean; 355 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-21T06:19:16.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:16 smithi089 ceph-mon[33879]: pgmap v569: 129 pgs: 129 active+clean; 355 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-21T06:19:16.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:16 smithi017 ceph-mon[31080]: pgmap v569: 129 pgs: 129 active+clean; 355 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.5 MiB/s wr, 222 op/s 2024-09-21T06:19:18.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:18 smithi081 ceph-mon[33870]: pgmap v570: 129 pgs: 129 active+clean; 359 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 262 op/s 2024-09-21T06:19:18.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:18 smithi089 ceph-mon[33879]: pgmap v570: 129 pgs: 129 active+clean; 359 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 262 op/s 2024-09-21T06:19:18.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:18 smithi017 ceph-mon[31080]: pgmap v570: 129 pgs: 129 active+clean; 359 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 262 op/s 2024-09-21T06:19:20.469 INFO:tasks.workunit.client.0.smithi017.stdout: 60 9638 118 6773 89 3900 148 2024-09-21T06:19:20.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:20 smithi081 ceph-mon[33870]: pgmap v571: 129 pgs: 129 active+clean; 362 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 273 op/s 2024-09-21T06:19:20.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:20 smithi089 ceph-mon[33879]: pgmap v571: 129 pgs: 129 active+clean; 362 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 273 op/s 2024-09-21T06:19:20.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:20 smithi017 ceph-mon[31080]: pgmap v571: 129 pgs: 129 active+clean; 362 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 273 op/s 2024-09-21T06:19:22.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:22 smithi081 ceph-mon[33870]: pgmap v572: 129 pgs: 129 active+clean; 366 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 273 op/s 2024-09-21T06:19:22.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:22 smithi089 ceph-mon[33879]: pgmap v572: 129 pgs: 129 active+clean; 366 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 273 op/s 2024-09-21T06:19:22.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:22 smithi017 ceph-mon[31080]: pgmap v572: 129 pgs: 129 active+clean; 366 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 273 op/s 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: pgmap v573: 129 pgs: 129 active+clean; 368 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: Unable to set osd_memory_target on smithi089 to 184518656: error parsing value: Value '184518656' is below minimum 939524096 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:24.759 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:19:24.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: pgmap v573: 129 pgs: 129 active+clean; 368 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: Unable to set osd_memory_target on smithi089 to 184518656: error parsing value: Value '184518656' is below minimum 939524096 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:24.868 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:19:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: pgmap v573: 129 pgs: 129 active+clean; 368 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi089 to 175.9M 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: Unable to set osd_memory_target on smithi081 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: Unable to set osd_memory_target on smithi089 to 184518656: error parsing value: Value '184518656' is below minimum 939524096 2024-09-21T06:19:24.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:19:24.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:24.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:24.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:19:25.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:25 smithi081 ceph-mon[33870]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-21T06:19:25.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:25 smithi081 ceph-mon[33870]: Unable to set osd_memory_target on smithi017 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-21T06:19:25.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:25 smithi089 ceph-mon[33879]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-21T06:19:25.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:25 smithi089 ceph-mon[33879]: Unable to set osd_memory_target on smithi017 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-21T06:19:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:25 smithi017 ceph-mon[31080]: Adjusting osd_memory_target on smithi017 to 177.0M 2024-09-21T06:19:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:25 smithi017 ceph-mon[31080]: Unable to set osd_memory_target on smithi017 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-21T06:19:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:26 smithi081 ceph-mon[33870]: pgmap v574: 129 pgs: 129 active+clean; 365 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-21T06:19:26.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:26 smithi089 ceph-mon[33879]: pgmap v574: 129 pgs: 129 active+clean; 365 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-21T06:19:26.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:26 smithi017 ceph-mon[31080]: pgmap v574: 129 pgs: 129 active+clean; 365 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-21T06:19:28.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:28 smithi081 ceph-mon[33870]: pgmap v575: 129 pgs: 129 active+clean; 363 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-09-21T06:19:28.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:28 smithi089 ceph-mon[33879]: pgmap v575: 129 pgs: 129 active+clean; 363 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-09-21T06:19:28.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:28 smithi017 ceph-mon[31080]: pgmap v575: 129 pgs: 129 active+clean; 363 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-09-21T06:19:30.469 INFO:tasks.workunit.client.0.smithi017.stdout: 60 10055 144 6837 61 3599 133 2024-09-21T06:19:30.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:30 smithi081 ceph-mon[33870]: pgmap v576: 129 pgs: 129 active+clean; 368 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-09-21T06:19:30.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:30 smithi089 ceph-mon[33879]: pgmap v576: 129 pgs: 129 active+clean; 368 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-09-21T06:19:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:30 smithi017 ceph-mon[31080]: pgmap v576: 129 pgs: 129 active+clean; 368 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-09-21T06:19:32.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:32 smithi081 ceph-mon[33870]: pgmap v577: 129 pgs: 129 active+clean; 369 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 188 op/s 2024-09-21T06:19:32.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:32 smithi089 ceph-mon[33879]: pgmap v577: 129 pgs: 129 active+clean; 369 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 188 op/s 2024-09-21T06:19:32.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:32 smithi017 ceph-mon[31080]: pgmap v577: 129 pgs: 129 active+clean; 369 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 188 op/s 2024-09-21T06:19:34.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:34 smithi081 ceph-mon[33870]: pgmap v578: 129 pgs: 129 active+clean; 369 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-09-21T06:19:34.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:34 smithi089 ceph-mon[33879]: pgmap v578: 129 pgs: 129 active+clean; 369 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-09-21T06:19:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:34 smithi017 ceph-mon[31080]: pgmap v578: 129 pgs: 129 active+clean; 369 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-09-21T06:19:36.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:36 smithi081 ceph-mon[33870]: pgmap v579: 129 pgs: 129 active+clean; 377 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-09-21T06:19:36.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:36 smithi089 ceph-mon[33879]: pgmap v579: 129 pgs: 129 active+clean; 377 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-09-21T06:19:36.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:36 smithi017 ceph-mon[31080]: pgmap v579: 129 pgs: 129 active+clean; 377 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-09-21T06:19:38.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:38 smithi081 ceph-mon[33870]: pgmap v580: 129 pgs: 129 active+clean; 382 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 236 op/s 2024-09-21T06:19:38.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:38 smithi089 ceph-mon[33879]: pgmap v580: 129 pgs: 129 active+clean; 382 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 236 op/s 2024-09-21T06:19:38.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:38 smithi017 ceph-mon[31080]: pgmap v580: 129 pgs: 129 active+clean; 382 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 236 op/s 2024-09-21T06:19:40.469 INFO:tasks.workunit.client.0.smithi017.stdout: 62 10591 92 6700 92 3409 145 2024-09-21T06:19:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:40 smithi081 ceph-mon[33870]: pgmap v581: 129 pgs: 129 active+clean; 385 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 257 op/s 2024-09-21T06:19:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:40 smithi089 ceph-mon[33879]: pgmap v581: 129 pgs: 129 active+clean; 385 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 257 op/s 2024-09-21T06:19:40.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:40 smithi017 ceph-mon[31080]: pgmap v581: 129 pgs: 129 active+clean; 385 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 257 op/s 2024-09-21T06:19:42.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:42 smithi081 ceph-mon[33870]: pgmap v582: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 218 op/s 2024-09-21T06:19:42.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:42 smithi089 ceph-mon[33879]: pgmap v582: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 218 op/s 2024-09-21T06:19:42.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:42 smithi017 ceph-mon[31080]: pgmap v582: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 218 op/s 2024-09-21T06:19:44.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:44 smithi081 ceph-mon[33870]: pgmap v583: 129 pgs: 129 active+clean; 392 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 265 op/s 2024-09-21T06:19:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:44 smithi089 ceph-mon[33879]: pgmap v583: 129 pgs: 129 active+clean; 392 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 265 op/s 2024-09-21T06:19:44.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:44 smithi017 ceph-mon[31080]: pgmap v583: 129 pgs: 129 active+clean; 392 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 265 op/s 2024-09-21T06:19:46.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:46 smithi081 ceph-mon[33870]: pgmap v584: 129 pgs: 129 active+clean; 390 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 280 op/s 2024-09-21T06:19:46.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:46 smithi089 ceph-mon[33879]: pgmap v584: 129 pgs: 129 active+clean; 390 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 280 op/s 2024-09-21T06:19:46.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:46 smithi017 ceph-mon[31080]: pgmap v584: 129 pgs: 129 active+clean; 390 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 280 op/s 2024-09-21T06:19:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:48 smithi081 ceph-mon[33870]: pgmap v585: 129 pgs: 129 active+clean; 385 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-09-21T06:19:48.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:48 smithi089 ceph-mon[33879]: pgmap v585: 129 pgs: 129 active+clean; 385 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-09-21T06:19:48.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:48 smithi017 ceph-mon[31080]: pgmap v585: 129 pgs: 129 active+clean; 385 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-09-21T06:19:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:50 smithi081 ceph-mon[33870]: pgmap v586: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-21T06:19:50.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:50 smithi089 ceph-mon[33879]: pgmap v586: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-21T06:19:50.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:50 smithi017 ceph-mon[31080]: pgmap v586: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-21T06:19:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:52 smithi081 ceph-mon[33870]: pgmap v587: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2024-09-21T06:19:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:52 smithi089 ceph-mon[33879]: pgmap v587: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2024-09-21T06:19:52.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:52 smithi017 ceph-mon[31080]: pgmap v587: 129 pgs: 129 active+clean; 386 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2024-09-21T06:19:54.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:54 smithi081 ceph-mon[33870]: pgmap v588: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-09-21T06:19:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:54 smithi089 ceph-mon[33879]: pgmap v588: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-09-21T06:19:54.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:54 smithi017 ceph-mon[31080]: pgmap v588: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-09-21T06:19:56.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:56 smithi081 ceph-mon[33870]: pgmap v589: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 726 KiB/s wr, 133 op/s 2024-09-21T06:19:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:56 smithi089 ceph-mon[33879]: pgmap v589: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 726 KiB/s wr, 133 op/s 2024-09-21T06:19:56.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:56 smithi017 ceph-mon[31080]: pgmap v589: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 726 KiB/s wr, 133 op/s 2024-09-21T06:19:58.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:19:58 smithi081 ceph-mon[33870]: pgmap v590: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 509 KiB/s wr, 107 op/s 2024-09-21T06:19:58.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:19:58 smithi089 ceph-mon[33879]: pgmap v590: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 509 KiB/s wr, 107 op/s 2024-09-21T06:19:58.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:19:58 smithi017 ceph-mon[31080]: pgmap v590: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 509 KiB/s wr, 107 op/s 2024-09-21T06:20:00.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:00 smithi081 ceph-mon[33870]: pgmap v591: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 178 KiB/s wr, 45 op/s 2024-09-21T06:20:00.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:00 smithi081 ceph-mon[33870]: overall HEALTH_OK 2024-09-21T06:20:00.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:00 smithi089 ceph-mon[33879]: pgmap v591: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 178 KiB/s wr, 45 op/s 2024-09-21T06:20:00.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:00 smithi089 ceph-mon[33879]: overall HEALTH_OK 2024-09-21T06:20:00.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:00 smithi017 ceph-mon[31080]: pgmap v591: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 178 KiB/s wr, 45 op/s 2024-09-21T06:20:00.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:00 smithi017 ceph-mon[31080]: overall HEALTH_OK 2024-09-21T06:20:03.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:02 smithi089 ceph-mon[33879]: pgmap v592: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-21T06:20:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:02 smithi017 ceph-mon[31080]: pgmap v592: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-21T06:20:03.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:02 smithi081 ceph-mon[33870]: pgmap v592: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 25 op/s 2024-09-21T06:20:05.060 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:04 smithi081 ceph-mon[33870]: pgmap v593: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 48 KiB/s wr, 21 op/s 2024-09-21T06:20:05.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:04 smithi089 ceph-mon[33879]: pgmap v593: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 48 KiB/s wr, 21 op/s 2024-09-21T06:20:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:04 smithi017 ceph-mon[31080]: pgmap v593: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 48 KiB/s wr, 21 op/s 2024-09-21T06:20:07.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:06 smithi089 ceph-mon[33879]: pgmap v594: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-21T06:20:07.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:06 smithi017 ceph-mon[31080]: pgmap v594: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-21T06:20:07.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:06 smithi081 ceph-mon[33870]: pgmap v594: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-21T06:20:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:08 smithi089 ceph-mon[33879]: pgmap v595: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-21T06:20:09.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:08 smithi017 ceph-mon[31080]: pgmap v595: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-21T06:20:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:08 smithi081 ceph-mon[33870]: pgmap v595: 129 pgs: 129 active+clean; 387 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-21T06:20:10.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:10 smithi017 ceph-mon[31080]: pgmap v596: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:20:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:10 smithi089 ceph-mon[33879]: pgmap v596: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:20:11.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:10 smithi081 ceph-mon[33870]: pgmap v596: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:20:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:12 smithi089 ceph-mon[33879]: pgmap v597: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-09-21T06:20:13.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:12 smithi017 ceph-mon[31080]: pgmap v597: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-09-21T06:20:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:12 smithi081 ceph-mon[33870]: pgmap v597: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-09-21T06:20:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:14 smithi089 ceph-mon[33879]: pgmap v598: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-09-21T06:20:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:14 smithi017 ceph-mon[31080]: pgmap v598: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-09-21T06:20:15.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:14 smithi081 ceph-mon[33870]: pgmap v598: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 KiB/s wr, 15 op/s 2024-09-21T06:20:17.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:16 smithi089 ceph-mon[33879]: pgmap v599: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:20:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:16 smithi017 ceph-mon[31080]: pgmap v599: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:20:17.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:16 smithi081 ceph-mon[33870]: pgmap v599: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:20:17.438 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T06:20:17.438 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T06:20:17.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:20:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:18.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.420+0000 7f23e577f640 1 -- 172.21.15.17:0/549155641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 msgr2=0x7f23e0110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 --2- 172.21.15.17:0/549155641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0110670 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009ca0 tx=0x7f23d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 -- 172.21.15.17:0/549155641 shutdown_connections 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 --2- 172.21.15.17:0/549155641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0110670 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 --2- 172.21.15.17:0/549155641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e01094f0 0x7f23e0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 --2- 172.21.15.17:0/549155641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e0103bb0 0x7f23e0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 -- 172.21.15.17:0/549155641 >> 172.21.15.17:0/549155641 conn(0x7f23e00ff600 msgr2=0x7f23e0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 -- 172.21.15.17:0/549155641 shutdown_connections 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 -- 172.21.15.17:0/549155641 wait complete. 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.421+0000 7f23e577f640 1 Processor -- start 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 -- start start 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e0103bb0 0x7f23e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e01094f0 0x7f23e0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0113a00 con 0x7f23e0109e40 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0113880 con 0x7f23e0103bb0 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23e577f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0113b80 con 0x7f23e01094f0 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51988/0 (socket says 172.21.15.17:51988) 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 -- 172.21.15.17:0/3691406638 learned_addr learned my addr 172.21.15.17:0/3691406638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23deffd640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e0103bb0 0x7f23e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23d67fc640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e01094f0 0x7f23e0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 -- 172.21.15.17:0/3691406638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e01094f0 msgr2=0x7f23e0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e01094f0 0x7f23e0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 -- 172.21.15.17:0/3691406638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e0103bb0 msgr2=0x7f23e0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e0103bb0 0x7f23e0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.422+0000 7f23df7fe640 1 -- 172.21.15.17:0/3691406638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e01a8670 con 0x7f23e0109e40 2024-09-21T06:20:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.423+0000 7f23df7fe640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0076190 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f23d8005cc0 tx=0x7f23d8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.423+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8032e00 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.423+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23d80044d0 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.423+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8030b70 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.423+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01a8900 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.423+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e01a8e40 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.424+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e0103fc0 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.426+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f23d8030d10 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.427+0000 7f23dcff9640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23cc0b6510 0x7f23cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.427+0000 7f23deffd640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23cc0b6510 0x7f23cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.427+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f23d8108b30 con 0x7f23e0109e40 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.427+0000 7f23deffd640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23cc0b6510 0x7f23cc0b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f23e0077160 tx=0x7f23d000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.430+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23d80cefd0 con 0x7f23e0109e40 2024-09-21T06:20:18.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.658+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23e002e640 con 0x7f23e0109e40 2024-09-21T06:20:18.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.659+0000 7f23dcff9640 1 -- 172.21.15.17:0/3691406638 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7f23d80d33b0 con 0x7f23e0109e40 2024-09-21T06:20:18.660 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:20:18.661 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:20:18.661 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:20:18.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23cc0b6510 msgr2=0x7f23cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23cc0b6510 0x7f23cc0b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f23e0077160 tx=0x7f23d000b390 comp rx=0 tx=0).stop 2024-09-21T06:20:18.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 msgr2=0x7f23e0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0076190 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f23d8005cc0 tx=0x7f23d8032a10 comp rx=0 tx=0).stop 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 shutdown_connections 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f23cc0b6510 0x7f23cc0b8a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23e0109e40 0x7f23e0076190 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e01094f0 0x7f23e0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 --2- 172.21.15.17:0/3691406638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e0103bb0 0x7f23e0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 >> 172.21.15.17:0/3691406638 conn(0x7f23e00ff600 msgr2=0x7f23e0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 shutdown_connections 2024-09-21T06:20:18.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:18.661+0000 7f23e577f640 1 -- 172.21.15.17:0/3691406638 wait complete. 2024-09-21T06:20:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:18 smithi089 ceph-mon[33879]: pgmap v600: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-21T06:20:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:18 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3691406638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:18 smithi017 ceph-mon[31080]: pgmap v600: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-21T06:20:19.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:18 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3691406638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:18 smithi081 ceph-mon[33870]: pgmap v600: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-21T06:20:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:18 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3691406638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:19.438 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T06:20:19.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T06:20:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 -- 172.21.15.17:0/347932336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10103b70 msgr2=0x7f4a10103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/347932336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10103b70 0x7f4a10103f80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009900 tx=0x7f4a0002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 -- 172.21.15.17:0/347932336 shutdown_connections 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/347932336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10109e00 0x7f4a10110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/347932336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a101094b0 0x7f4a101098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/347932336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10103b70 0x7f4a10103f80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 -- 172.21.15.17:0/347932336 >> 172.21.15.17:0/347932336 conn(0x7f4a100ff5a0 msgr2=0x7f4a101019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 -- 172.21.15.17:0/347932336 shutdown_connections 2024-09-21T06:20:20.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 -- 172.21.15.17:0/347932336 wait complete. 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.200+0000 7f4a15e8d640 1 Processor -- start 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 -- start start 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10103b70 0x7f4a10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a101094b0 0x7f4a10075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 0x7f4a10076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a10113970 con 0x7f4a10109e00 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101137f0 con 0x7f4a10103b70 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a15e8d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a10113af0 con 0x7f4a101094b0 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 0x7f4a10076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 0x7f4a10076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60200/0 (socket says 172.21.15.17:60200) 2024-09-21T06:20:20.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a0ffff640 1 -- 172.21.15.17:0/2195762028 learned_addr learned my addr 172.21.15.17:0/2195762028 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10103b70 0x7f4a10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.201+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a101094b0 0x7f4a10075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0ffff640 1 -- 172.21.15.17:0/2195762028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a101094b0 msgr2=0x7f4a10075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0ffff640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a101094b0 0x7f4a10075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0ffff640 1 -- 172.21.15.17:0/2195762028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10103b70 msgr2=0x7f4a10075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0ffff640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10103b70 0x7f4a10075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0ffff640 1 -- 172.21.15.17:0/2195762028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a101a8610 con 0x7f4a10109e00 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0ffff640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 0x7f4a10076190 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800eaa0 tx=0x7f4a0800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0cff9640 1 -- 172.21.15.17:0/2195762028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08004d20 con 0x7f4a10109e00 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0cff9640 1 -- 172.21.15.17:0/2195762028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a08005020 con 0x7f4a10109e00 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a101a8900 con 0x7f4a10109e00 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a0cff9640 1 -- 172.21.15.17:0/2195762028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a080116d0 con 0x7f4a10109e00 2024-09-21T06:20:20.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.202+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a101a8e40 con 0x7f4a10109e00 2024-09-21T06:20:20.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.205+0000 7f4a1c401740 1 Processor -- start 2024-09-21T06:20:20.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.205+0000 7f4a0cff9640 1 -- 172.21.15.17:0/2195762028 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4a08011870 con 0x7f4a10109e00 2024-09-21T06:20:20.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.205+0000 7f4a1c401740 1 -- start start 2024-09-21T06:20:20.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a14f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a1c401740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fc7a0c5bb0 con 0x55fc79d87b70 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a1c401740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc7a0b4fe0 con 0x55fc79d7f990 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a1c401740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fc7a0b8df0 con 0x55fc79da8850 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a14f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a14f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60214/0 (socket says 172.21.15.17:60214) 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0effd640 1 -- 172.21.15.17:0/1501507733 learned_addr learned my addr 172.21.15.17:0/1501507733 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0effd640 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0cff9640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49f80b6590 0x7f49f80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/1501507733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 msgr2=0x55fc7a14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/1501507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 msgr2=0x55fc7a14f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a14f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/1501507733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc79e22ba0 con 0x55fc79d7f990 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0effd640 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.206+0000 7f4a0ffff640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49f80b6590 0x7f49f80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.207+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a14f3b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a00005940 tx=0x7f4a00031de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8a4d628f96d73b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.207+0000 7f4a0cff9640 1 -- 172.21.15.17:0/2195762028 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f4a080e76f0 con 0x7f4a10109e00 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.207+0000 7f49f5ffb640 1 -- 172.21.15.17:0/1501507733 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00035030 con 0x55fc79d7f990 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.207+0000 7f49f5ffb640 1 -- 172.21.15.17:0/1501507733 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a00040070 con 0x55fc79d7f990 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.207+0000 7f4a0ffff640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49f80b6590 0x7f49f80b8aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4a080a4dc0 tx=0x7f4a0807a820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.207+0000 7f49f5ffb640 1 -- 172.21.15.17:0/1501507733 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a000038e0 con 0x55fc79d7f990 2024-09-21T06:20:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 -- 172.21.15.17:0/1501507733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 msgr2=0x55fc7a14f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a14f3b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a00005940 tx=0x7f4a00031de0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 -- 172.21.15.17:0/1501507733 shutdown_connections 2024-09-21T06:20:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a14f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a14f3b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 --2- 172.21.15.17:0/1501507733 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 -- 172.21.15.17:0/1501507733 >> 172.21.15.17:0/1501507733 conn(0x55fc79d9cc40 msgr2=0x55fc7a14cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 -- 172.21.15.17:0/1501507733 shutdown_connections 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 -- 172.21.15.17:0/1501507733 wait complete. 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.208+0000 7f4a1c401740 1 -- start start 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 Processor -- start 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 0x55fc7a15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d87b70 0x55fc7a15b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a1668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fc79f167b0 con 0x55fc79d7f990 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fc7a04fe90 con 0x55fc79d87b70 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55fc7a15d5f0 con 0x55fc79da8850 2024-09-21T06:20:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a1c401740 10 client.0 _ll_register_callbacks cb 0x55fc7a0b2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 0x55fc7a15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 0x55fc7a15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60224/0 (socket says 172.21.15.17:60224) 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d87b70 0x55fc7a15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 -- 172.21.15.17:0/2276634146 learned_addr learned my addr 172.21.15.17:0/2276634146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a1668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 -- 172.21.15.17:0/2276634146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 msgr2=0x55fc7a1668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a1668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 -- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d87b70 msgr2=0x55fc7a15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d87b70 0x55fc7a15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.209+0000 7f4a0effd640 1 -- 172.21.15.17:0/2276634146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7a166f20 con 0x55fc79d7f990 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d87b70 0x55fc7a15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 0x55fc7a15aa90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4a04011f70 tx=0x7f4a04013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b852fbd1bedc0af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f49eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f49eeffd640 1 -- 172.21.15.17:0/2276634146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04005220 con 0x55fc79d7f990 2024-09-21T06:20:20.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f49eeffd640 1 -- 172.21.15.17:0/2276634146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f4a040053c0 con 0x55fc79d7f990 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a00040070 con 0x55fc79d7f990 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f49eeffd640 1 -- 172.21.15.17:0/2276634146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4a04029050 con 0x55fc79d7f990 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f4a1c401740 10 client.15846 fetch_fsmap learned FSMap version 31 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fc7a169850 con 0x55fc79d7f990 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.210+0000 7f49eeffd640 1 -- 172.21.15.17:0/2276634146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a00040070 con 0x55fc79d7f990 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f49eeffd640 1 -- 172.21.15.17:0/2276634146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f4a0400e750 con 0x55fc79d7f990 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a1c401740 10 client.15846 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a1c401740 10 client.15846 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a1c401740 20 client.15846 populate_metadata read hostname 'smithi017' 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d671d0 0x55fc7a16cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a1c401740 4 client.15846 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc7a0c7b00 con 0x55fc79d671d0 2024-09-21T06:20:20.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d671d0 0x55fc7a16cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d671d0 0x55fc7a16cde0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e095d35399f790 server_cookie=2c7275f66b73eda5 in_seq=0 out_seq=0 2024-09-21T06:20:20.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.211+0000 7f49eeffd640 10 client.15846 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.212+0000 7f49eeffd640 1 -- 172.21.15.17:0/2276634146 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc7a0c7b00 con 0x55fc79d671d0 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.212+0000 7f49eeffd640 10 client.15846 handle_command_reply: tid=0 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.212+0000 7f4a1c401740 1 client.15846 shutdown 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 msgr2=0x55fc7a15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 0x55fc7a15aa90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4a04011f70 tx=0x7f4a04013040 comp rx=0 tx=0).stop 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 shutdown_connections 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d671d0 0x55fc7a16cde0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a1668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d87b70 0x55fc7a15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2276634146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d7f990 0x55fc7a15aa90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f49eeffd640 0 client.15846 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:20.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 >> 172.21.15.17:0/2276634146 conn(0x55fc79d9cc40 msgr2=0x55fc7a152000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 shutdown_connections 2024-09-21T06:20:20.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 1 -- 172.21.15.17:0/2276634146 wait complete. 2024-09-21T06:20:20.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.213+0000 7f4a1c401740 20 client.15846 trim_cache size 0 max 16384 2024-09-21T06:20:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.230+0000 7f4a1c401740 1 Processor -- start 2024-09-21T06:20:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.230+0000 7f4a1c401740 1 -- start start 2024-09-21T06:20:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79d7f990 0x55fc7a152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a1667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79da8850 0x55fc7a153f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a1c401740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101b5490 con 0x55fc79d87b70 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a1c401740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101b2d00 con 0x55fc79da8850 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a1c401740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101b0b50 con 0x55fc79d7f990 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a1667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a1667e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60230/0 (socket says 172.21.15.17:60230) 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/2307394922 learned_addr learned my addr 172.21.15.17:0/2307394922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79da8850 0x55fc7a153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79d7f990 0x55fc7a152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/2307394922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79d7f990 msgr2=0x55fc7a152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79d7f990 0x55fc7a152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/2307394922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79da8850 msgr2=0x55fc7a153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79da8850 0x55fc7a153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/2307394922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7a156120 con 0x55fc79d87b70 2024-09-21T06:20:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0effd640 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79da8850 0x55fc7a153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a1667e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4a00031bd0 tx=0x7f4a00031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47671e6be8615f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.231+0000 7f49f57fa640 1 -- 172.21.15.17:0/2307394922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00035070 con 0x55fc79d87b70 2024-09-21T06:20:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f49f57fa640 1 -- 172.21.15.17:0/2307394922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a00040050 con 0x55fc79d87b70 2024-09-21T06:20:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f49f57fa640 1 -- 172.21.15.17:0/2307394922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00003ce0 con 0x55fc79d87b70 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 -- 172.21.15.17:0/2307394922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 msgr2=0x55fc7a1667e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a1667e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4a00031bd0 tx=0x7f4a00031d40 comp rx=0 tx=0).stop 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 -- 172.21.15.17:0/2307394922 shutdown_connections 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a1667e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79da8850 0x55fc7a153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 --2- 172.21.15.17:0/2307394922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79d7f990 0x55fc7a152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 -- 172.21.15.17:0/2307394922 >> 172.21.15.17:0/2307394922 conn(0x55fc79d9cc40 msgr2=0x55fc7a151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 -- 172.21.15.17:0/2307394922 shutdown_connections 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.232+0000 7f4a1c401740 1 -- 172.21.15.17:0/2307394922 wait complete. 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 -- start start 2024-09-21T06:20:20.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 Processor -- start 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101b11c0 con 0x55fc79d87b70 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101b2630 con 0x55fc79d7f990 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a101b1890 con 0x55fc79da8850 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.233+0000 7f4a1c401740 10 client.0 _ll_register_callbacks cb 0x7f4a0400ad10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a15e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60244/0 (socket says 172.21.15.17:60244) 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/4059858754 learned_addr learned my addr 172.21.15.17:0/4059858754 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0effd640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0effd640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/4059858754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 msgr2=0x55fc7a15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a15ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 msgr2=0x55fc7a162fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a162fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 -- 172.21.15.17:0/4059858754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc7a15f650 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0effd640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a0f7fe640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a15e9d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4a00006010 tx=0x7f4a00005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6afd371a809f212 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f49eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f49eeffd640 1 -- 172.21.15.17:0/4059858754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0005d060 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f49eeffd640 1 -- 172.21.15.17:0/4059858754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f4a000057f0 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.234+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a00040050 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f49eeffd640 1 -- 172.21.15.17:0/4059858754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4a00064050 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 10 client.15852 fetch_fsmap learned FSMap version 31 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fc7a1d8670 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f49eeffd640 1 -- 172.21.15.17:0/4059858754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a00040050 con 0x55fc79d87b70 2024-09-21T06:20:20.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f49eeffd640 1 -- 172.21.15.17:0/4059858754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f4a0004d610 con 0x55fc79d87b70 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 10 client.15852 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 10 client.15852 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 20 client.15852 populate_metadata read hostname 'smithi017' 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d3c580 0x55fc7a1da970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 4 client.15852 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x55fc7a0c35b0 con 0x55fc79d3c580 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.235+0000 7f4a0effd640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d3c580 0x55fc7a1da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.236+0000 7f4a0effd640 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d3c580 0x55fc7a1da970 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2a90133007a25c8 server_cookie=99ca68ea8834bc94 in_seq=0 out_seq=0 2024-09-21T06:20:20.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:20.236+0000 7f49eeffd640 10 client.15852 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:21.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:20 smithi089 ceph-mon[33879]: pgmap v601: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-21T06:20:21.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:20 smithi017 ceph-mon[31080]: pgmap v601: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-21T06:20:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:20 smithi081 ceph-mon[33870]: pgmap v601: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-21T06:20:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.124+0000 7f49eeffd640 1 -- 172.21.15.17:0/4059858754 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fc7a0c35b0 con 0x55fc79d3c580 2024-09-21T06:20:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.124+0000 7f49eeffd640 10 client.15852 handle_command_reply: tid=0 2024-09-21T06:20:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.124+0000 7f4a1c401740 1 client.15852 shutdown 2024-09-21T06:20:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 msgr2=0x55fc7a15e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a15e9d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4a00006010 tx=0x7f4a00005e80 comp rx=0 tx=0).stop 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 shutdown_connections 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55fc79d3c580 0x55fc7a1da970 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc79d87b70 0x55fc7a15e9d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fc79da8850 0x55fc7a15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 --2- 172.21.15.17:0/4059858754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc79d7f990 0x55fc7a162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f49eeffd640 0 client.15852 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 >> 172.21.15.17:0/4059858754 conn(0x55fc79d9cc40 msgr2=0x55fc7a151cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 shutdown_connections 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 1 -- 172.21.15.17:0/4059858754 wait complete. 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a1c401740 20 client.15852 trim_cache size 0 max 16384 2024-09-21T06:20:22.128 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 30, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "41a7269d": { 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 30, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 141.1, 2024-09-21T06:20:22.129 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:22.130 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49f80b6590 msgr2=0x7f49f80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49f80b6590 0x7f49f80b8aa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4a080a4dc0 tx=0x7f4a0807a820 comp rx=0 tx=0).stop 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 msgr2=0x7f4a10076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.125+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 0x7f4a10076190 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800eaa0 tx=0x7f4a0800eea0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 shutdown_connections 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f49f80b6590 0x7f49f80b8aa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a10109e00 0x7f4a10076190 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a101094b0 0x7f4a10075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 --2- 172.21.15.17:0/2195762028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a10103b70 0x7f4a10075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 >> 172.21.15.17:0/2195762028 conn(0x7f4a100ff5a0 msgr2=0x7f4a101019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 shutdown_connections 2024-09-21T06:20:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:22.126+0000 7f4a15e8d640 1 -- 172.21.15.17:0/2195762028 wait complete. 2024-09-21T06:20:22.900 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '41a7269d', quiesce took 5.5 seconds. Will release after: 15.55 2024-09-21T06:20:23.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:22 smithi089 ceph-mon[33879]: pgmap v602: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-21T06:20:23.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:22 smithi017 ceph-mon[31080]: pgmap v602: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-21T06:20:23.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:22 smithi081 ceph-mon[33870]: pgmap v602: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-21T06:20:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:24 smithi089 ceph-mon[33879]: pgmap v603: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 KiB/s wr, 25 op/s 2024-09-21T06:20:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:24 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:20:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:24 smithi017 ceph-mon[31080]: pgmap v603: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 KiB/s wr, 25 op/s 2024-09-21T06:20:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:24 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:20:25.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:24 smithi081 ceph-mon[33870]: pgmap v603: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 KiB/s wr, 25 op/s 2024-09-21T06:20:25.277 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:25.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:25.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:25.278 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:24 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:20:27.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:26 smithi089 ceph-mon[33879]: pgmap v604: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-21T06:20:27.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:26 smithi017 ceph-mon[31080]: pgmap v604: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-21T06:20:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:26 smithi081 ceph-mon[33870]: pgmap v604: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-09-21T06:20:29.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:28 smithi089 ceph-mon[33879]: pgmap v605: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 24 op/s 2024-09-21T06:20:29.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:28 smithi017 ceph-mon[31080]: pgmap v605: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 24 op/s 2024-09-21T06:20:29.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:28 smithi081 ceph-mon[33870]: pgmap v605: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 24 op/s 2024-09-21T06:20:31.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:30 smithi089 ceph-mon[33879]: pgmap v606: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 KiB/s wr, 22 op/s 2024-09-21T06:20:31.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:30 smithi017 ceph-mon[31080]: pgmap v606: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 KiB/s wr, 22 op/s 2024-09-21T06:20:31.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:30 smithi081 ceph-mon[33870]: pgmap v606: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 KiB/s wr, 22 op/s 2024-09-21T06:20:33.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:32 smithi089 ceph-mon[33879]: pgmap v607: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-09-21T06:20:33.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:32 smithi017 ceph-mon[31080]: pgmap v607: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-09-21T06:20:33.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:32 smithi081 ceph-mon[33870]: pgmap v607: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-09-21T06:20:35.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:34 smithi089 ceph-mon[33879]: pgmap v608: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-09-21T06:20:35.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:34 smithi017 ceph-mon[31080]: pgmap v608: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-09-21T06:20:35.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:34 smithi081 ceph-mon[33870]: pgmap v608: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 22 op/s 2024-09-21T06:20:37.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:36 smithi089 ceph-mon[33879]: pgmap v609: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-21T06:20:37.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:36 smithi017 ceph-mon[31080]: pgmap v609: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-21T06:20:37.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:36 smithi081 ceph-mon[33870]: pgmap v609: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-21T06:20:38.451 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:20:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:39.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:38 smithi017 ceph-mon[31080]: pgmap v610: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 9 op/s 2024-09-21T06:20:39.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:38 smithi089 ceph-mon[33879]: pgmap v610: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 9 op/s 2024-09-21T06:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 -- 172.21.15.17:0/2864645241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac01094c0 msgr2=0x7ffac01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 --2- 172.21.15.17:0/2864645241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac01094c0 0x7ffac01098d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009900 tx=0x7ffab402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 -- 172.21.15.17:0/2864645241 shutdown_connections 2024-09-21T06:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 --2- 172.21.15.17:0/2864645241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac01094c0 0x7ffac01098d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 --2- 172.21.15.17:0/2864645241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffac0109e10 0x7ffac0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 --2- 172.21.15.17:0/2864645241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 0x7ffac0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 -- 172.21.15.17:0/2864645241 >> 172.21.15.17:0/2864645241 conn(0x7ffac00ff610 msgr2=0x7ffac0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 -- 172.21.15.17:0/2864645241 shutdown_connections 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.230+0000 7ffac595b640 1 -- 172.21.15.17:0/2864645241 wait complete. 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.231+0000 7ffac595b640 1 Processor -- start 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.231+0000 7ffac595b640 1 -- start start 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffac595b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 0x7ffac019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffac595b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffac01094c0 0x7ffac019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffac595b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 0x7ffac019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffac595b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffac01139d0 con 0x7ffac0109e10 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffac595b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0113850 con 0x7ffac0103b80 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffac595b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffac0113b50 con 0x7ffac01094c0 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 0x7ffac019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 0x7ffac019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34498/0 (socket says 172.21.15.17:34498) 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 -- 172.21.15.17:0/3793834114 learned_addr learned my addr 172.21.15.17:0/3793834114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabeffd640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 0x7ffac019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabe7fc640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffac01094c0 0x7ffac019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 -- 172.21.15.17:0/3793834114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffac01094c0 msgr2=0x7ffac019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffac01094c0 0x7ffac019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 -- 172.21.15.17:0/3793834114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 msgr2=0x7ffac019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 0x7ffac019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabf7fe640 1 -- 172.21.15.17:0/3793834114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac01a0350 con 0x7ffac0109e10 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.232+0000 7ffabeffd640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 0x7ffac019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.233+0000 7ffabf7fe640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 0x7ffac019fc20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffab800eb10 tx=0x7ffab800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:39.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.233+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8004b20 con 0x7ffac0109e10 2024-09-21T06:20:39.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.233+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac01a0640 con 0x7ffac0109e10 2024-09-21T06:20:39.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.233+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffab8004cc0 con 0x7ffac0109e10 2024-09-21T06:20:39.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.233+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8010690 con 0x7ffac0109e10 2024-09-21T06:20:39.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.233+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac01a6da0 con 0x7ffac0109e10 2024-09-21T06:20:39.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.234+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac0104e00 con 0x7ffac0109e10 2024-09-21T06:20:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.236+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ffab8005000 con 0x7ffac0109e10 2024-09-21T06:20:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.237+0000 7ffac4959640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffaa80b6510 0x7ffaa80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.237+0000 7ffabeffd640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffaa80b6510 0x7ffaa80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.237+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7ffab80e7d80 con 0x7ffac0109e10 2024-09-21T06:20:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.238+0000 7ffabeffd640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffaa80b6510 0x7ffaa80b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffab0005d00 tx=0x7ffab000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:39.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.242+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffab8056710 con 0x7ffac0109e10 2024-09-21T06:20:39.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:38 smithi081 ceph-mon[33870]: pgmap v610: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 9 op/s 2024-09-21T06:20:39.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.471+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffac0103f90 con 0x7ffac0109e10 2024-09-21T06:20:39.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.472+0000 7ffac4959640 1 -- 172.21.15.17:0/3793834114 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7ffab80ae280 con 0x7ffac0109e10 2024-09-21T06:20:39.474 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:20:39.474 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:20:39.474 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffaa80b6510 msgr2=0x7ffaa80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffaa80b6510 0x7ffaa80b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffab0005d00 tx=0x7ffab000b410 comp rx=0 tx=0).stop 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 msgr2=0x7ffac019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 0x7ffac019fc20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffab800eb10 tx=0x7ffab800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 shutdown_connections 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ffaa80b6510 0x7ffaa80b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac0109e10 0x7ffac019fc20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffac01094c0 0x7ffac019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 --2- 172.21.15.17:0/3793834114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac0103b80 0x7ffac019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 >> 172.21.15.17:0/3793834114 conn(0x7ffac00ff610 msgr2=0x7ffac0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 shutdown_connections 2024-09-21T06:20:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:39.474+0000 7ffac595b640 1 -- 172.21.15.17:0/3793834114 wait complete. 2024-09-21T06:20:40.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:39 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3793834114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:40.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:39 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3793834114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:40.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:39 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3793834114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:40.300 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id 41a7269d --release --await' 2024-09-21T06:20:40.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id 41a7269d --release --await 2024-09-21T06:20:40.561 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:40.968 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:40 smithi017 ceph-mon[31080]: pgmap v611: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T06:20:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 -- 172.21.15.17:0/1062819681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 msgr2=0x7f8070102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 --2- 172.21.15.17:0/1062819681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070102e90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f806c009900 tx=0x7f806c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 -- 172.21.15.17:0/1062819681 shutdown_connections 2024-09-21T06:20:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 --2- 172.21.15.17:0/1062819681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8070108d10 0x7f807010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 --2- 172.21.15.17:0/1062819681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80701083c0 0x7f80701087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 --2- 172.21.15.17:0/1062819681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070102e90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 -- 172.21.15.17:0/1062819681 >> 172.21.15.17:0/1062819681 conn(0x7f8070079740 msgr2=0x7f8070079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 -- 172.21.15.17:0/1062819681 shutdown_connections 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.066+0000 7f8077a78640 1 -- 172.21.15.17:0/1062819681 wait complete. 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 Processor -- start 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 -- start start 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80701083c0 0x7f80701994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8070108d10 0x7f8070199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8070112830 con 0x7f8070102a80 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80701126b0 con 0x7f80701083c0 2024-09-21T06:20:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8077a78640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f80701129b0 con 0x7f8070108d10 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8075814640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.067+0000 7f8075814640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34510/0 (socket says 172.21.15.17:34510) 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 -- 172.21.15.17:0/1973006893 learned_addr learned my addr 172.21.15.17:0/1973006893 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075013640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80701083c0 0x7f80701994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8076015640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8070108d10 0x7f8070199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 -- 172.21.15.17:0/1973006893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8070108d10 msgr2=0x7f8070199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8070108d10 0x7f8070199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 -- 172.21.15.17:0/1973006893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80701083c0 msgr2=0x7f80701994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80701083c0 0x7f80701994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 -- 172.21.15.17:0/1973006893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80701a8660 con 0x7f8070102a80 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8075814640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070198fb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f806c009230 tx=0x7f806c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8066ffd640 1 -- 172.21.15.17:0/1973006893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c03f030 con 0x7f8070102a80 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8066ffd640 1 -- 172.21.15.17:0/1973006893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f806c003a80 con 0x7f8070102a80 2024-09-21T06:20:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701a88f0 con 0x7f8070102a80 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.068+0000 7f8066ffd640 1 -- 172.21.15.17:0/1973006893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c035070 con 0x7f8070102a80 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.069+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701a8e20 con 0x7f8070102a80 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.071+0000 7f807dfec740 1 Processor -- start 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.071+0000 7f807dfec740 1 -- start start 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f807dfec740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac47f7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8066ffd640 1 -- 172.21.15.17:0/1973006893 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f806c042030 con 0x7f8070102a80 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f807dfec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac47f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f807dfec740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f807dfec740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ac46e2dc0 con 0x564ac4451520 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f807dfec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ac476f1f0 con 0x564ac4428660 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f807dfec740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ac475e620 con 0x564ac4430840 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac47f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac47f7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34520/0 (socket says 172.21.15.17:34520) 2024-09-21T06:20:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 -- 172.21.15.17:0/2860626316 learned_addr learned my addr 172.21.15.17:0/2860626316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8075013640 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8075814640 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac47f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 -- 172.21.15.17:0/2860626316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 msgr2=0x564ac47f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 -- 172.21.15.17:0/2860626316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 msgr2=0x564ac47f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac47f7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 -- 172.21.15.17:0/2860626316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ac4726fd0 con 0x564ac4451520 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.072+0000 7f8076015640 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac47f7510 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8068009e60 tx=0x7f8068010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c974be0ef903fc78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.073+0000 7f805bfff640 1 -- 172.21.15.17:0/2860626316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068016070 con 0x564ac4451520 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.073+0000 7f805bfff640 1 -- 172.21.15.17:0/2860626316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8068004d20 con 0x564ac4451520 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.073+0000 7f805bfff640 1 -- 172.21.15.17:0/2860626316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80680126b0 con 0x564ac4451520 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.073+0000 7f8066ffd640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f805c0b6590 0x7f805c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.073+0000 7f8075814640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f805c0b6590 0x7f805c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.073+0000 7f8066ffd640 1 -- 172.21.15.17:0/1973006893 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f806c107bc0 con 0x7f8070102a80 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 -- 172.21.15.17:0/2860626316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 msgr2=0x564ac47f7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f8075814640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f805c0b6590 0x7f805c0b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x564ac47f6190 tx=0x7f806c02a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac47f7510 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8068009e60 tx=0x7f8068010740 comp rx=0 tx=0).stop 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 -- 172.21.15.17:0/2860626316 shutdown_connections 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac47f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 --2- 172.21.15.17:0/2860626316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac47f7510 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 -- 172.21.15.17:0/2860626316 >> 172.21.15.17:0/2860626316 conn(0x564ac4445910 msgr2=0x564ac47f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 -- 172.21.15.17:0/2860626316 shutdown_connections 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 -- 172.21.15.17:0/2860626316 wait complete. 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 -- start start 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.074+0000 7f807dfec740 1 Processor -- start 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4802c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac4803150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac480eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564ac46f9300 con 0x564ac4451520 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ac4762430 con 0x564ac4428660 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x564ac45bfbb0 con 0x564ac4430840 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f807dfec740 10 client.0 _ll_register_callbacks cb 0x564ac4713120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac480eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac480eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34532/0 (socket says 172.21.15.17:34532) 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 -- 172.21.15.17:0/4062037654 learned_addr learned my addr 172.21.15.17:0/4062037654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8075013640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac4803150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4802c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 -- 172.21.15.17:0/4062037654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 msgr2=0x564ac4803150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac4803150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 -- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 msgr2=0x564ac4802c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4802c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.075+0000 7f8076015640 1 -- 172.21.15.17:0/4062037654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ac46e8780 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f8076015640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac480eec0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8068011010 tx=0x7f8068005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da5dafe7103f651 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f80597fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f80597fa640 1 -- 172.21.15.17:0/4062037654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806801e030 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f80597fa640 1 -- 172.21.15.17:0/4062037654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f8068004ed0 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8068004d20 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f80597fa640 1 -- 172.21.15.17:0/4062037654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8068031050 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 10 client.15870 fetch_fsmap learned FSMap version 31 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564ac44bcb00 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f80597fa640 1 -- 172.21.15.17:0/4062037654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8068004d20 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f80597fa640 1 -- 172.21.15.17:0/4062037654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f806800f040 con 0x564ac4451520 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 10 client.15870 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 10 client.15870 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:20:41.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 20 client.15870 populate_metadata read hostname 'smithi017' 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac440fea0 0x564ac4814e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 4 client.15870 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.076+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ac4771140 con 0x564ac440fea0 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.077+0000 7f8075013640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac440fea0 0x564ac4814e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.077+0000 7f8075013640 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac440fea0 0x564ac4814e10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c65fc7b05e9154 server_cookie=5169577d7039dce2 in_seq=0 out_seq=0 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.077+0000 7f80597fa640 10 client.15870 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f80597fa640 1 -- 172.21.15.17:0/4062037654 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ac4771140 con 0x564ac440fea0 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f80597fa640 10 client.15870 handle_command_reply: tid=0 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 client.15870 shutdown 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 msgr2=0x564ac480eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac480eec0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8068011010 tx=0x7f8068005920 comp rx=0 tx=0).stop 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 shutdown_connections 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac440fea0 0x564ac4814e10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4451520 0x564ac480eec0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac4803150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f80597fa640 0 client.15870 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 --2- 172.21.15.17:0/4062037654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4802c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 >> 172.21.15.17:0/4062037654 conn(0x564ac4445910 msgr2=0x564ac47fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 shutdown_connections 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.078+0000 7f807dfec740 1 -- 172.21.15.17:0/4062037654 wait complete. 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.079+0000 7f807dfec740 20 client.15870 trim_cache size 0 max 16384 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 Processor -- start 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 -- start start 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 0x564ac47fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4801ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47ffe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f80701b55a0 con 0x564ac4445910 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80701b2e10 con 0x564ac4428660 2024-09-21T06:20:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f807dfec740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f80701b0c60 con 0x564ac4430840 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 0x564ac47fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 0x564ac47fe350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34542/0 (socket says 172.21.15.17:34542) 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 -- 172.21.15.17:0/698682270 learned_addr learned my addr 172.21.15.17:0/698682270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8075013640 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4801ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 -- 172.21.15.17:0/698682270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 msgr2=0x564ac47ffe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47ffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 -- 172.21.15.17:0/698682270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 msgr2=0x564ac4801ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4801ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.096+0000 7f8076015640 1 -- 172.21.15.17:0/698682270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ac4533960 con 0x564ac4445910 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.097+0000 7f8076015640 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 0x564ac47fe350 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f806800a010 tx=0x7f8068009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a386aeb132edf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.097+0000 7f805b7fe640 1 -- 172.21.15.17:0/698682270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806801e070 con 0x564ac4445910 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.097+0000 7f805b7fe640 1 -- 172.21.15.17:0/698682270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8068010c40 con 0x564ac4445910 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.097+0000 7f805b7fe640 1 -- 172.21.15.17:0/698682270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068016040 con 0x564ac4445910 2024-09-21T06:20:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 -- 172.21.15.17:0/698682270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 msgr2=0x564ac47fe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 0x564ac47fe350 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f806800a010 tx=0x7f8068009be0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 -- 172.21.15.17:0/698682270 shutdown_connections 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4430840 0x564ac47ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac4801ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 --2- 172.21.15.17:0/698682270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4445910 0x564ac47fe350 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 -- 172.21.15.17:0/698682270 >> 172.21.15.17:0/698682270 conn(0x564ac48032d0 msgr2=0x564ac4801490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 -- 172.21.15.17:0/698682270 shutdown_connections 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 -- 172.21.15.17:0/698682270 wait complete. 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 -- start start 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.098+0000 7f807dfec740 1 Processor -- start 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac48184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 0x564ac4816980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4445910 0x564ac4816ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f80701b12d0 con 0x564ac4430840 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80701b2740 con 0x564ac4428660 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f80701b19a0 con 0x564ac4445910 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f807dfec740 10 client.0 _ll_register_callbacks cb 0x7f806000b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 0x564ac4816980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 0x564ac4816980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34554/0 (socket says 172.21.15.17:34554) 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 -- 172.21.15.17:0/3057262215 learned_addr learned my addr 172.21.15.17:0/3057262215 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8076015640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac48184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8076015640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4445910 0x564ac4816ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 -- 172.21.15.17:0/3057262215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4445910 msgr2=0x564ac4816ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4445910 0x564ac4816ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 -- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 msgr2=0x564ac48184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac48184a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 -- 172.21.15.17:0/3057262215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ac4817500 con 0x564ac4430840 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8076015640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4445910 0x564ac4816ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f8075013640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 0x564ac4816980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f806000bdd0 tx=0x7f8060012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68033c40b8c61f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.099+0000 7f80597fa640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f80597fa640 1 -- 172.21.15.17:0/3057262215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060004020 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8068010c40 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f80597fa640 1 -- 172.21.15.17:0/3057262215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f80600041c0 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f80597fa640 1 -- 172.21.15.17:0/3057262215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8060030050 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 10 client.15876 fetch_fsmap learned FSMap version 31 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564ac48803c0 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f80597fa640 1 -- 172.21.15.17:0/3057262215 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8068010c40 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f80597fa640 1 -- 172.21.15.17:0/3057262215 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f80600039e0 con 0x564ac4430840 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 10 client.15876 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 10 client.15876 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 20 client.15876 populate_metadata read hostname 'smithi017' 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac4451520 0x564ac4882bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 4 client.15876 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "41a7269d", "release": true, "await": true}] 2024-09-21T06:20:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.100+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "41a7269d", "release": true, "await": true}) -- 0x564ac476cbf0 con 0x564ac4451520 2024-09-21T06:20:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.101+0000 7f8076015640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac4451520 0x564ac4882bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.101+0000 7f80597fa640 10 client.15876 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.101+0000 7f8076015640 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac4451520 0x564ac4882bb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1114f5caa9d88fc server_cookie=e2bd293756c8c99c in_seq=0 out_seq=0 2024-09-21T06:20:41.125 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:40 smithi089 ceph-mon[33879]: pgmap v611: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T06:20:41.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:40 smithi081 ceph-mon[33870]: pgmap v611: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T06:20:41.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f80597fa640 1 -- 172.21.15.17:0/3057262215 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564ac476cbf0 con 0x564ac4451520 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f80597fa640 10 client.15876 handle_command_reply: tid=0 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 client.15876 shutdown 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 msgr2=0x564ac4816980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 0x564ac4816980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f806000bdd0 tx=0x7f8060012ba0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 shutdown_connections 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x564ac4451520 0x564ac4882bb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ac4430840 0x564ac4816980 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564ac4445910 0x564ac4816ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f80597fa640 0 client.15876 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 --2- 172.21.15.17:0/3057262215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ac4428660 0x564ac48184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 >> 172.21.15.17:0/3057262215 conn(0x564ac48032d0 msgr2=0x564ac4801e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 shutdown_connections 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 1 -- 172.21.15.17:0/3057262215 wait complete. 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.310+0000 7f807dfec740 20 client.15876 trim_cache size 0 max 16384 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:20:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 32, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "41a7269d": { 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 32, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 141.1, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:20:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f805c0b6590 msgr2=0x7f805c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f805c0b6590 0x7f805c0b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x564ac47f6190 tx=0x7f806c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 msgr2=0x7f8070198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070198fb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f806c009230 tx=0x7f806c004270 comp rx=0 tx=0).stop 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 shutdown_connections 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f805c0b6590 0x7f805c0b8aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8070108d10 0x7f8070199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80701083c0 0x7f80701994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 --2- 172.21.15.17:0/1973006893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102a80 0x7f8070198fb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 >> 172.21.15.17:0/1973006893 conn(0x7f8070079740 msgr2=0x7f80701015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 shutdown_connections 2024-09-21T06:20:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:41.311+0000 7f8077a78640 1 -- 172.21.15.17:0/1973006893 wait complete. 2024-09-21T06:20:42.048 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '41a7269d', total seconds elapsed: 24.6 2024-09-21T06:20:42.048 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T06:20:42.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:20:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 -- 172.21.15.17:0/3950076297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 msgr2=0x7f1214110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 --2- 172.21.15.17:0/3950076297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f1214110640 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f120c009900 tx=0x7f120c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 -- 172.21.15.17:0/3950076297 shutdown_connections 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 --2- 172.21.15.17:0/3950076297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f1214110640 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 --2- 172.21.15.17:0/3950076297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12141094c0 0x7f12141098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 --2- 172.21.15.17:0/3950076297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 0x7f1214103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 -- 172.21.15.17:0/3950076297 >> 172.21.15.17:0/3950076297 conn(0x7f12140ff610 msgr2=0x7f1214101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 -- 172.21.15.17:0/3950076297 shutdown_connections 2024-09-21T06:20:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.834+0000 7f121b6a5640 1 -- 172.21.15.17:0/3950076297 wait complete. 2024-09-21T06:20:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 Processor -- start 2024-09-21T06:20:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 -- start start 2024-09-21T06:20:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 0x7f121419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12141094c0 0x7f121419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f121419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12141139e0 con 0x7f1214109e10 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1214113860 con 0x7f12141094c0 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f121b6a5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1214113b60 con 0x7f1214103b80 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f1219c42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f121419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f1219c42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f121419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34568/0 (socket says 172.21.15.17:34568) 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f1219c42640 1 -- 172.21.15.17:0/96220549 learned_addr learned my addr 172.21.15.17:0/96220549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f1219441640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 0x7f121419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.835+0000 7f1218c40640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12141094c0 0x7f121419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219c42640 1 -- 172.21.15.17:0/96220549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 msgr2=0x7f121419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219c42640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 0x7f121419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219c42640 1 -- 172.21.15.17:0/96220549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12141094c0 msgr2=0x7f121419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219c42640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12141094c0 0x7f121419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219c42640 1 -- 172.21.15.17:0/96220549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12141a0360 con 0x7f1214109e10 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219441640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 0x7f121419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f1219c42640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f121419fc30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f120c005ab0 tx=0x7f120c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c03f030 con 0x7f1214109e10 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f120c003a80 con 0x7f1214109e10 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12141a05f0 con 0x7f1214109e10 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c035070 con 0x7f1214109e10 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.836+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12141a6db0 con 0x7f1214109e10 2024-09-21T06:20:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.837+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1214104e00 con 0x7f1214109e10 2024-09-21T06:20:42.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.839+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f120c042030 con 0x7f1214109e10 2024-09-21T06:20:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.840+0000 7f12127fc640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11fc0b6590 0x7f11fc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.840+0000 7f1219441640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11fc0b6590 0x7f11fc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.840+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f120c107ea0 con 0x7f1214109e10 2024-09-21T06:20:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.841+0000 7f1219441640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11fc0b6590 0x7f11fc0b8aa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f120400a7b0 tx=0x7f120400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:42.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:42.844+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f120c0d2780 con 0x7f1214109e10 2024-09-21T06:20:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.071+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1214103f90 con 0x7f1214109e10 2024-09-21T06:20:43.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:42 smithi017 ceph-mon[31080]: pgmap v612: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T06:20:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.072+0000 7f12127fc640 1 -- 172.21.15.17:0/96220549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7f120c0d76c0 con 0x7f1214109e10 2024-09-21T06:20:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:20:43.074 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:20:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:20:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11fc0b6590 msgr2=0x7f11fc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11fc0b6590 0x7f11fc0b8aa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f120400a7b0 tx=0x7f120400d040 comp rx=0 tx=0).stop 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 msgr2=0x7f121419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f121419fc30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f120c005ab0 tx=0x7f120c0040e0 comp rx=0 tx=0).stop 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 shutdown_connections 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11fc0b6590 0x7f11fc0b8aa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1214109e10 0x7f121419fc30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12141094c0 0x7f121419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 --2- 172.21.15.17:0/96220549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1214103b80 0x7f121419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 >> 172.21.15.17:0/96220549 conn(0x7f12140ff610 msgr2=0x7f1214101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 shutdown_connections 2024-09-21T06:20:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:43.075+0000 7f121b6a5640 1 -- 172.21.15.17:0/96220549 wait complete. 2024-09-21T06:20:43.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:42 smithi089 ceph-mon[33879]: pgmap v612: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T06:20:43.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:42 smithi081 ceph-mon[33870]: pgmap v612: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-21T06:20:43.756 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T06:20:43.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T06:20:44.017 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:44.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:43 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/96220549' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:44.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:43 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/96220549' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:44.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:43 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/96220549' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 -- 172.21.15.17:0/2379094286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d4108400 msgr2=0x7f11d4108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 --2- 172.21.15.17:0/2379094286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d4108400 0x7f11d4108810 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009900 tx=0x7f11c802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 -- 172.21.15.17:0/2379094286 shutdown_connections 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 --2- 172.21.15.17:0/2379094286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d4108400 0x7f11d4108810 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 --2- 172.21.15.17:0/2379094286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108d50 0x7f11d410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 --2- 172.21.15.17:0/2379094286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d41032a0 0x7f11d41036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 -- 172.21.15.17:0/2379094286 >> 172.21.15.17:0/2379094286 conn(0x7f11d4079fd0 msgr2=0x7f11d407a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 -- 172.21.15.17:0/2379094286 shutdown_connections 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 -- 172.21.15.17:0/2379094286 wait complete. 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.567+0000 7f11d93b3640 1 Processor -- start 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 -- start start 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 0x7f11d419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108400 0x7f11d419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d4108d50 0x7f11d419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4112870 con 0x7f11d41032a0 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41126f0 con 0x7f11d4108400 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d93b3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41129f0 con 0x7f11d4108d50 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 0x7f11d419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 0x7f11d419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34582/0 (socket says 172.21.15.17:34582) 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 -- 172.21.15.17:0/367891213 learned_addr learned my addr 172.21.15.17:0/367891213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d27fc640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108400 0x7f11d419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d37fe640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d4108d50 0x7f11d419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 -- 172.21.15.17:0/367891213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d4108d50 msgr2=0x7f11d419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d4108d50 0x7f11d419bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 -- 172.21.15.17:0/367891213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108400 msgr2=0x7f11d419b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108400 0x7f11d419b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d2ffd640 1 -- 172.21.15.17:0/367891213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d41a63a0 con 0x7f11d41032a0 2024-09-21T06:20:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d37fe640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d4108d50 0x7f11d419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.568+0000 7f11d27fc640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108400 0x7f11d419b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.569+0000 7f11d2ffd640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 0x7f11d419b1a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f11c400c920 tx=0x7f11c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.569+0000 7f11bbfff640 1 -- 172.21.15.17:0/367891213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4007c70 con 0x7f11d41032a0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.569+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d41a6690 con 0x7f11d41032a0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.569+0000 7f11bbfff640 1 -- 172.21.15.17:0/367891213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c4007e10 con 0x7f11d41032a0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.569+0000 7f11bbfff640 1 -- 172.21.15.17:0/367891213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c40186f0 con 0x7f11d41032a0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.569+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d41a6ba0 con 0x7f11d41032a0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.571+0000 7f11df927740 1 Processor -- start 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.571+0000 7f11df927740 1 -- start start 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.571+0000 7f11bbfff640 1 -- 172.21.15.17:0/367891213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f11c400f450 con 0x7f11d41032a0 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11df927740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 0x55e9ee69ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11df927740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee69d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11df927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee69d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11df927740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e9ee613bb0 con 0x55e9ee2f6850 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11df927740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e9ee602fe0 con 0x55e9ee2cd990 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11df927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e9ee606df0 con 0x55e9ee2d5b70 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 0x55e9ee69ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 0x55e9ee69ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34598/0 (socket says 172.21.15.17:34598) 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 -- 172.21.15.17:0/1557432244 learned_addr learned my addr 172.21.15.17:0/1557432244 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d2ffd640 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee69d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d27fc640 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee69d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 -- 172.21.15.17:0/1557432244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 msgr2=0x55e9ee69d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee69d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 -- 172.21.15.17:0/1557432244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 msgr2=0x55e9ee69d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee69d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11d37fe640 1 -- 172.21.15.17:0/1557432244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ee370ba0 con 0x55e9ee2f6850 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.572+0000 7f11bbfff640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11bc0b6540 0x7f11bc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.573+0000 7f11d37fe640 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 0x55e9ee69ce70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009ea0 tx=0x7f11cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e0c9e6a84f1958 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.573+0000 7f11d2ffd640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11bc0b6540 0x7f11bc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.573+0000 7f11bbfff640 1 -- 172.21.15.17:0/367891213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f11c40e78b0 con 0x7f11d41032a0 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.573+0000 7f11b97fa640 1 -- 172.21.15.17:0/1557432244 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc004d20 con 0x55e9ee2f6850 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.573+0000 7f11b97fa640 1 -- 172.21.15.17:0/1557432244 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11cc00fe90 con 0x55e9ee2f6850 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.573+0000 7f11b97fa640 1 -- 172.21.15.17:0/1557432244 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0116d0 con 0x55e9ee2f6850 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 -- 172.21.15.17:0/1557432244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 msgr2=0x55e9ee69ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11d2ffd640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11bc0b6540 0x7f11bc0b8a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55e9ee69baf0 tx=0x7f11c40ed550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 0x55e9ee69ce70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009ea0 tx=0x7f11cc009f90 comp rx=0 tx=0).stop 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 -- 172.21.15.17:0/1557432244 shutdown_connections 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee69d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee69d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 --2- 172.21.15.17:0/1557432244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2f6850 0x55e9ee69ce70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 -- 172.21.15.17:0/1557432244 >> 172.21.15.17:0/1557432244 conn(0x55e9ee2eac40 msgr2=0x55e9ee69ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 -- 172.21.15.17:0/1557432244 shutdown_connections 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 -- 172.21.15.17:0/1557432244 wait complete. 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 -- start start 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.574+0000 7f11df927740 1 Processor -- start 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2f6850 0x55e9ee6b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e9ee4647b0 con 0x55e9ee2cd990 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e9ee59de90 con 0x55e9ee2f6850 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55e9ee6afa00 con 0x55e9ee2d5b70 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 10 client.0 _ll_register_callbacks cb 0x55e9ee600710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34612/0 (socket says 172.21.15.17:34612) 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 -- 172.21.15.17:0/2205424879 learned_addr learned my addr 172.21.15.17:0/2205424879 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d27fc640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2f6850 0x55e9ee6b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 -- 172.21.15.17:0/2205424879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 msgr2=0x55e9ee6ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 -- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2f6850 msgr2=0x55e9ee6b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2f6850 0x55e9ee6b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 -- 172.21.15.17:0/2205424879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ee6b9320 con 0x55e9ee2cd990 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ace80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009e70 tx=0x7f11cc005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd6cac9f5dd6131 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2205424879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc011ca0 con 0x55e9ee2cd990 2024-09-21T06:20:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2205424879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f11cc02a430 con 0x55e9ee2cd990 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.575+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11cc00fe90 con 0x55e9ee2cd990 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2205424879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f11cc032050 con 0x55e9ee2cd990 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 10 client.15894 fetch_fsmap learned FSMap version 31 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e9ee6bbc30 con 0x55e9ee2cd990 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2205424879 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11cc00fe90 con 0x55e9ee2cd990 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2205424879 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f11cc02c6f0 con 0x55e9ee2cd990 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 10 client.15894 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 10 client.15894 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 20 client.15894 populate_metadata read hostname 'smithi017' 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2b51d0 0x55e9ee6beff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 4 client.15894 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9ee615b00 con 0x55e9ee2b51d0 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.576+0000 7f11d27fc640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2b51d0 0x55e9ee6beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.577+0000 7f11b6ff5640 10 client.15894 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.577+0000 7f11d27fc640 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2b51d0 0x55e9ee6beff0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7db1de3a5a5ce39 server_cookie=df9f55cfacfbb3ff in_seq=0 out_seq=0 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2205424879 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9ee615b00 con 0x55e9ee2b51d0 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11b6ff5640 10 client.15894 handle_command_reply: tid=0 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 client.15894 shutdown 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 msgr2=0x55e9ee6ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ace80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009e70 tx=0x7f11cc005c10 comp rx=0 tx=0).stop 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 shutdown_connections 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2b51d0 0x55e9ee6beff0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11b6ff5640 0 client.15894 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2f6850 0x55e9ee6b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 --2- 172.21.15.17:0/2205424879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ace80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 >> 172.21.15.17:0/2205424879 conn(0x55e9ee2eac40 msgr2=0x55e9ee69e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 shutdown_connections 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 1 -- 172.21.15.17:0/2205424879 wait complete. 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.578+0000 7f11df927740 20 client.15894 trim_cache size 0 max 16384 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 Processor -- start 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 -- start start 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee699c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41b1160 con 0x55e9ee2cd990 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41ae9d0 con 0x55e9ee2d5b70 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11df927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41ac820 con 0x55e9ee2b51d0 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11d27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11d27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34624/0 (socket says 172.21.15.17:34624) 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.595+0000 7f11d27fc640 1 -- 172.21.15.17:0/14863179 learned_addr learned my addr 172.21.15.17:0/14863179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d37fe640 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee699c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d27fc640 1 -- 172.21.15.17:0/14863179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 msgr2=0x55e9ee699c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d27fc640 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee699c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d37fe640 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d27fc640 1 -- 172.21.15.17:0/14863179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2d5b70 msgr2=0x55e9ee6a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d27fc640 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d27fc640 1 -- 172.21.15.17:0/14863179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ee6ab180 con 0x55e9ee2cd990 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d37fe640 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11d27fc640 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ac3e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f11d4075c50 tx=0x7f11c8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2447f663cfe2cbc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11b8ff9640 1 -- 172.21.15.17:0/14863179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8035030 con 0x55e9ee2cd990 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11b8ff9640 1 -- 172.21.15.17:0/14863179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c8031d90 con 0x55e9ee2cd990 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.596+0000 7f11b8ff9640 1 -- 172.21.15.17:0/14863179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8004920 con 0x55e9ee2cd990 2024-09-21T06:20:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 -- 172.21.15.17:0/14863179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 msgr2=0x55e9ee6ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ac3e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f11d4075c50 tx=0x7f11c8009680 comp rx=0 tx=0).stop 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 -- 172.21.15.17:0/14863179 shutdown_connections 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2cd990 0x55e9ee6ac3e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 --2- 172.21.15.17:0/14863179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee699c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 -- 172.21.15.17:0/14863179 >> 172.21.15.17:0/14863179 conn(0x55e9ee2eac40 msgr2=0x55e9ee69ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 -- 172.21.15.17:0/14863179 shutdown_connections 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 -- 172.21.15.17:0/14863179 wait complete. 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 -- start start 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.597+0000 7f11df927740 1 Processor -- start 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee6c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee6c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41ace90 con 0x55e9ee2d5b70 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41ae300 con 0x55e9ee2cd990 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41ad560 con 0x55e9ee2b51d0 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 10 client.0 _ll_register_callbacks cb 0x7f11c40ed420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6c1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34626/0 (socket says 172.21.15.17:34626) 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 -- 172.21.15.17:0/2913468638 learned_addr learned my addr 172.21.15.17:0/2913468638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d27fc640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee6c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee6c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 -- 172.21.15.17:0/2913468638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 msgr2=0x55e9ee6c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee6c1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 -- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 msgr2=0x55e9ee6c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee6c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 -- 172.21.15.17:0/2913468638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ee729980 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11d37fe640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6c1c80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0097f0 tx=0x7f11cc01b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d640ec3127c69f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2913468638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc011bf0 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2913468638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f11cc011d90 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.598+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11c8031d90 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2913468638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f11cc043050 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 10 client.15900 fetch_fsmap learned FSMap version 31 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e9ee72aaa0 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2913468638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11c8031d90 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2913468638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f11cc0194c0 con 0x55e9ee2d5b70 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 10 client.15900 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 10 client.15900 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 20 client.15900 populate_metadata read hostname 'smithi017' 2024-09-21T06:20:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2f6850 0x55e9ee72d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 4 client.15900 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T06:20:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x55e9ee6115b0 con 0x55e9ee2f6850 2024-09-21T06:20:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.599+0000 7f11d27fc640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2f6850 0x55e9ee72d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.600+0000 7f11b6ff5640 10 client.15900 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:44.600+0000 7f11d27fc640 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2f6850 0x55e9ee72d2a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3dc8fa27b661a9 server_cookie=3ff641b200ce1a02 in_seq=0 out_seq=0 2024-09-21T06:20:45.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:44 smithi089 ceph-mon[33879]: pgmap v613: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2024-09-21T06:20:45.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:44 smithi017 ceph-mon[31080]: pgmap v613: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2024-09-21T06:20:45.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:44 smithi081 ceph-mon[33870]: pgmap v613: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2024-09-21T06:20:47.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:46 smithi089 ceph-mon[33879]: pgmap v614: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T06:20:47.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:46 smithi017 ceph-mon[31080]: pgmap v614: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T06:20:47.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:46 smithi081 ceph-mon[33870]: pgmap v614: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-21T06:20:47.462 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-21T06:20:47.462 INFO:tasks.workunit.client.0.smithi017.stdout:Final score for writes: 62 2024-09-21T06:20:47.462 INFO:tasks.workunit.client.0.smithi017.stdout:Final score for reads : 5436 2024-09-21T06:20:47.462 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-21T06:20:47.463 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T06:20:47.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.527+0000 7f11b6ff5640 1 -- 172.21.15.17:0/2913468638 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e9ee6115b0 con 0x55e9ee2f6850 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.527+0000 7f11b6ff5640 10 client.15900 handle_command_reply: tid=0 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.527+0000 7f11df927740 1 client.15900 shutdown 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 msgr2=0x55e9ee6c1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6c1c80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0097f0 tx=0x7f11cc01b040 comp rx=0 tx=0).stop 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 shutdown_connections 2024-09-21T06:20:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55e9ee2f6850 0x55e9ee72d2a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e9ee2d5b70 0x55e9ee6c1c80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11b6ff5640 0 client.15900 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9ee2cd990 0x55e9ee6c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 --2- 172.21.15.17:0/2913468638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e9ee2b51d0 0x55e9ee6c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 >> 172.21.15.17:0/2913468638 conn(0x55e9ee2eac40 msgr2=0x55e9ee69ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 shutdown_connections 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 1 -- 172.21.15.17:0/2913468638 wait complete. 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.528+0000 7f11df927740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:20:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 34, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "da895e09": { 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 34, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 141.1, 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:20:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "QUIESCED", 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:20:47.533 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11bc0b6540 msgr2=0x7f11bc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11bc0b6540 0x7f11bc0b8a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55e9ee69baf0 tx=0x7f11c40ed550 comp rx=0 tx=0).stop 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 msgr2=0x7f11d419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 0x7f11d419b1a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f11c400c920 tx=0x7f11c400cde0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 shutdown_connections 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f11bc0b6540 0x7f11bc0b8a50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d4108d50 0x7f11d419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11d4108400 0x7f11d419b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 --2- 172.21.15.17:0/367891213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11d41032a0 0x7f11d419b1a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 >> 172.21.15.17:0/367891213 conn(0x7f11d4079fd0 msgr2=0x7f11d4106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 shutdown_connections 2024-09-21T06:20:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:20:47.529+0000 7f11d93b3640 1 -- 172.21.15.17:0/367891213 wait complete. 2024-09-21T06:20:48.277 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'da895e09', quiesce took 6.2 seconds. Will release after: 14.850000000000001 2024-09-21T06:20:49.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:48 smithi089 ceph-mon[33879]: pgmap v615: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.4 KiB/s wr, 9 op/s 2024-09-21T06:20:49.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:48 smithi017 ceph-mon[31080]: pgmap v615: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.4 KiB/s wr, 9 op/s 2024-09-21T06:20:49.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:48 smithi081 ceph-mon[33870]: pgmap v615: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.4 KiB/s wr, 9 op/s 2024-09-21T06:20:51.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:50 smithi089 ceph-mon[33879]: pgmap v616: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.7 KiB/s wr, 10 op/s 2024-09-21T06:20:51.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:50 smithi017 ceph-mon[31080]: pgmap v616: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.7 KiB/s wr, 10 op/s 2024-09-21T06:20:51.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:50 smithi081 ceph-mon[33870]: pgmap v616: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.7 KiB/s wr, 10 op/s 2024-09-21T06:20:53.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:52 smithi089 ceph-mon[33879]: pgmap v617: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.9 KiB/s wr, 10 op/s 2024-09-21T06:20:53.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:52 smithi017 ceph-mon[31080]: pgmap v617: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.9 KiB/s wr, 10 op/s 2024-09-21T06:20:53.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:52 smithi081 ceph-mon[33870]: pgmap v617: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.9 KiB/s wr, 10 op/s 2024-09-21T06:20:55.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:54 smithi017 ceph-mon[31080]: pgmap v618: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.7 KiB/s wr, 11 op/s 2024-09-21T06:20:55.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:54 smithi081 ceph-mon[33870]: pgmap v618: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.7 KiB/s wr, 11 op/s 2024-09-21T06:20:55.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:54 smithi089 ceph-mon[33879]: pgmap v618: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.7 KiB/s wr, 11 op/s 2024-09-21T06:20:57.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:56 smithi017 ceph-mon[31080]: pgmap v619: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-09-21T06:20:57.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:56 smithi081 ceph-mon[33870]: pgmap v619: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-09-21T06:20:57.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:56 smithi089 ceph-mon[33879]: pgmap v619: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-09-21T06:20:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:20:58 smithi017 ceph-mon[31080]: pgmap v620: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-21T06:20:59.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:20:58 smithi081 ceph-mon[33870]: pgmap v620: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-21T06:20:59.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:20:58 smithi089 ceph-mon[33879]: pgmap v620: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-21T06:21:01.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:00 smithi017 ceph-mon[31080]: pgmap v621: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T06:21:01.168 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:00 smithi089 ceph-mon[33879]: pgmap v621: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T06:21:01.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:00 smithi081 ceph-mon[33870]: pgmap v621: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T06:21:03.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:21:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:02 smithi017 ceph-mon[31080]: pgmap v622: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-21T06:21:03.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:02 smithi081 ceph-mon[33870]: pgmap v622: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-21T06:21:03.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:02 smithi089 ceph-mon[33879]: pgmap v622: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-21T06:21:03.397 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 -- 172.21.15.17:0/57385404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f810de10 msgr2=0x7f15f8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 --2- 172.21.15.17:0/57385404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f810de10 0x7f15f8110300 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009ca0 tx=0x7f15f002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 -- 172.21.15.17:0/57385404 shutdown_connections 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 --2- 172.21.15.17:0/57385404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f810de10 0x7f15f8110300 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 --2- 172.21.15.17:0/57385404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f8105300 0x7f15f810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 --2- 172.21.15.17:0/57385404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15f81049b0 0x7f15f8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 -- 172.21.15.17:0/57385404 >> 172.21.15.17:0/57385404 conn(0x7f15f8079730 msgr2=0x7f15f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 -- 172.21.15.17:0/57385404 shutdown_connections 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.918+0000 7f16003eb640 1 -- 172.21.15.17:0/57385404 wait complete. 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 Processor -- start 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 -- start start 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15f81049b0 0x7f15f81026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 0x7f15f8102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f810de10 0x7f15f8103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8113990 con 0x7f15f8105300 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8113810 con 0x7f15f81049b0 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f16003eb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f15f8113b10 con 0x7f15f810de10 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f15fd986640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 0x7f15f8102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f15fd986640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 0x7f15f8102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35584/0 (socket says 172.21.15.17:35584) 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f15fd986640 1 -- 172.21.15.17:0/2507190399 learned_addr learned my addr 172.21.15.17:0/2507190399 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.919+0000 7f15fe187640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15f81049b0 0x7f15f81026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fe988640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f810de10 0x7f15f8103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fd986640 1 -- 172.21.15.17:0/2507190399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f810de10 msgr2=0x7f15f8103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fd986640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f810de10 0x7f15f8103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fd986640 1 -- 172.21.15.17:0/2507190399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15f81049b0 msgr2=0x7f15f81026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fd986640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15f81049b0 0x7f15f81026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fd986640 1 -- 172.21.15.17:0/2507190399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f81a8640 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15fd986640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 0x7f15f8102c30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f15e800e9c0 tx=0x7f15e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e800ccc0 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f81a8930 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15e80054b0 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8010430 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.920+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f81a8e70 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.922+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f8104dc0 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.923+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f15e8004f00 con 0x7f15f8105300 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.924+0000 7f15ef7fe640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f15e40b6510 0x7f15e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.924+0000 7f15fe187640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f15e40b6510 0x7f15e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.924+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f15e80e7c60 con 0x7f15f8105300 2024-09-21T06:21:03.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.925+0000 7f15fe187640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f15e40b6510 0x7f15e40b8a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f15f8104140 tx=0x7f15f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:03.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:03.927+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15e8056710 con 0x7f15f8105300 2024-09-21T06:21:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.161+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15f802e640 con 0x7f15f8105300 2024-09-21T06:21:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.162+0000 7f15ef7fe640 1 -- 172.21.15.17:0/2507190399 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11888 (secure 0 0 0) 0x7f15e80ae160 con 0x7f15f8105300 2024-09-21T06:21:04.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:21:04.164 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-21T06:16:52:352704+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:16:51.792181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:21:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f15e40b6510 msgr2=0x7f15e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f15e40b6510 0x7f15e40b8a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f15f8104140 tx=0x7f15f4005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 msgr2=0x7f15f8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 0x7f15f8102c30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f15e800e9c0 tx=0x7f15e800ee80 comp rx=0 tx=0).stop 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 shutdown_connections 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f15e40b6510 0x7f15e40b8a20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8105300 0x7f15f8102c30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15f810de10 0x7f15f8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 --2- 172.21.15.17:0/2507190399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15f81049b0 0x7f15f81026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 >> 172.21.15.17:0/2507190399 conn(0x7f15f8079730 msgr2=0x7f15f8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 shutdown_connections 2024-09-21T06:21:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:04.165+0000 7f16003eb640 1 -- 172.21.15.17:0/2507190399 wait complete. 2024-09-21T06:21:05.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:04 smithi017 ceph-mon[31080]: pgmap v623: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-21T06:21:05.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:04 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2507190399' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:05.139 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --set-id da895e09 --release --await' 2024-09-21T06:21:05.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --set-id da895e09 --release --await 2024-09-21T06:21:05.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:04 smithi081 ceph-mon[33870]: pgmap v623: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-21T06:21:05.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:04 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2507190399' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:05.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:04 smithi089 ceph-mon[33879]: pgmap v623: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-21T06:21:05.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:04 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2507190399' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 -- 172.21.15.17:0/1497047789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6920108cf0 msgr2=0x7f692010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 --2- 172.21.15.17:0/1497047789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6920108cf0 0x7f692010f520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ca0 tx=0x7f691802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 -- 172.21.15.17:0/1497047789 shutdown_connections 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 --2- 172.21.15.17:0/1497047789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6920108cf0 0x7f692010f520 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 --2- 172.21.15.17:0/1497047789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f69201083a0 0x7f69201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 --2- 172.21.15.17:0/1497047789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 0x7f6920102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 -- 172.21.15.17:0/1497047789 >> 172.21.15.17:0/1497047789 conn(0x7f6920079730 msgr2=0x7f6920079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 -- 172.21.15.17:0/1497047789 shutdown_connections 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.941+0000 7f692592f640 1 -- 172.21.15.17:0/1497047789 wait complete. 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.942+0000 7f692592f640 1 Processor -- start 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.942+0000 7f692592f640 1 -- start start 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f692592f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 0x7f692019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f692592f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 0x7f692019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f692592f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6920108cf0 0x7f692019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f692592f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6920113960 con 0x7f69201083a0 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f692592f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69201137e0 con 0x7f6920102a60 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f692592f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6920113ae0 con 0x7f6920108cf0 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 0x7f692019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 0x7f692019a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35590/0 (socket says 172.21.15.17:35590) 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 -- 172.21.15.17:0/2922262874 learned_addr learned my addr 172.21.15.17:0/2922262874 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691effd640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 0x7f692019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691f7fe640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6920108cf0 0x7f692019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 -- 172.21.15.17:0/2922262874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6920108cf0 msgr2=0x7f692019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6920108cf0 0x7f692019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 -- 172.21.15.17:0/2922262874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 msgr2=0x7f692019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 0x7f692019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 -- 172.21.15.17:0/2922262874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69201a02c0 con 0x7f69201083a0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691effd640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 0x7f692019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.943+0000 7f691e7fc640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 0x7f692019a8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f690800e9f0 tx=0x7f690800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.944+0000 7f692492d640 1 -- 172.21.15.17:0/2922262874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690800ccc0 con 0x7f69201083a0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.944+0000 7f692492d640 1 -- 172.21.15.17:0/2922262874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69080054b0 con 0x7f69201083a0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.944+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69201a05b0 con 0x7f69201083a0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.944+0000 7f692492d640 1 -- 172.21.15.17:0/2922262874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908010430 con 0x7f69201083a0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.944+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69201a6d10 con 0x7f69201083a0 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.946+0000 7f692bea3740 1 Processor -- start 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.946+0000 7f692bea3740 1 -- start start 2024-09-21T06:21:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.946+0000 7f692492d640 1 -- 172.21.15.17:0/2922262874 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f69080046c0 con 0x7f69201083a0 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.946+0000 7f692bea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 0x561af2515510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f692bea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af2146660 0x561af2515a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f692bea3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af2515f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f692bea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561af2400dc0 con 0x561af216f520 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f692bea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561af248d1f0 con 0x561af2146660 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f692bea3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561af247c620 con 0x561af214e840 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 0x561af2515510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 0x561af2515510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35592/0 (socket says 172.21.15.17:35592) 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 -- 172.21.15.17:0/159570732 learned_addr learned my addr 172.21.15.17:0/159570732 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691effd640 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af2146660 0x561af2515a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691e7fc640 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af2515f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 -- 172.21.15.17:0/159570732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 msgr2=0x561af2515f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af2515f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 -- 172.21.15.17:0/159570732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af2146660 msgr2=0x561af2515a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af2146660 0x561af2515a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 -- 172.21.15.17:0/159570732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561af2444fd0 con 0x561af216f520 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f691f7fe640 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 0x561af2515510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ca0 tx=0x7f6918009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb7874c554a0645 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.947+0000 7f692492d640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f690c0b6590 0x7f690c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.948+0000 7f6915ffb640 1 -- 172.21.15.17:0/159570732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918031980 con 0x561af216f520 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.948+0000 7f6915ffb640 1 -- 172.21.15.17:0/159570732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6918036030 con 0x561af216f520 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.948+0000 7f6915ffb640 1 -- 172.21.15.17:0/159570732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918004460 con 0x561af216f520 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.948+0000 7f691effd640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f690c0b6590 0x7f690c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.948+0000 7f692492d640 1 -- 172.21.15.17:0/2922262874 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f69080e7970 con 0x7f69201083a0 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 -- 172.21.15.17:0/159570732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 msgr2=0x561af2515510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 0x561af2515510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ca0 tx=0x7f6918009a20 comp rx=0 tx=0).stop 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f691effd640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f690c0b6590 0x7f690c0b8aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x561af2514190 tx=0x7f691000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 -- 172.21.15.17:0/159570732 shutdown_connections 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af2515f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af2146660 0x561af2515a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 --2- 172.21.15.17:0/159570732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af216f520 0x561af2515510 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 -- 172.21.15.17:0/159570732 >> 172.21.15.17:0/159570732 conn(0x561af2163910 msgr2=0x561af2513400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 -- 172.21.15.17:0/159570732 shutdown_connections 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 -- 172.21.15.17:0/159570732 wait complete. 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 -- start start 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.949+0000 7f692bea3740 1 Processor -- start 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 0x561af2520ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af25210e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af216f520 0x561af25310c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561af2417300 con 0x561af2146660 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561af2480430 con 0x561af216f520 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x561af22ddbb0 con 0x561af214e840 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f692bea3740 10 client.0 _ll_register_callbacks cb 0x561af2431120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 0x561af2520ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 0x561af2520ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35594/0 (socket says 172.21.15.17:35594) 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 -- 172.21.15.17:0/708899318 learned_addr learned my addr 172.21.15.17:0/708899318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691f7fe640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af216f520 0x561af25310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691e7fc640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af25210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 -- 172.21.15.17:0/708899318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 msgr2=0x561af25210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af25210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 -- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af216f520 msgr2=0x561af25310c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af216f520 0x561af25310c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 -- 172.21.15.17:0/708899318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561af2406780 con 0x561af2146660 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f691effd640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 0x561af2520ba0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6910010800 tx=0x7f6910004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19edd649b3682ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f68feffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.950+0000 7f68feffd640 1 -- 172.21.15.17:0/708899318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691002c060 con 0x561af2146660 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f68feffd640 1 -- 172.21.15.17:0/708899318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f6910017030 con 0x561af2146660 2024-09-21T06:21:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6918036030 con 0x561af2146660 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f68feffd640 1 -- 172.21.15.17:0/708899318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6910004020 con 0x561af2146660 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 10 client.15918 fetch_fsmap learned FSMap version 31 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561af21dab00 con 0x561af2146660 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f68feffd640 1 -- 172.21.15.17:0/708899318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6918036030 con 0x561af2146660 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f68feffd640 1 -- 172.21.15.17:0/708899318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f6910003810 con 0x561af2146660 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 10 client.15918 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 10 client.15918 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 20 client.15918 populate_metadata read hostname 'smithi017' 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af212dea0 0x561af25371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 4 client.15918 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.951+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561af248f140 con 0x561af212dea0 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.952+0000 7f691e7fc640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af212dea0 0x561af25371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.952+0000 7f68feffd640 10 client.15918 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.952+0000 7f691e7fc640 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af212dea0 0x561af25371f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29ef24b4fee9e9a2 server_cookie=e38744d87d586b9b in_seq=0 out_seq=0 2024-09-21T06:21:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f68feffd640 1 -- 172.21.15.17:0/708899318 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561af248f140 con 0x561af212dea0 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f68feffd640 10 client.15918 handle_command_reply: tid=0 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 client.15918 shutdown 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 msgr2=0x561af2520ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 0x561af2520ba0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6910010800 tx=0x7f6910004730 comp rx=0 tx=0).stop 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 shutdown_connections 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af212dea0 0x561af25371f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af216f520 0x561af25310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f68feffd640 0 client.15918 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af214e840 0x561af25210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 --2- 172.21.15.17:0/708899318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af2146660 0x561af2520ba0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 >> 172.21.15.17:0/708899318 conn(0x561af2163910 msgr2=0x561af25186f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 shutdown_connections 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 1 -- 172.21.15.17:0/708899318 wait complete. 2024-09-21T06:21:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.953+0000 7f692bea3740 20 client.15918 trim_cache size 0 max 16384 2024-09-21T06:21:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.970+0000 7f692bea3740 1 Processor -- start 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.970+0000 7f692bea3740 1 -- start start 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f692bea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af212dea0 0x561af2530fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f692bea3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af2516f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f692bea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 0x561af25227d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f692bea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69201b1040 con 0x561af214e840 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f692bea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69201ae8b0 con 0x561af212dea0 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f692bea3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f69201ac700 con 0x561af2146660 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 0x561af25227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 0x561af25227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35610/0 (socket says 172.21.15.17:35610) 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 -- 172.21.15.17:0/2249698255 learned_addr learned my addr 172.21.15.17:0/2249698255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691effd640 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af212dea0 0x561af2530fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691e7fc640 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af2516f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 -- 172.21.15.17:0/2249698255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 msgr2=0x561af2516f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af2516f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 -- 172.21.15.17:0/2249698255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af212dea0 msgr2=0x561af2530fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af212dea0 0x561af2530fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691f7fe640 1 -- 172.21.15.17:0/2249698255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561af2251960 con 0x561af214e840 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.971+0000 7f691effd640 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af212dea0 0x561af2530fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.972+0000 7f691f7fe640 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 0x561af25227d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6918045000 tx=0x7f69180094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b8809c6928584a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.972+0000 7f69157fa640 1 -- 172.21.15.17:0/2249698255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918055020 con 0x561af214e840 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.972+0000 7f69157fa640 1 -- 172.21.15.17:0/2249698255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6918036040 con 0x561af214e840 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.972+0000 7f69157fa640 1 -- 172.21.15.17:0/2249698255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691804a040 con 0x561af214e840 2024-09-21T06:21:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 -- 172.21.15.17:0/2249698255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 msgr2=0x561af25227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 0x561af25227d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6918045000 tx=0x7f69180094a0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 -- 172.21.15.17:0/2249698255 shutdown_connections 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af214e840 0x561af25227d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af2516f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 --2- 172.21.15.17:0/2249698255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af212dea0 0x561af2530fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 -- 172.21.15.17:0/2249698255 >> 172.21.15.17:0/2249698255 conn(0x561af2163910 msgr2=0x561af25220c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 -- 172.21.15.17:0/2249698255 shutdown_connections 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 -- 172.21.15.17:0/2249698255 wait complete. 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 -- start start 2024-09-21T06:21:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.973+0000 7f692bea3740 1 Processor -- start 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 0x561af252b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af252bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af214e840 0x561af259ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69201acd70 con 0x561af212dea0 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69201ae1e0 con 0x561af214e840 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f69201ad440 con 0x561af2146660 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f692bea3740 10 client.0 _ll_register_callbacks cb 0x7f69100106c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 0x561af252b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 0x561af252b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35614/0 (socket says 172.21.15.17:35614) 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 -- 172.21.15.17:0/1168366518 learned_addr learned my addr 172.21.15.17:0/1168366518 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691f7fe640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af214e840 0x561af259ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691e7fc640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af252bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 -- 172.21.15.17:0/1168366518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 msgr2=0x561af252bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af252bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 -- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af214e840 msgr2=0x561af259ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af214e840 0x561af259ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 -- 172.21.15.17:0/1168366518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561af259b200 con 0x561af212dea0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f691effd640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 0x561af252b930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6910011e90 tx=0x7f69100038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4eb520bb704a23d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f68feffd640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.974+0000 7f68feffd640 1 -- 172.21.15.17:0/1168366518 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691001fc10 con 0x561af212dea0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f68feffd640 1 -- 172.21.15.17:0/1168366518 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f691001fdb0 con 0x561af212dea0 2024-09-21T06:21:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6918036040 con 0x561af212dea0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f68feffd640 1 -- 172.21.15.17:0/1168366518 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f691002c020 con 0x561af212dea0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 10 client.15924 fetch_fsmap learned FSMap version 31 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561af25a25b0 con 0x561af212dea0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f68feffd640 1 -- 172.21.15.17:0/1168366518 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6918036040 con 0x561af212dea0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f68feffd640 1 -- 172.21.15.17:0/1168366518 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f6910037bf0 con 0x561af212dea0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 10 client.15924 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 10 client.15924 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 20 client.15924 populate_metadata read hostname 'smithi017' 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af216f520 0x561af25a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 4 client.15924 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "da895e09", "release": true, "await": true}] 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "set_id": "da895e09", "release": true, "await": true}) -- 0x561af248abf0 con 0x561af216f520 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.975+0000 7f691e7fc640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af216f520 0x561af25a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.976+0000 7f691e7fc640 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af216f520 0x561af25a4df0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b182cf303fd878cb server_cookie=e68c7a728747bb38 in_seq=0 out_seq=0 2024-09-21T06:21:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:05.976+0000 7f68feffd640 10 client.15924 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f68feffd640 1 -- 172.21.15.17:0/1168366518 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561af248abf0 con 0x561af216f520 2024-09-21T06:21:06.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f68feffd640 10 client.15924 handle_command_reply: tid=0 2024-09-21T06:21:06.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 client.15924 shutdown 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 msgr2=0x561af252b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 0x561af252b930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6910011e90 tx=0x7f69100038a0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 shutdown_connections 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x561af216f520 0x561af25a4df0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561af214e840 0x561af259ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561af2146660 0x561af252bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f68feffd640 0 client.15924 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 --2- 172.21.15.17:0/1168366518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561af212dea0 0x561af252b930 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 >> 172.21.15.17:0/1168366518 conn(0x561af2163910 msgr2=0x561af2516cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 shutdown_connections 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 1 -- 172.21.15.17:0/1168366518 wait complete. 2024-09-21T06:21:06.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692bea3740 20 client.15924 trim_cache size 0 max 16384 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 31, 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 36, 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": { 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "da895e09": { 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 36, 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age_ref": 0.0, 2024-09-21T06:21:06.291 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "timeout": 90.0, 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "expiration": 141.1, 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "members": { 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "file:/": { 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "excluded": false, 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "state": { 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RELEASED", 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.0 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:06.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f690c0b6590 msgr2=0x7f690c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f690c0b6590 0x7f690c0b8aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x561af2514190 tx=0x7f691000b390 comp rx=0 tx=0).stop 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 msgr2=0x7f692019a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 0x7f692019a8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f690800e9f0 tx=0x7f690800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 shutdown_connections 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f690c0b6590 0x7f690c0b8aa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69201083a0 0x7f692019a8f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6920108cf0 0x7f692019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 --2- 172.21.15.17:0/2922262874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6920102a60 0x7f692019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.194+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 >> 172.21.15.17:0/2922262874 conn(0x7f6920079730 msgr2=0x7f69201043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.195+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 shutdown_connections 2024-09-21T06:21:06.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:06.195+0000 7f692592f640 1 -- 172.21.15.17:0/2922262874 wait complete. 2024-09-21T06:21:06.930 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'da895e09', total seconds elapsed: 24.9 2024-09-21T06:21:07.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:06 smithi017 ceph-mon[31080]: pgmap v624: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T06:21:07.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:06 smithi081 ceph-mon[33870]: pgmap v624: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T06:21:07.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:06 smithi089 ceph-mon[33879]: pgmap v624: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T06:21:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:08 smithi081 ceph-mon[33870]: pgmap v625: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 7 op/s 2024-09-21T06:21:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:08 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:09.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:08 smithi089 ceph-mon[33879]: pgmap v625: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 7 op/s 2024-09-21T06:21:09.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:08 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:09.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:08 smithi017 ceph-mon[31080]: pgmap v625: 129 pgs: 129 active+clean; 387 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 KiB/s wr, 7 op/s 2024-09-21T06:21:09.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:08 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:11.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:10 smithi081 ceph-mon[33870]: pgmap v626: 129 pgs: 129 active+clean; 385 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 28 op/s 2024-09-21T06:21:11.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:10 smithi089 ceph-mon[33879]: pgmap v626: 129 pgs: 129 active+clean; 385 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 28 op/s 2024-09-21T06:21:11.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:10 smithi017 ceph-mon[31080]: pgmap v626: 129 pgs: 129 active+clean; 385 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 28 op/s 2024-09-21T06:21:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:12 smithi081 ceph-mon[33870]: pgmap v627: 129 pgs: 129 active+clean; 378 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 98 KiB/s wr, 66 op/s 2024-09-21T06:21:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:12 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:13.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:12 smithi089 ceph-mon[33879]: pgmap v627: 129 pgs: 129 active+clean; 378 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 98 KiB/s wr, 66 op/s 2024-09-21T06:21:13.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:12 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:13.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:12 smithi017 ceph-mon[31080]: pgmap v627: 129 pgs: 129 active+clean; 378 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 98 KiB/s wr, 66 op/s 2024-09-21T06:21:13.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:12 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:14.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:13 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:14.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:13 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:14.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:13 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:15.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:14 smithi081 ceph-mon[33870]: pgmap v628: 129 pgs: 129 active+clean; 375 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 341 KiB/s wr, 100 op/s 2024-09-21T06:21:15.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:14 smithi089 ceph-mon[33879]: pgmap v628: 129 pgs: 129 active+clean; 375 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 341 KiB/s wr, 100 op/s 2024-09-21T06:21:15.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:14 smithi017 ceph-mon[31080]: pgmap v628: 129 pgs: 129 active+clean; 375 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 341 KiB/s wr, 100 op/s 2024-09-21T06:21:17.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:16 smithi081 ceph-mon[33870]: pgmap v629: 129 pgs: 129 active+clean; 364 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 485 KiB/s wr, 185 op/s 2024-09-21T06:21:17.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:16 smithi089 ceph-mon[33879]: pgmap v629: 129 pgs: 129 active+clean; 364 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 485 KiB/s wr, 185 op/s 2024-09-21T06:21:17.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:16 smithi017 ceph-mon[31080]: pgmap v629: 129 pgs: 129 active+clean; 364 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 485 KiB/s wr, 185 op/s 2024-09-21T06:21:18.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:17 smithi081 ceph-mon[33870]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:18.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:17 smithi089 ceph-mon[33879]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:18.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:17 smithi017 ceph-mon[31080]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:18 smithi081 ceph-mon[33870]: pgmap v630: 129 pgs: 129 active+clean; 353 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 547 KiB/s wr, 244 op/s 2024-09-21T06:21:19.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:18 smithi089 ceph-mon[33879]: pgmap v630: 129 pgs: 129 active+clean; 353 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 547 KiB/s wr, 244 op/s 2024-09-21T06:21:19.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:18 smithi017 ceph-mon[31080]: pgmap v630: 129 pgs: 129 active+clean; 353 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 547 KiB/s wr, 244 op/s 2024-09-21T06:21:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:20 smithi081 ceph-mon[33870]: pgmap v631: 129 pgs: 129 active+clean; 347 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 841 KiB/s wr, 316 op/s 2024-09-21T06:21:21.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:20 smithi089 ceph-mon[33879]: pgmap v631: 129 pgs: 129 active+clean; 347 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 841 KiB/s wr, 316 op/s 2024-09-21T06:21:21.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:20 smithi017 ceph-mon[31080]: pgmap v631: 129 pgs: 129 active+clean; 347 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 841 KiB/s wr, 316 op/s 2024-09-21T06:21:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:21 smithi081 ceph-mon[33870]: pgmap v632: 129 pgs: 129 active+clean; 338 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 892 KiB/s wr, 366 op/s 2024-09-21T06:21:22.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:21 smithi089 ceph-mon[33879]: pgmap v632: 129 pgs: 129 active+clean; 338 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 892 KiB/s wr, 366 op/s 2024-09-21T06:21:22.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:21 smithi017 ceph-mon[31080]: pgmap v632: 129 pgs: 129 active+clean; 338 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 892 KiB/s wr, 366 op/s 2024-09-21T06:21:24.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:24 smithi081 ceph-mon[33870]: pgmap v633: 129 pgs: 129 active+clean; 334 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.0 MiB/s wr, 375 op/s 2024-09-21T06:21:24.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:24 smithi089 ceph-mon[33879]: pgmap v633: 129 pgs: 129 active+clean; 334 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.0 MiB/s wr, 375 op/s 2024-09-21T06:21:24.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:24 smithi017 ceph-mon[31080]: pgmap v633: 129 pgs: 129 active+clean; 334 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.0 MiB/s wr, 375 op/s 2024-09-21T06:21:25.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:25.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:25.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:21:25.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:25.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:25.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:25.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:21:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:25.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:21:26.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:26 smithi081 ceph-mon[33870]: pgmap v634: 129 pgs: 129 active+clean; 323 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 423 op/s 2024-09-21T06:21:26.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:26 smithi089 ceph-mon[33879]: pgmap v634: 129 pgs: 129 active+clean; 323 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 423 op/s 2024-09-21T06:21:26.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:26 smithi017 ceph-mon[31080]: pgmap v634: 129 pgs: 129 active+clean; 323 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 423 op/s 2024-09-21T06:21:28.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:28 smithi081 ceph-mon[33870]: pgmap v635: 129 pgs: 129 active+clean; 312 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 955 KiB/s wr, 409 op/s 2024-09-21T06:21:28.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:28 smithi089 ceph-mon[33879]: pgmap v635: 129 pgs: 129 active+clean; 312 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 955 KiB/s wr, 409 op/s 2024-09-21T06:21:28.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:28 smithi017 ceph-mon[31080]: pgmap v635: 129 pgs: 129 active+clean; 312 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 955 KiB/s wr, 409 op/s 2024-09-21T06:21:30.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:30 smithi081 ceph-mon[33870]: pgmap v636: 129 pgs: 129 active+clean; 305 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 429 op/s 2024-09-21T06:21:30.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:30 smithi089 ceph-mon[33879]: pgmap v636: 129 pgs: 129 active+clean; 305 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 429 op/s 2024-09-21T06:21:30.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:30 smithi017 ceph-mon[31080]: pgmap v636: 129 pgs: 129 active+clean; 305 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 429 op/s 2024-09-21T06:21:32.667 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:32 smithi089 ceph-mon[33879]: pgmap v637: 129 pgs: 129 active+clean; 297 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 871 KiB/s wr, 404 op/s 2024-09-21T06:21:32.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:32 smithi081 ceph-mon[33870]: pgmap v637: 129 pgs: 129 active+clean; 297 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 871 KiB/s wr, 404 op/s 2024-09-21T06:21:32.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:32 smithi017 ceph-mon[31080]: pgmap v637: 129 pgs: 129 active+clean; 297 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 871 KiB/s wr, 404 op/s 2024-09-21T06:21:34.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:34 smithi081 ceph-mon[33870]: pgmap v638: 129 pgs: 129 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 918 KiB/s wr, 374 op/s 2024-09-21T06:21:34.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:34 smithi089 ceph-mon[33879]: pgmap v638: 129 pgs: 129 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 918 KiB/s wr, 374 op/s 2024-09-21T06:21:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:34 smithi017 ceph-mon[31080]: pgmap v638: 129 pgs: 129 active+clean; 293 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 918 KiB/s wr, 374 op/s 2024-09-21T06:21:36.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:36 smithi081 ceph-mon[33870]: pgmap v639: 129 pgs: 129 active+clean; 283 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 972 KiB/s wr, 409 op/s 2024-09-21T06:21:36.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:36 smithi089 ceph-mon[33879]: pgmap v639: 129 pgs: 129 active+clean; 283 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 972 KiB/s wr, 409 op/s 2024-09-21T06:21:36.888 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:36 smithi017 ceph-mon[31080]: pgmap v639: 129 pgs: 129 active+clean; 283 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 972 KiB/s wr, 409 op/s 2024-09-21T06:21:38.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:38 smithi017 ceph-mon[31080]: pgmap v640: 129 pgs: 129 active+clean; 270 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 399 op/s 2024-09-21T06:21:38.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:38 smithi081 ceph-mon[33870]: pgmap v640: 129 pgs: 129 active+clean; 270 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 399 op/s 2024-09-21T06:21:38.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:38 smithi089 ceph-mon[33879]: pgmap v640: 129 pgs: 129 active+clean; 270 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 399 op/s 2024-09-21T06:21:38.889 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-21T06:21:38.889 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T06:21:39.269 DEBUG:teuthology.parallel:result is None 2024-09-21T06:21:39.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:21:39.309 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:21:39.310 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T06:21:39.321 INFO:tasks.quiescer:joining Quiescers 2024-09-21T06:21:39.321 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T06:21:39.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:21:39.701 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 -- 172.21.15.17:0/3238500787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c103b90 msgr2=0x7f4a1c103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 --2- 172.21.15.17:0/3238500787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c103b90 0x7f4a1c103fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009ca0 tx=0x7f4a1402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 -- 172.21.15.17:0/3238500787 shutdown_connections 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 --2- 172.21.15.17:0/3238500787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a1c109e20 0x7f4a1c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 --2- 172.21.15.17:0/3238500787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 --2- 172.21.15.17:0/3238500787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c103b90 0x7f4a1c103fa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 -- 172.21.15.17:0/3238500787 >> 172.21.15.17:0/3238500787 conn(0x7f4a1c0ff5e0 msgr2=0x7f4a1c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 -- 172.21.15.17:0/3238500787 shutdown_connections 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.198+0000 7f4a20d98640 1 -- 172.21.15.17:0/3238500787 wait complete. 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.199+0000 7f4a20d98640 1 Processor -- start 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 -- start start 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a1c103b90 0x7f4a1c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c109e20 0x7f4a1c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1139e0 con 0x7f4a1c1094d0 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113860 con 0x7f4a1c109e20 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a20d98640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113b60 con 0x7f4a1c103b90 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46392/0 (socket says 172.21.15.17:46392) 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 -- 172.21.15.17:0/2745225271 learned_addr learned my addr 172.21.15.17:0/2745225271 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a1ad9d640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c109e20 0x7f4a1c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a1a59c640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a1c103b90 0x7f4a1c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 -- 172.21.15.17:0/2745225271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a1c103b90 msgr2=0x7f4a1c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a1c103b90 0x7f4a1c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 -- 172.21.15.17:0/2745225271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c109e20 msgr2=0x7f4a1c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.200+0000 7f4a19d9b640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c109e20 0x7f4a1c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a19d9b640 1 -- 172.21.15.17:0/2745225271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1a03a0 con 0x7f4a1c1094d0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a19d9b640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c19a9d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400d740 tx=0x7f4a0400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04017070 con 0x7f4a1c1094d0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1a0690 con 0x7f4a1c1094d0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1a6df0 con 0x7f4a1c1094d0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a0400de50 con 0x7f4a1c1094d0 2024-09-21T06:21:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.201+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400f620 con 0x7f4a1c1094d0 2024-09-21T06:21:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.202+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c103fa0 con 0x7f4a1c1094d0 2024-09-21T06:21:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.204+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4a0401a070 con 0x7f4a1c1094d0 2024-09-21T06:21:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.205+0000 7f4a137fe640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4a080b6510 0x7f4a080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.205+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f4a040e6f90 con 0x7f4a1c1094d0 2024-09-21T06:21:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.206+0000 7f4a1a59c640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4a080b6510 0x7f4a080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.207+0000 7f4a1a59c640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4a080b6510 0x7f4a080b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000f80 tx=0x7f4a14031000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:40.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.209+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a040b1870 con 0x7f4a1c1094d0 2024-09-21T06:21:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.438+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a1c10bc20 con 0x7f4a1c1094d0 2024-09-21T06:21:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.439+0000 7f4a137fe640 1 -- 172.21.15.17:0/2745225271 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11894 (secure 0 0 0) 0x7f4a040b67b0 con 0x7f4a1c1094d0 2024-09-21T06:21:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:21:40.442 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"btime":"2024-09-21T06:21:16:911958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:21:16.799396+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:21:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4a080b6510 msgr2=0x7f4a080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4a080b6510 0x7f4a080b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000f80 tx=0x7f4a14031000 comp rx=0 tx=0).stop 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 msgr2=0x7f4a1c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c19a9d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400d740 tx=0x7f4a0400dc00 comp rx=0 tx=0).stop 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 shutdown_connections 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4a080b6510 0x7f4a080b8a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c1094d0 0x7f4a1c19a9d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a1c109e20 0x7f4a1c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 --2- 172.21.15.17:0/2745225271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a1c103b90 0x7f4a1c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 >> 172.21.15.17:0/2745225271 conn(0x7f4a1c0ff5e0 msgr2=0x7f4a1c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 shutdown_connections 2024-09-21T06:21:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:40.441+0000 7f4a20d98640 1 -- 172.21.15.17:0/2745225271 wait complete. 2024-09-21T06:21:40.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:40 smithi081 ceph-mon[33870]: pgmap v641: 129 pgs: 129 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 393 op/s 2024-09-21T06:21:40.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:40 smithi017 ceph-mon[31080]: pgmap v641: 129 pgs: 129 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 393 op/s 2024-09-21T06:21:40.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:40 smithi089 ceph-mon[33879]: pgmap v641: 129 pgs: 129 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 393 op/s 2024-09-21T06:21:41.198 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24656 quiesce db --cancel --all' 2024-09-21T06:21:41.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24656 quiesce db --cancel --all 2024-09-21T06:21:41.465 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:41.720 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:41 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2745225271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:41.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:41 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2745225271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:41.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:41 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2745225271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.954+0000 7fe6102ba640 1 -- 172.21.15.17:0/1086837806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 msgr2=0x7fe60810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.954+0000 7fe6102ba640 1 --2- 172.21.15.17:0/1086837806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60810d970 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009900 tx=0x7fe5f802a410 comp rx=0 tx=0).stop 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 -- 172.21.15.17:0/1086837806 shutdown_connections 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 --2- 172.21.15.17:0/1086837806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60810d970 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 --2- 172.21.15.17:0/1086837806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60810deb0 0x7fe608110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 --2- 172.21.15.17:0/1086837806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe608104900 0x7fe608104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 -- 172.21.15.17:0/1086837806 >> 172.21.15.17:0/1086837806 conn(0x7fe608079760 msgr2=0x7fe608079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:42.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 -- 172.21.15.17:0/1086837806 shutdown_connections 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 -- 172.21.15.17:0/1086837806 wait complete. 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 Processor -- start 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.955+0000 7fe6102ba640 1 -- start start 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe6102ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe608104900 0x7fe60819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe6102ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe6102ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60810deb0 0x7fe60819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe6102ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe608113950 con 0x7fe608105250 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe6102ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081137d0 con 0x7fe608104900 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe6102ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe608113ad0 con 0x7fe60810deb0 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46420/0 (socket says 172.21.15.17:46420) 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 -- 172.21.15.17:0/3910068864 learned_addr learned my addr 172.21.15.17:0/3910068864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60e857640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60810deb0 0x7fe60819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60e056640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe608104900 0x7fe60819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 -- 172.21.15.17:0/3910068864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60810deb0 msgr2=0x7fe60819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60810deb0 0x7fe60819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 -- 172.21.15.17:0/3910068864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe608104900 msgr2=0x7fe60819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe608104900 0x7fe60819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.956+0000 7fe60d855640 1 -- 172.21.15.17:0/3910068864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6081a02d0 con 0x7fe608105250 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.957+0000 7fe60d855640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60819a9c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8005940 tx=0x7fe5f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.957+0000 7fe5ff7fe640 1 -- 172.21.15.17:0/3910068864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f803f030 con 0x7fe608105250 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.957+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6081a0560 con 0x7fe608105250 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.957+0000 7fe5ff7fe640 1 -- 172.21.15.17:0/3910068864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5f8003c90 con 0x7fe608105250 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.957+0000 7fe5ff7fe640 1 -- 172.21.15.17:0/3910068864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8035070 con 0x7fe608105250 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.957+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6081a0a90 con 0x7fe608105250 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.959+0000 7fe61682e740 1 Processor -- start 2024-09-21T06:21:42.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 -- start start 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe5ff7fe640 1 -- 172.21.15.17:0/3910068864 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe5f8042030 con 0x7fe608105250 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40515d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b40515d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40515dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b4050d3dd0 con 0x55b404d955f0 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b4050c3200 con 0x55b404d8d410 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe61682e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b4050c7010 con 0x55b404db62d0 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40515dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40515dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46430/0 (socket says 172.21.15.17:46430) 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe60d855640 1 -- 172.21.15.17:0/3317376 learned_addr learned my addr 172.21.15.17:0/3317376 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe60e857640 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40515d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.960+0000 7fe60e056640 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b40515d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e857640 1 -- 172.21.15.17:0/3317376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 msgr2=0x55b40515d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e857640 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b40515d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e857640 1 -- 172.21.15.17:0/3317376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 msgr2=0x55b40515dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e857640 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40515dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e857640 1 -- 172.21.15.17:0/3317376 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b404e218b0 con 0x55b404db62d0 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60d855640 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40515dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe5ff7fe640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5f40b6540 0x7fe5f40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e056640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5f40b6540 0x7fe5f40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe5ff7fe640 1 -- 172.21.15.17:0/3910068864 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe5f8107bb0 con 0x7fe608105250 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe60e857640 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40515d310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe60000ada0 tx=0x7fe60000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df6208a1bcca7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe5fcd9a640 1 -- 172.21.15.17:0/3317376 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600003b70 con 0x55b404db62d0 2024-09-21T06:21:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe5fcd9a640 1 -- 172.21.15.17:0/3317376 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe600003d10 con 0x55b404db62d0 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.961+0000 7fe5fcd9a640 1 -- 172.21.15.17:0/3317376 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6000109c0 con 0x55b404db62d0 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 -- 172.21.15.17:0/3317376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 msgr2=0x55b40515d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe60e056640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5f40b6540 0x7fe5f40b8a50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55b40515bf90 tx=0x7fe604005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40515d310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe60000ada0 tx=0x7fe60000f790 comp rx=0 tx=0).stop 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 -- 172.21.15.17:0/3317376 shutdown_connections 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40515dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b40515d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 --2- 172.21.15.17:0/3317376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40515d310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 -- 172.21.15.17:0/3317376 >> 172.21.15.17:0/3317376 conn(0x55b404daa6c0 msgr2=0x55b40515b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 -- 172.21.15.17:0/3317376 shutdown_connections 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.962+0000 7fe61682e740 1 -- 172.21.15.17:0/3317376 wait complete. 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 -- start start 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 Processor -- start 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b405168f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b405169480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404db62d0 0x55b405174de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b404f24810 con 0x55b404d955f0 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b40505e080 con 0x55b404db62d0 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55b40516baf0 con 0x55b404d8d410 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe61682e740 10 client.0 _ll_register_callbacks cb 0x55b40506e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b405169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b405169480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46438/0 (socket says 172.21.15.17:46438) 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.963+0000 7fe60d855640 1 -- 172.21.15.17:0/2836833097 learned_addr learned my addr 172.21.15.17:0/2836833097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60e056640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b405168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60e857640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404db62d0 0x55b405174de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60d855640 1 -- 172.21.15.17:0/2836833097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 msgr2=0x55b405168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60d855640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b405168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60d855640 1 -- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404db62d0 msgr2=0x55b405174de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60d855640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404db62d0 0x55b405174de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60d855640 1 -- 172.21.15.17:0/2836833097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b405068460 con 0x55b404d955f0 2024-09-21T06:21:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60e857640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404db62d0 0x55b405174de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:21:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe60d855640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b405169480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80cacd0 tx=0x7fe5f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8719186964c1611e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/2836833097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8049070 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/2836833097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe5f80d7140 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe600003d10 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/2836833097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe5f80c9900 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe61682e740 10 client.15942 fetch_fsmap learned FSMap version 35 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.964+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b405177b50 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/2836833097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe600003d10 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/2836833097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fe5f80cece0 con 0x55b404d955f0 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe61682e740 10 client.15942 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe61682e740 10 client.15942 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe61682e740 20 client.15942 populate_metadata read hostname 'smithi017' 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe61682e740 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d74c50 0x55b40517b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe61682e740 4 client.15942 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:42.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4050d5d20 con 0x55b404d74c50 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.965+0000 7fe60e056640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d74c50 0x55b40517b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.966+0000 7fe60e056640 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d74c50 0x55b40517b0e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81cf0e2e7a48440 server_cookie=89589fb98d5c708c in_seq=0 out_seq=0 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.966+0000 7fe5f1ffb640 10 client.15942 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.966+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/2836833097 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4050d5d20 con 0x55b404d74c50 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.966+0000 7fe5f1ffb640 10 client.15942 handle_command_reply: tid=0 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.966+0000 7fe61682e740 1 client.15942 shutdown 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 msgr2=0x55b405169480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b405169480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80cacd0 tx=0x7fe5f8009260 comp rx=0 tx=0).stop 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 shutdown_connections 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d74c50 0x55b40517b0e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b405169480 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404db62d0 0x55b405174de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe5f1ffb640 0 client.15942 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 --2- 172.21.15.17:0/2836833097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b405168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 >> 172.21.15.17:0/2836833097 conn(0x55b404daa6c0 msgr2=0x55b4051604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 shutdown_connections 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 1 -- 172.21.15.17:0/2836833097 wait complete. 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.967+0000 7fe61682e740 20 client.15942 trim_cache size 0 max 16384 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.984+0000 7fe61682e740 1 Processor -- start 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.984+0000 7fe61682e740 1 -- start start 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe61682e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b40515ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe61682e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 0x55b405160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe61682e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404db62d0 0x55b405165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe61682e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081b3370 con 0x55b404db62d0 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe61682e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081b0b80 con 0x55b404d955f0 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe61682e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081ae9d0 con 0x55b404d8d410 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60d855640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 0x55b405160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404db62d0 0x55b405165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60d855640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 0x55b405160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.17:51572/0 (socket says 172.21.15.17:51572) 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60d855640 1 -- 172.21.15.17:0/1489804843 learned_addr learned my addr 172.21.15.17:0/1489804843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e056640 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b40515ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 -- 172.21.15.17:0/1489804843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 msgr2=0x55b40515ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b40515ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 -- 172.21.15.17:0/1489804843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 msgr2=0x55b405160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 0x55b405160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 -- 172.21.15.17:0/1489804843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b405155490 con 0x55b404db62d0 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60d855640 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 0x55b405160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:42.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe60e857640 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404db62d0 0x55b405165ef0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe60000ada0 tx=0x7fe60000afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd13c70706bd9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.985+0000 7fe5f3fff640 1 -- 172.21.15.17:0/1489804843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600026020 con 0x55b404db62d0 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe5f3fff640 1 -- 172.21.15.17:0/1489804843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe600004c00 con 0x55b404db62d0 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe5f3fff640 1 -- 172.21.15.17:0/1489804843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60001d040 con 0x55b404db62d0 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 -- 172.21.15.17:0/1489804843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404db62d0 msgr2=0x55b405165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404db62d0 0x55b405165ef0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe60000ada0 tx=0x7fe60000afd0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 -- 172.21.15.17:0/1489804843 shutdown_connections 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404db62d0 0x55b405165ef0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d955f0 0x55b405160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 --2- 172.21.15.17:0/1489804843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404d8d410 0x55b40515ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 -- 172.21.15.17:0/1489804843 >> 172.21.15.17:0/1489804843 conn(0x55b404daa6c0 msgr2=0x55b405160410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 -- 172.21.15.17:0/1489804843 shutdown_connections 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.986+0000 7fe61682e740 1 -- 172.21.15.17:0/1489804843 wait complete. 2024-09-21T06:21:42.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 -- start start 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 Processor -- start 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b405171380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40516d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40516dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081af040 con 0x55b404d955f0 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081b04b0 con 0x55b404d8d410 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081af710 con 0x55b404db62d0 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe61682e740 10 client.0 _ll_register_callbacks cb 0x7fe5f810b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40516d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe60d855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40516d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46464/0 (socket says 172.21.15.17:46464) 2024-09-21T06:21:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe60d855640 1 -- 172.21.15.17:0/1293403630 learned_addr learned my addr 172.21.15.17:0/1293403630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.987+0000 7fe60e056640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b405171380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60e857640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40516dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60d855640 1 -- 172.21.15.17:0/1293403630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 msgr2=0x55b40516dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60d855640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40516dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60d855640 1 -- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 msgr2=0x55b405171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60d855640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b405171380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60d855640 1 -- 172.21.15.17:0/1293403630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b40516e370 con 0x55b404d955f0 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60e056640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b405171380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60e857640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40516dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:21:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe60d855640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40516d840 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80cacd0 tx=0x7fe5f80c9f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74d099f2834d3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/1293403630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8049040 con 0x55b404d955f0 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/1293403630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe5f8003800 con 0x55b404d955f0 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe600004c00 con 0x55b404d955f0 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/1293403630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe5f80c91d0 con 0x55b404d955f0 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe61682e740 10 client.15948 fetch_fsmap learned FSMap version 35 2024-09-21T06:21:42.427 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 35, 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "leader": 24656, 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "set_version": 36, 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "sets": {} 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b4051eac80 con 0x55b404d955f0 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/1293403630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe600004c00 con 0x55b404d955f0 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/1293403630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fe5f80cece0 con 0x55b404d955f0 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.988+0000 7fe61682e740 10 client.15948 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe61682e740 10 client.15948 resolve_mds: validated gid 24656 aka daemon mds.b 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe61682e740 20 client.15948 populate_metadata read hostname 'smithi017' 2024-09-21T06:21:42.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe61682e740 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d4a000 0x55b4051ed320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe61682e740 4 client.15948 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 --> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55b4050d17d0 con 0x55b404d4a000 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe60e056640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d4a000 0x55b4051ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe5f1ffb640 10 client.15948 ms_handle_connect on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.989+0000 7fe60e056640 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d4a000 0x55b4051ed320 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf266f39ec0fcda server_cookie=2f54f12ea5f936ca in_seq=0 out_seq=0 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe5f1ffb640 1 -- 172.21.15.17:0/1293403630 <== mds.0 v2:172.21.15.81:6838/84773565 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55b4050d17d0 con 0x55b404d4a000 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe5f1ffb640 10 client.15948 handle_command_reply: tid=0 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 client.15948 shutdown 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 msgr2=0x55b40516d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40516d840 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80cacd0 tx=0x7fe5f80c9f00 comp rx=0 tx=0).stop 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 shutdown_connections 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:6838/84773565,v1:172.21.15.81:6839/84773565] conn(0x55b404d4a000 0x55b4051ed320 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b404d955f0 0x55b40516d840 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b404db62d0 0x55b40516dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 --2- 172.21.15.17:0/1293403630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b404d8d410 0x55b405171380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe5f1ffb640 0 client.15948 ms_handle_reset on v2:172.21.15.81:6838/84773565 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 >> 172.21.15.17:0/1293403630 conn(0x55b404daa6c0 msgr2=0x55b40515ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 shutdown_connections 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 1 -- 172.21.15.17:0/1293403630 wait complete. 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.990+0000 7fe61682e740 20 client.15948 trim_cache size 0 max 16384 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5f40b6540 msgr2=0x7fe5f40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5f40b6540 0x7fe5f40b8a50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55b40515bf90 tx=0x7fe604005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 msgr2=0x7fe60819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60819a9c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8005940 tx=0x7fe5f80042f0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 shutdown_connections 2024-09-21T06:21:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe5f40b6540 0x7fe5f40b8a50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe608105250 0x7fe60819a9c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60810deb0 0x7fe60819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 --2- 172.21.15.17:0/3910068864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe608104900 0x7fe60819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 >> 172.21.15.17:0/3910068864 conn(0x7fe608079760 msgr2=0x7fe6080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 shutdown_connections 2024-09-21T06:21:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:41.991+0000 7fe6102ba640 1 -- 172.21.15.17:0/3910068864 wait complete. 2024-09-21T06:21:42.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:42 smithi081 ceph-mon[33870]: pgmap v642: 129 pgs: 129 active+clean; 249 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 767 KiB/s wr, 376 op/s 2024-09-21T06:21:42.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:42 smithi089 ceph-mon[33879]: pgmap v642: 129 pgs: 129 active+clean; 249 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 767 KiB/s wr, 376 op/s 2024-09-21T06:21:42.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:42 smithi017 ceph-mon[31080]: pgmap v642: 129 pgs: 129 active+clean; 249 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 767 KiB/s wr, 376 op/s 2024-09-21T06:21:44.485 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T06:21:44.485 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:21:44.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.620+0000 7fbf78d58640 1 -- 172.21.15.17:0/2794107863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf741025c0 msgr2=0x7fbf74102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.620+0000 7fbf78d58640 1 --2- 172.21.15.17:0/2794107863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf741025c0 0x7fbf74102a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009900 tx=0x7fbf6402a410 comp rx=0 tx=0).stop 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.620+0000 7fbf78d58640 1 -- 172.21.15.17:0/2794107863 shutdown_connections 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 --2- 172.21.15.17:0/2794107863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf74103fe0 0x7fbf7410a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 --2- 172.21.15.17:0/2794107863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf74103640 0x7fbf74103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 --2- 172.21.15.17:0/2794107863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf741025c0 0x7fbf74102a30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 -- 172.21.15.17:0/2794107863 >> 172.21.15.17:0/2794107863 conn(0x7fbf740fdf00 msgr2=0x7fbf741003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 -- 172.21.15.17:0/2794107863 shutdown_connections 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 -- 172.21.15.17:0/2794107863 wait complete. 2024-09-21T06:21:44.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 Processor -- start 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.621+0000 7fbf78d58640 1 -- start start 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf741025c0 0x7fbf74199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 0x7fbf7419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf74103fe0 0x7fbf7419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410e110 con 0x7fbf74103640 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410df90 con 0x7fbf74103fe0 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410e290 con 0x7fbf741025c0 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 0x7fbf7419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 0x7fbf7419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46488/0 (socket says 172.21.15.17:46488) 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 -- 172.21.15.17:0/3775560189 learned_addr learned my addr 172.21.15.17:0/3775560189 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf7259c640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf741025c0 0x7fbf74199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf72d9d640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf74103fe0 0x7fbf7419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 -- 172.21.15.17:0/3775560189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf741025c0 msgr2=0x7fbf74199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf741025c0 0x7fbf74199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 -- 172.21.15.17:0/3775560189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf74103fe0 msgr2=0x7fbf7419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf74103fe0 0x7fbf7419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 -- 172.21.15.17:0/3775560189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7419b860 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf71d9b640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 0x7fbf7419a520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c920 tx=0x7fbf6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68007c70 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf68007e10 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7419bb50 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.622+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68018710 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.623+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a22d0 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.623+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf741a24a0 con 0x7fbf74103640 2024-09-21T06:21:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.625+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fbf6800f450 con 0x7fbf74103640 2024-09-21T06:21:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.626+0000 7fbf637fe640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf5c0b6510 0x7fbf5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.626+0000 7fbf7259c640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf5c0b6510 0x7fbf5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.626+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fbf680e7b90 con 0x7fbf74103640 2024-09-21T06:21:44.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.627+0000 7fbf7259c640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf5c0b6510 0x7fbf5c0b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf64000c00 tx=0x7fbf64005720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.629+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf68014030 con 0x7fbf74103640 2024-09-21T06:21:44.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:44 smithi081 ceph-mon[33870]: pgmap v643: 129 pgs: 129 active+clean; 247 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 889 KiB/s wr, 350 op/s 2024-09-21T06:21:44.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.819+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf741a2670 con 0x7fbf74103640 2024-09-21T06:21:44.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.820+0000 7fbf637fe640 1 -- 172.21.15.17:0/3775560189 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24775 (secure 0 0 0) 0x7fbf680ae120 con 0x7fbf74103640 2024-09-21T06:21:44.822 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:21:44.823 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:11:47.669754+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf5c0b6510 msgr2=0x7fbf5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf5c0b6510 0x7fbf5c0b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf64000c00 tx=0x7fbf64005720 comp rx=0 tx=0).stop 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 msgr2=0x7fbf7419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 0x7fbf7419a520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c920 tx=0x7fbf6800cde0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 shutdown_connections 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fbf5c0b6510 0x7fbf5c0b8a20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf74103640 0x7fbf7419a520 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf74103fe0 0x7fbf7419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 --2- 172.21.15.17:0/3775560189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf741025c0 0x7fbf74199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 >> 172.21.15.17:0/3775560189 conn(0x7fbf740fdf00 msgr2=0x7fbf7406b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 shutdown_connections 2024-09-21T06:21:44.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.823+0000 7fbf78d58640 1 -- 172.21.15.17:0/3775560189 wait complete. 2024-09-21T06:21:44.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:44 smithi017 ceph-mon[31080]: pgmap v643: 129 pgs: 129 active+clean; 247 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 889 KiB/s wr, 350 op/s 2024-09-21T06:21:44.837 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:05:35.514229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:10:12.685383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:10:15.181624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T06:10:21.569947+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T06:21:44.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:21:44.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:44 smithi089 ceph-mon[33879]: pgmap v643: 129 pgs: 129 active+clean; 247 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 889 KiB/s wr, 350 op/s 2024-09-21T06:21:44.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 -- 172.21.15.17:0/1531675786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103620 msgr2=0x7f922c103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 --2- 172.21.15.17:0/1531675786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103620 0x7f922c103a30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9214009900 tx=0x7f921402a410 comp rx=0 tx=0).stop 2024-09-21T06:21:44.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 -- 172.21.15.17:0/1531675786 shutdown_connections 2024-09-21T06:21:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 --2- 172.21.15.17:0/1531675786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103620 0x7f922c103a30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 --2- 172.21.15.17:0/1531675786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f922c103fc0 0x7f922c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 --2- 172.21.15.17:0/1531675786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922c1025a0 0x7f922c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 -- 172.21.15.17:0/1531675786 >> 172.21.15.17:0/1531675786 conn(0x7f922c0fdf00 msgr2=0x7f922c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.953+0000 7f92314bd640 1 -- 172.21.15.17:0/1531675786 shutdown_connections 2024-09-21T06:21:44.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 -- 172.21.15.17:0/1531675786 wait complete. 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 Processor -- start 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 -- start start 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922c1025a0 0x7f922c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f922c103620 0x7f922c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 0x7f922c19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f922c10e090 con 0x7f922c103fc0 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f922c10df10 con 0x7f922c1025a0 2024-09-21T06:21:44.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.954+0000 7f92314bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f922c10e210 con 0x7f922c103620 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 0x7f922c19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 0x7f922c19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46518/0 (socket says 172.21.15.17:46518) 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 -- 172.21.15.17:0/2674108565 learned_addr learned my addr 172.21.15.17:0/2674108565 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922affd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922c1025a0 0x7f922c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f9223fff640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f922c103620 0x7f922c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 -- 172.21.15.17:0/2674108565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f922c103620 msgr2=0x7f922c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f922c103620 0x7f922c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 -- 172.21.15.17:0/2674108565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922c1025a0 msgr2=0x7f922c199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922c1025a0 0x7f922c199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 -- 172.21.15.17:0/2674108565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c19b7f0 con 0x7f922c103fc0 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f922b7fe640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 0x7f922c19b060 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f922400cce0 tx=0x7f922400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922400f450 con 0x7f922c103fc0 2024-09-21T06:21:44.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f922400fa80 con 0x7f922c103fc0 2024-09-21T06:21:44.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c19bae0 con 0x7f922c103fc0 2024-09-21T06:21:44.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9224018ad0 con 0x7f922c103fc0 2024-09-21T06:21:44.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.955+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c1a2080 con 0x7f922c103fc0 2024-09-21T06:21:44.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.957+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c1a2340 con 0x7f922c103fc0 2024-09-21T06:21:44.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.959+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f922400f5f0 con 0x7f922c103fc0 2024-09-21T06:21:44.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.960+0000 7f9228ff9640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92180b6510 0x7f92180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.960+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f92240e7f60 con 0x7f922c103fc0 2024-09-21T06:21:44.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.960+0000 7f922affd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92180b6510 0x7f92180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.961+0000 7f922affd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92180b6510 0x7f92180b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f921c00bbe0 tx=0x7f921c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:44.963+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9224014030 con 0x7f922c103fc0 2024-09-21T06:21:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.152+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f922c1a2510 con 0x7f922c103fc0 2024-09-21T06:21:45.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.153+0000 7f9228ff9640 1 -- 172.21.15.17:0/2674108565 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f92240ae490 con 0x7f922c103fc0 2024-09-21T06:21:45.155 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-21T06:21:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92180b6510 msgr2=0x7f92180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92180b6510 0x7f92180b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f921c00bbe0 tx=0x7f921c00b390 comp rx=0 tx=0).stop 2024-09-21T06:21:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 msgr2=0x7f922c19b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 0x7f922c19b060 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f922400cce0 tx=0x7f922400a620 comp rx=0 tx=0).stop 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 shutdown_connections 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f92180b6510 0x7f92180b8a20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f922c103fc0 0x7f922c19b060 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f922c103620 0x7f922c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 --2- 172.21.15.17:0/2674108565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f922c1025a0 0x7f922c199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 >> 172.21.15.17:0/2674108565 conn(0x7f922c0fdf00 msgr2=0x7f922c06ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 shutdown_connections 2024-09-21T06:21:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.155+0000 7f92314bd640 1 -- 172.21.15.17:0/2674108565 wait complete. 2024-09-21T06:21:45.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:21:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1137044454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc1050c0 msgr2=0x7f72cc10ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1137044454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc1050c0 0x7f72cc10ba60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009ca0 tx=0x7f72c402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1137044454 shutdown_connections 2024-09-21T06:21:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1137044454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc1050c0 0x7f72cc10ba60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1137044454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc104720 0x7f72cc104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1137044454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc1036a0 0x7f72cc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1137044454 >> 172.21.15.17:0/1137044454 conn(0x7f72cc0fefe0 msgr2=0x7f72cc101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1137044454 shutdown_connections 2024-09-21T06:21:45.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.283+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1137044454 wait complete. 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 Processor -- start 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 -- start start 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc1036a0 0x7f72cc199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 0x7f72cc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc1050c0 0x7f72cc19afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc10f130 con 0x7f72cc104720 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc10efb0 con 0x7f72cc1050c0 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72d0a4a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc10f2b0 con 0x7f72cc1036a0 2024-09-21T06:21:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72c9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 0x7f72cc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72c9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 0x7f72cc19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46536/0 (socket says 172.21.15.17:46536) 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72c9d9b640 1 -- 172.21.15.17:0/1081333172 learned_addr learned my addr 172.21.15.17:0/1081333172 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.284+0000 7f72cad9d640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc1050c0 0x7f72cc19afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72ca59c640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc1036a0 0x7f72cc199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72c9d9b640 1 -- 172.21.15.17:0/1081333172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc1036a0 msgr2=0x7f72cc199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72c9d9b640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc1036a0 0x7f72cc199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72c9d9b640 1 -- 172.21.15.17:0/1081333172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc1050c0 msgr2=0x7f72cc19afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72c9d9b640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc1050c0 0x7f72cc19afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72c9d9b640 1 -- 172.21.15.17:0/1081333172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc19b770 con 0x7f72cc104720 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72c9d9b640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 0x7f72cc19a430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c890 tx=0x7f72c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0004220 con 0x7f72cc104720 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc19ba60 con 0x7f72cc104720 2024-09-21T06:21:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c0007e40 con 0x7f72cc104720 2024-09-21T06:21:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0004a00 con 0x7f72cc104720 2024-09-21T06:21:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.285+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc1a21e0 con 0x7f72cc104720 2024-09-21T06:21:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.286+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72cc10a870 con 0x7f72cc104720 2024-09-21T06:21:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.288+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f72c00079b0 con 0x7f72cc104720 2024-09-21T06:21:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.289+0000 7f72bb7fe640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f72b40b6510 0x7f72b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.289+0000 7f72ca59c640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f72b40b6510 0x7f72b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.289+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f72c00e7790 con 0x7f72cc104720 2024-09-21T06:21:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.289+0000 7f72ca59c640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f72b40b6510 0x7f72b40b8a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72bc005e10 tx=0x7f72bc005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.292+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72c0014030 con 0x7f72cc104720 2024-09-21T06:21:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.483+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f72cc02e7d0 con 0x7f72cc104720 2024-09-21T06:21:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.484+0000 7f72bb7fe640 1 -- 172.21.15.17:0/1081333172 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f72cc02e7d0 con 0x7f72cc104720 2024-09-21T06:21:45.486 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f72b40b6510 msgr2=0x7f72b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f72b40b6510 0x7f72b40b8a20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72bc005e10 tx=0x7f72bc005da0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 msgr2=0x7f72cc19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 0x7f72cc19a430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c890 tx=0x7f72c000cd50 comp rx=0 tx=0).stop 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 shutdown_connections 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f72b40b6510 0x7f72b40b8a20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72cc104720 0x7f72cc19a430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc1050c0 0x7f72cc19afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 --2- 172.21.15.17:0/1081333172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc1036a0 0x7f72cc199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 >> 172.21.15.17:0/1081333172 conn(0x7f72cc0fefe0 msgr2=0x7f72cc107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 shutdown_connections 2024-09-21T06:21:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.486+0000 7f72d0a4a640 1 -- 172.21.15.17:0/1081333172 wait complete. 2024-09-21T06:21:45.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:21:45.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.615+0000 7f2c0e425640 1 -- 172.21.15.17:0/4293560179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103640 msgr2=0x7f2c08103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.615+0000 7f2c0e425640 1 --2- 172.21.15.17:0/4293560179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103640 0x7f2c08103a50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009900 tx=0x7f2bfc02a410 comp rx=0 tx=0).stop 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 -- 172.21.15.17:0/4293560179 shutdown_connections 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 --2- 172.21.15.17:0/4293560179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103640 0x7f2c08103a50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 --2- 172.21.15.17:0/4293560179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c08103fe0 0x7f2c0810a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 --2- 172.21.15.17:0/4293560179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c081025c0 0x7f2c08102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 -- 172.21.15.17:0/4293560179 >> 172.21.15.17:0/4293560179 conn(0x7f2c080fdf00 msgr2=0x7f2c081003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 -- 172.21.15.17:0/4293560179 shutdown_connections 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 -- 172.21.15.17:0/4293560179 wait complete. 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 Processor -- start 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.616+0000 7f2c0e425640 1 -- start start 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0e425640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c081025c0 0x7f2c08199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0e425640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c08103640 0x7f2c0819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0e425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 0x7f2c0819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0e425640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0810e0c0 con 0x7f2c08103fe0 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0e425640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0810df40 con 0x7f2c08103640 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0e425640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0810e240 con 0x7f2c081025c0 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 0x7f2c0819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 0x7f2c0819b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46560/0 (socket says 172.21.15.17:46560) 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 -- 172.21.15.17:0/3501315459 learned_addr learned my addr 172.21.15.17:0/3501315459 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c07fff640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c081025c0 0x7f2c08199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c077fe640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c08103640 0x7f2c0819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 -- 172.21.15.17:0/3501315459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c081025c0 msgr2=0x7f2c08199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c081025c0 0x7f2c08199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 -- 172.21.15.17:0/3501315459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c08103640 msgr2=0x7f2c0819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c08103640 0x7f2c0819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 -- 172.21.15.17:0/3501315459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0819b890 con 0x7f2c08103fe0 2024-09-21T06:21:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c0c9c2640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 0x7f2c0819b070 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000eaa0 tx=0x7f2c0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.617+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000cdb0 con 0x7f2c08103fe0 2024-09-21T06:21:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.618+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0819bb80 con 0x7f2c08103fe0 2024-09-21T06:21:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.618+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c00005020 con 0x7f2c08103fe0 2024-09-21T06:21:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.618+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000116d0 con 0x7f2c08103fe0 2024-09-21T06:21:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.618+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c081a2270 con 0x7f2c08103fe0 2024-09-21T06:21:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.619+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c081a2440 con 0x7f2c08103fe0 2024-09-21T06:21:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.620+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2c000051d0 con 0x7f2c08103fe0 2024-09-21T06:21:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.621+0000 7f2c057fa640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2bf00b6510 0x7f2bf00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.621+0000 7f2c07fff640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2bf00b6510 0x7f2bf00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.621+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f2c000e7c20 con 0x7f2c08103fe0 2024-09-21T06:21:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.622+0000 7f2c07fff640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2bf00b6510 0x7f2bf00b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009bd0 tx=0x7f2bf8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.624+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c00016030 con 0x7f2c08103fe0 2024-09-21T06:21:45.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:45 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3775560189' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:21:45.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:45 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2674108565' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:21:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.813+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c081a2610 con 0x7f2c08103fe0 2024-09-21T06:21:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.813+0000 7f2c057fa640 1 -- 172.21.15.17:0/3501315459 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f2c000ae120 con 0x7f2c08103fe0 2024-09-21T06:21:45.815 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-21T06:21:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2bf00b6510 msgr2=0x7f2bf00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2bf00b6510 0x7f2bf00b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009bd0 tx=0x7f2bf8005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 msgr2=0x7f2c0819b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 0x7f2c0819b070 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000eaa0 tx=0x7f2c0000ef60 comp rx=0 tx=0).stop 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 shutdown_connections 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f2bf00b6510 0x7f2bf00b8a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c08103fe0 0x7f2c0819b070 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c08103640 0x7f2c0819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 --2- 172.21.15.17:0/3501315459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c081025c0 0x7f2c08199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 >> 172.21.15.17:0/3501315459 conn(0x7f2c080fdf00 msgr2=0x7f2c080ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 shutdown_connections 2024-09-21T06:21:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.816+0000 7f2c0e425640 1 -- 172.21.15.17:0/3501315459 wait complete. 2024-09-21T06:21:45.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:45 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3775560189' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:21:45.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:45 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2674108565' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:21:45.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T06:21:45.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:45 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3775560189' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:21:45.867 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:45 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2674108565' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:21:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 -- 172.21.15.17:0/1783475178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 msgr2=0x7f2688107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 --2- 172.21.15.17:0/1783475178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f2688107bd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f267c009900 tx=0x7f267c02a410 comp rx=0 tx=0).stop 2024-09-21T06:21:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 -- 172.21.15.17:0/1783475178 shutdown_connections 2024-09-21T06:21:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 --2- 172.21.15.17:0/1783475178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f2688107bd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 --2- 172.21.15.17:0/1783475178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2688108310 0x7f268810a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 --2- 172.21.15.17:0/1783475178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2688102c50 0x7f26881050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 -- 172.21.15.17:0/1783475178 >> 172.21.15.17:0/1783475178 conn(0x7f26880fd6c0 msgr2=0x7f26880ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 -- 172.21.15.17:0/1783475178 shutdown_connections 2024-09-21T06:21:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 -- 172.21.15.17:0/1783475178 wait complete. 2024-09-21T06:21:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.944+0000 7f268e769640 1 Processor -- start 2024-09-21T06:21:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 -- start start 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2688102c50 0x7f2688199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f268819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2688108310 0x7f268819b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f268810e0d0 con 0x7f26881056f0 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f268810df50 con 0x7f2688102c50 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268e769640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f268810e250 con 0x7f2688108310 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f268819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f268819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46582/0 (socket says 172.21.15.17:46582) 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 -- 172.21.15.17:0/3745058826 learned_addr learned my addr 172.21.15.17:0/3745058826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f268cd06640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2688108310 0x7f268819b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f2687fff640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2688102c50 0x7f2688199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 -- 172.21.15.17:0/3745058826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2688108310 msgr2=0x7f268819b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2688108310 0x7f268819b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 -- 172.21.15.17:0/3745058826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2688102c50 msgr2=0x7f2688199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2688102c50 0x7f2688199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.945+0000 7f26877fe640 1 -- 172.21.15.17:0/3745058826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268819b880 con 0x7f26881056f0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.946+0000 7f26877fe640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f268819a4b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f267c009230 tx=0x7f267c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.946+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c03f030 con 0x7f26881056f0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.946+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f267c003c90 con 0x7f26881056f0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.946+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268819bb10 con 0x7f26881056f0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.946+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c035070 con 0x7f26881056f0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.946+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268819be20 con 0x7f26881056f0 2024-09-21T06:21:45.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.947+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26881a22f0 con 0x7f26881056f0 2024-09-21T06:21:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.948+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f267c042030 con 0x7f26881056f0 2024-09-21T06:21:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.949+0000 7f26857fa640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26700b6510 0x7f26700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.949+0000 7f2687fff640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26700b6510 0x7f26700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.949+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f267c107bf0 con 0x7f26881056f0 2024-09-21T06:21:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.950+0000 7f2687fff640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26700b6510 0x7f26700b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2678005fd0 tx=0x7f267800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:45.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:45.954+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f267c0d24d0 con 0x7f26881056f0 2024-09-21T06:21:46.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.142+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f26881a24c0 con 0x7f26881056f0 2024-09-21T06:21:46.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.142+0000 7f26857fa640 1 -- 172.21.15.17:0/3745058826 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) ==== 103+0+11 (secure 0 0 0) 0x7f267c0d7410 con 0x7f26881056f0 2024-09-21T06:21:46.144 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-21T06:21:46.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26700b6510 msgr2=0x7f26700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26700b6510 0x7f26700b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2678005fd0 tx=0x7f267800b390 comp rx=0 tx=0).stop 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 msgr2=0x7f268819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f268819a4b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f267c009230 tx=0x7f267c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 shutdown_connections 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f26700b6510 0x7f26700b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26881056f0 0x7f268819a4b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2688108310 0x7f268819b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 --2- 172.21.15.17:0/3745058826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2688102c50 0x7f2688199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 >> 172.21.15.17:0/3745058826 conn(0x7f26880fd6c0 msgr2=0x7f2688107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 shutdown_connections 2024-09-21T06:21:46.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.145+0000 7f268e769640 1 -- 172.21.15.17:0/3745058826 wait complete. 2024-09-21T06:21:46.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:21:46.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3575122891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 msgr2=0x7fe2c810ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:46.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3575122891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c810ba80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009ca0 tx=0x7fe2c002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3575122891 shutdown_connections 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3575122891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c810ba80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3575122891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 0x7fe2c8104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3575122891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c81036c0 0x7fe2c8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3575122891 >> 172.21.15.17:0/3575122891 conn(0x7fe2c80ff020 msgr2=0x7fe2c81014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3575122891 shutdown_connections 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3575122891 wait complete. 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 Processor -- start 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.269+0000 7fe2cdd2b640 1 -- start start 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2cdd2b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c81036c0 0x7fe2c8199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2cdd2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 0x7fe2c819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2cdd2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c819b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:46.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2cdd2b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c810f150 con 0x7fe2c81050e0 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2cdd2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c810efd0 con 0x7fe2c8104740 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2cdd2b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c810f2d0 con 0x7fe2c81036c0 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c819b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c819b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46596/0 (socket says 172.21.15.17:46596) 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 -- 172.21.15.17:0/3546905124 learned_addr learned my addr 172.21.15.17:0/3546905124 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c77fe640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c81036c0 0x7fe2c8199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c6ffd640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 0x7fe2c819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 -- 172.21.15.17:0/3546905124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c81036c0 msgr2=0x7fe2c8199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c81036c0 0x7fe2c8199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 -- 172.21.15.17:0/3546905124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 msgr2=0x7fe2c819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 0x7fe2c819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 -- 172.21.15.17:0/3546905124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c819b7c0 con 0x7fe2c81050e0 2024-09-21T06:21:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c6ffd640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 0x7fe2c819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c7fff640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c819b030 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009dc0 tx=0x7fe2c0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.270+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0004240 con 0x7fe2c81050e0 2024-09-21T06:21:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.271+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c819ba50 con 0x7fe2c81050e0 2024-09-21T06:21:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.271+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2c0040030 con 0x7fe2c81050e0 2024-09-21T06:21:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.271+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0030d80 con 0x7fe2c81050e0 2024-09-21T06:21:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.271+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c81a2230 con 0x7fe2c81050e0 2024-09-21T06:21:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.271+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c810a890 con 0x7fe2c81050e0 2024-09-21T06:21:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.273+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe2c00305c0 con 0x7fe2c81050e0 2024-09-21T06:21:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.274+0000 7fe2c4ff9640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe2b00b6510 0x7fe2b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.274+0000 7fe2c77fe640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe2b00b6510 0x7fe2b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.274+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fe2c0108710 con 0x7fe2c81050e0 2024-09-21T06:21:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.274+0000 7fe2c77fe640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe2b00b6510 0x7fe2b00b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800abe0 tx=0x7fe2b800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:46.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.277+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2c00cebb0 con 0x7fe2c81050e0 2024-09-21T06:21:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.521+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe2c8063fc0 con 0x7fe2c81050e0 2024-09-21T06:21:46.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.530+0000 7fe2c4ff9640 1 -- 172.21.15.17:0/3546905124 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+833522 (secure 0 0 0) 0x7fe2c00d2f90 con 0x7fe2c81050e0 2024-09-21T06:21:46.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:21:46.542 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:46.542 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 18, 2024-09-21T06:21:46.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.543 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 14152, 2024-09-21T06:21:46.543 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2024-09-21T06:21:46.543 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2024-09-21T06:21:46.543 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-21T06:21:46.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-21T06:21:46.544 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2024-09-21T06:21:46.544 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1923174301 2024-09-21T06:21:46.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-21T06:21:46.545 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2024-09-21T06:21:46.545 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1923174301 2024-09-21T06:21:46.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.545 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:46.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.545 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/1923174301", 2024-09-21T06:21:46.546 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2024-09-21T06:02:45.023166+0000", 2024-09-21T06:21:46.546 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:21:46.546 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2024-09-21T06:21:46.546 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2024-09-21T06:21:46.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.546 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24118, 2024-09-21T06:21:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2024-09-21T06:21:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:21:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-21T06:21:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-21T06:21:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.548 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.548 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.548 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:46.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:46.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:21:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.552 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.556 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-21T06:21:46.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:21:46.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.560 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-21T06:21:46.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-21T06:21:46.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-21T06:21:46.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.562 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-21T06:21:46.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.563 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-21T06:21:46.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-21T06:21:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-21T06:21:46.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-21T06:21:46.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-21T06:21:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-21T06:21:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-21T06:21:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-21T06:21:46.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:21:46.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.572 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-21T06:21:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-21T06:21:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-21T06:21:46.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-21T06:21:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:21:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:21:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:21:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:21:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-21T06:21:46.600 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.601 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-21T06:21:46.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-21T06:21:46.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-21T06:21:46.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:46.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-21T06:21:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.620 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nginx": { 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nginx", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nginx container image", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-21T06:21:46.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-21T06:21:46.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:21:46.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-21T06:21:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-21T06:21:46.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-21T06:21:46.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba_metrics": { 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:21:46.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:21:46.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.635 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.642 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.643 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:21:46.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-21T06:21:46.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:21:46.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:21:46.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_keepalive_interval": { 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:21:46.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-21T06:21:46.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.668 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.669 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-21T06:21:46.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.676 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.679 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.680 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:21:46.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:21:46.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:21:46.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.684 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:21:46.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:21:46.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:21:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:21:46.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.696 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:21:46.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:21:46.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "[]", 2024-09-21T06:21:46.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "{}", 2024-09-21T06:21:46.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.712 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:21:46.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:21:46.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:21:46.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:21:46.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:46.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.727 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:21:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "sso_oauth2": { 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sso_oauth2", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.746 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.759 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.760 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.766 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.770 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.771 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.772 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:21:46.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.782 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.786 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.789 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.790 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.798 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.799 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-21T06:21:46.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.805 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-21T06:21:46.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.810 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.816 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-21T06:21:46.819 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.820 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.824 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.828 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.836 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.838 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.841 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-21T06:21:46.846 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.847 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.850 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.851 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.853 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-21T06:21:46.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.863 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.865 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.866 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:46.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.871 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-21T06:21:46.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:21:46.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.886 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.900 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.901 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.901 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.901 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.901 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.903 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max_requests": { 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_requests", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.909 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.910 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.913 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:21:46.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.925 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.926 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.927 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-21T06:21:46.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-21T06:21:46.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-21T06:21:46.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smb", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "internal_store_backend": { 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "internal_store_backend", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:21:46.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.943 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "update_orchestration": { 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "update_orchestration", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.952 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.957 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.958 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.961 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.964 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:21:46.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:21:46.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:21:46.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:21:46.982 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.991 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:46.993 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:46.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:46.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:46.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:46.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.002 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.005 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.006 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.008 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.009 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.014 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.015 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.023 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-21T06:21:47.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:47.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24134, 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.031 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.032 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:21:47.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.037 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-21T06:21:47.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-21T06:21:47.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-21T06:21:47.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:21:47.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:21:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.047 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-21T06:21:47.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-21T06:21:47.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.053 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.057 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-21T06:21:47.062 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.067 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.073 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-21T06:21:47.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-21T06:21:47.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-21T06:21:47.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:21:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nginx": { 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nginx", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nginx container image", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:21:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba_metrics": { 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:21:47.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.092 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.095 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-21T06:21:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-21T06:21:47.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:21:47.103 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.105 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-21T06:21:47.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-21T06:21:47.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-21T06:21:47.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.118 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.119 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-21T06:21:47.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-21T06:21:47.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-21T06:21:47.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:21:47.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_keepalive_interval": { 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.126 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.127 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.131 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.132 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.134 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.136 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:21:47.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:21:47.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.149 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.153 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.154 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:21:47.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "[]", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "{}", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:21:47.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:21:47.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:47.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.177 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.187 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.188 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-21T06:21:47.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.198 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "sso_oauth2": { 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sso_oauth2", 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.204 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.205 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.207 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-21T06:21:47.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:21:47.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.220 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-21T06:21:47.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:21:47.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.232 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.236 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:21:47.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.238 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.240 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-21T06:21:47.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.242 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.245 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.248 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.249 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-21T06:21:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-21T06:21:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-21T06:21:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:21:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-21T06:21:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-21T06:21:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.389 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.392 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "max_requests": { 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_requests", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:47.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.396 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.397 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.399 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.400 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.402 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.403 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:21:47.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.406 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.412 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.413 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.416 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.417 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.420 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-21T06:21:47.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.425 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.427 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-21T06:21:47.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smb", 2024-09-21T06:21:47.437 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "internal_store_backend": { 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "internal_store_backend", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:21:47.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.442 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.445 INFO:teuthology.orchestra.run.smithi017.stdout: "update_orchestration": { 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "update_orchestration", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.450 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.452 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.453 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.457 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.458 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.461 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.463 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.466 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.469 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:21:47.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.480 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.482 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-21T06:21:47.490 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.495 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.497 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.499 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.503 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.504 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-21T06:21:47.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.508 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.509 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.510 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-21T06:21:47.516 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.516 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.516 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.516 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.518 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.522 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:21:47.526 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.533 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.536 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-21T06:21:47.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.540 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2024-09-21T06:21:47.543 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "restful" 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.545 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.546 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.548 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2024-09-21T06:21:47.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2024-09-21T06:21:47.554 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:21:47.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2024-09-21T06:21:47.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.565 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.566 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2024-09-21T06:21:47.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2024-09-21T06:21:47.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.571 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.572 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.575 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.576 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2024-09-21T06:21:47.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-21T06:21:47.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "read", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap", 2024-09-21T06:21:47.579 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap-read" 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.582 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.583 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2024-09-21T06:21:47.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.587 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:21:47.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.590 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.591 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2024-09-21T06:21:47.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:21:47.596 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2024-09-21T06:21:47.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.606 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.608 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nginx": { 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nginx", 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nginx container image", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2024-09-21T06:21:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:21:47.615 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba": { 2024-09-21T06:21:47.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_samba_metrics": { 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:21:47.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:21:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:21:47.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "grafana_dashboards_path": { 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:21:47.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "hw_monitoring": { 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hw_monitoring", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.631 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2024-09-21T06:21:47.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.634 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.635 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.638 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:21:47.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.641 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:21:47.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "oob_default_addr": { 2024-09-21T06:21:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "oob_default_addr", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "169.254.1.1", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:21:47.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2024-09-21T06:21:47.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.656 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_keepalive_interval": { 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:21:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.664 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.666 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.667 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.668 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.671 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2024-09-21T06:21:47.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:21:47.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:21:47.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.686 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:21:47.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:21:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "[]", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "{}", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:21:47.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.714 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:21:47.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.718 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:21:47.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.726 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.727 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.729 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-21T06:21:47.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.736 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.739 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2024-09-21T06:21:47.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.742 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "sso_oauth2": { 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sso_oauth2", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-21T06:21:47.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.754 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2024-09-21T06:21:47.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2024-09-21T06:21:47.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2024-09-21T06:21:47.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.767 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.771 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.772 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.775 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2024-09-21T06:21:47.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.779 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.780 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.781 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2024-09-21T06:21:47.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:21:47.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.787 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.790 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.793 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2024-09-21T06:21:47.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2024-09-21T06:21:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2024-09-21T06:21:47.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2024-09-21T06:21:47.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.803 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.806 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.808 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.809 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.811 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.812 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.819 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.820 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2024-09-21T06:21:47.825 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.830 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.831 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2024-09-21T06:21:47.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:21:47.834 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.836 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2024-09-21T06:21:47.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.839 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.841 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.844 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.847 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.848 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.850 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.854 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.855 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.857 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.858 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.859 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.861 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.865 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.871 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.885 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.889 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2024-09-21T06:21:47.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.897 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.900 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.901 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.904 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2024-09-21T06:21:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2024-09-21T06:21:47.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.913 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.916 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:21:47.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.920 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:21:47.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:21:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2024-09-21T06:21:47.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2024-09-21T06:21:47.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.928 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.933 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2024-09-21T06:21:47.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.944 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max_requests": { 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_requests", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.953 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.957 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.958 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.960 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2024-09-21T06:21:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.964 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.965 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.968 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2024-09-21T06:21:47.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2024-09-21T06:21:47.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2024-09-21T06:21:47.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2024-09-21T06:21:47.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2024-09-21T06:21:47.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2024-09-21T06:21:47.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2024-09-21T06:21:47.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.979 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smb", 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "internal_store_backend": { 2024-09-21T06:21:47.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "internal_store_backend", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.983 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "update_orchestration": { 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "update_orchestration", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:47.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.990 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.991 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.995 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:47.998 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:47.999 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2024-09-21T06:21:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2024-09-21T06:21:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2024-09-21T06:21:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:21:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2024-09-21T06:21:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "sqlite3_killpoint": { 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "dev", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2024-09-21T06:21:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-21T06:21:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2024-09-21T06:21:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-21T06:21:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "squid": [ 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2024-09-21T06:21:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 3, 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4286381233 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1781694430 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-21T06:21:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2386741731 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 894474877 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-21T06:21:48.076 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.535+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe2b00b6510 msgr2=0x7fe2b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.535+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe2b00b6510 0x7fe2b00b8a20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800abe0 tx=0x7fe2b800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.535+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 msgr2=0x7fe2c819b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.535+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c819b030 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0009dc0 tx=0x7fe2c0003ba0 comp rx=0 tx=0).stop 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 shutdown_connections 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fe2b00b6510 0x7fe2b00b8a20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:48.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2c81050e0 0x7fe2c819b030 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c8104740 0x7fe2c819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 --2- 172.21.15.17:0/3546905124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c81036c0 0x7fe2c8199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 >> 172.21.15.17:0/3546905124 conn(0x7fe2c80ff020 msgr2=0x7fe2c8107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 shutdown_connections 2024-09-21T06:21:48.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:21:46.536+0000 7fe2cdd2b640 1 -- 172.21.15.17:0/3546905124 wait complete. 2024-09-21T06:21:48.128 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:21:48.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:21:48.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:46 smithi017 ceph-mon[31080]: pgmap v644: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 713 KiB/s wr, 336 op/s 2024-09-21T06:21:48.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:46 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1081333172' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:46 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3501315459' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:46 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3745058826' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:47 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3546905124' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:21:48.130 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:46 smithi089 ceph-mon[33879]: pgmap v644: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 713 KiB/s wr, 336 op/s 2024-09-21T06:21:48.130 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:46 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1081333172' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.130 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:46 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3501315459' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.130 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:46 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3745058826' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.130 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:47 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3546905124' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:21:48.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:46 smithi081 ceph-mon[33870]: pgmap v644: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 713 KiB/s wr, 336 op/s 2024-09-21T06:21:48.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:46 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1081333172' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:46 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3501315459' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:46 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3745058826' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T06:21:48.131 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:47 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3546905124' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:21:48.399 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:48.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:48 smithi017 ceph-mon[31080]: pgmap v645: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 493 KiB/s wr, 254 op/s 2024-09-21T06:21:48.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:48 smithi081 ceph-mon[33870]: pgmap v645: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 493 KiB/s wr, 254 op/s 2024-09-21T06:21:48.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:48 smithi089 ceph-mon[33879]: pgmap v645: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 493 KiB/s wr, 254 op/s 2024-09-21T06:21:48.962 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:48.962 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 2944, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 448, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.003429818, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000043229, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.002312141, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.004243521, 2024-09-21T06:21:48.963 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001414507 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 144, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:21:48.964 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 105536, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.014520431, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.011177047, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001849237, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 142, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.006551747, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000046139 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:48.965 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 105536 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 192, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 189, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 520128, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 116528, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-21T06:21:48.966 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.031047669, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.015275697, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.021051780, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 188, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.009111561, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000048465 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:48.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 520128, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 116528 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:48.968 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:48.969 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:48.970 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 29, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:48.971 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 968, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 193, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 493016, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 193, 2024-09-21T06:21:48.972 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 193, 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 493016, 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:48.973 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:49.722 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T06:21:49.722 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T06:21:49.723 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T06:21:49.723 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T06:21:49.723 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-21T06:21:49.723 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:21:49.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:21:49.982 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 199, 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 196, 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 522720, 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 120224, 2024-09-21T06:21:50.515 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.032999401, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.015905492, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.021116945, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 195, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.008165633, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000041875 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:50.516 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 522720, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 120224 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 5, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 151, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 106864, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.016192429, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.011597068, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003200184, 2024-09-21T06:21:50.517 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 150, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.010705074, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000071367 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 106864 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.518 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000341071, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000245011, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:50.519 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-21T06:21:50.520 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:50.521 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:50.522 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149007, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:50.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 968, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:50.524 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 200, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 494627, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 200, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 200, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 494627, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:50.525 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:50.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:50.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:50.526 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:50.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:50 smithi081 ceph-mon[33870]: pgmap v646: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 322 KiB/s wr, 182 op/s 2024-09-21T06:21:50.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:50 smithi089 ceph-mon[33879]: pgmap v646: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 322 KiB/s wr, 182 op/s 2024-09-21T06:21:50.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:50 smithi017 ceph-mon[31080]: pgmap v646: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 322 KiB/s wr, 182 op/s 2024-09-21T06:21:51.303 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T06:21:51.303 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T06:21:51.303 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T06:21:51.303 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T06:21:51.304 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-21T06:21:51.304 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:21:51.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:21:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-21T06:21:52.086 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001373524, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000265818, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:52.087 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 193, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 190, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 520400, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 117168, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.031810453, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.016409588, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.019662194, 2024-09-21T06:21:52.088 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 189, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.009158842, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000048459 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 520400, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 117168 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.089 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 5, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 148, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 106336, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.016899128, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.011672859, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003807506, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 147, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.010457881, 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000071142 2024-09-21T06:21:52.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 106336 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-21T06:21:52.091 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:52.092 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:52.093 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:52.094 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 968, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-21T06:21:52.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 194, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 493146, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 194, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 194, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 493146, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:52.096 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:52.097 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:52.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:52.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:52.097 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:52.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:52 smithi081 ceph-mon[33870]: pgmap v647: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 148 KiB/s wr, 117 op/s 2024-09-21T06:21:52.792 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:52 smithi017 ceph-mon[31080]: pgmap v647: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 148 KiB/s wr, 117 op/s 2024-09-21T06:21:52.822 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T06:21:52.822 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T06:21:52.822 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T06:21:52.823 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T06:21:52.823 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-21T06:21:52.823 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:21:52.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:21:52.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:52 smithi089 ceph-mon[33879]: pgmap v647: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 148 KiB/s wr, 117 op/s 2024-09-21T06:21:53.080 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2024-09-21T06:21:53.612 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001334761, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000276482, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 150, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 106592, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.015003558, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.011903517, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001574175, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:53.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 148, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.006612147, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000044676 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 106592 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 205, 2024-09-21T06:21:53.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 200, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 526208, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 121952, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.033865872, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.016550008, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.021645374, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 200, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.013159041, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000065795 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 526208, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 121952 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:53.617 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:53.618 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:53.619 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 29, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:53.620 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 968, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:53.621 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 202, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 494887, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 202, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 202, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 494887, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-21T06:21:53.622 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-21T06:21:53.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:53.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-21T06:21:53.623 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-21T06:21:54.329 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T06:21:54.329 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T06:21:54.329 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T06:21:54.329 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T06:21:54.329 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-21T06:21:54.329 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:21:54.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:21:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:21:54.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:54 smithi017 ceph-mon[31080]: pgmap v648: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 142 KiB/s wr, 56 op/s 2024-09-21T06:21:54.713 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:54 smithi081 ceph-mon[33870]: pgmap v648: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 142 KiB/s wr, 56 op/s 2024-09-21T06:21:54.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:54 smithi089 ceph-mon[33879]: pgmap v648: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 142 KiB/s wr, 56 op/s 2024-09-21T06:21:55.386 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:21:55.386 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:55.386 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 9265, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 10002, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2505140, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 37178442, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 49, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.869489048, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.421588352, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.285933940, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.151356166, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 10000, 2024-09-21T06:21:55.387 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.045252773, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000104525 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8735, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001450330, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000166 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 170429, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 79948, 2024-09-21T06:21:55.388 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 57829275, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 54893158, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 11, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 8.234429494, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 3.729040888, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 6.122026465, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.176268248, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 79947, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.997408191, 2024-09-21T06:21:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000024984 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 235078, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.030983632, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000131 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 54736, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 381536 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 37220, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 32282, 2024-09-21T06:21:55.390 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 15765611, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 13602327, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 12, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 2.275486701, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 1.076747666, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 1.397458895, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.092312992, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 32281, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.811333040, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000025133 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 62404, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.009090410, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000145 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 610384, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 126224 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-21T06:21:55.392 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 9284, 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 6.966924305, 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000750422 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6317, 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.727205439, 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000115118 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 50084, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 42076, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 42076, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 251.271969969, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.005971859 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 8008, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 120, 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 12, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 36, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 7, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 11, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 18, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 26, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 345, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 2, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 2, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 3, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 104265, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 59094, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 8003, 2024-09-21T06:21:55.395 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 731, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 9, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 15915, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 2, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 110, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 139, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 26, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 3004, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 4, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 234, 2024-09-21T06:21:55.396 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 6, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 9056, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 6632, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 4, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:21:55.397 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 115156, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 1990, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 124, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 12217 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 1095, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 4413, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 3226, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 5091, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 444, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 2, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 3263, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 3261, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 9, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 10659, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 123, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 12, 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_started": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_succeeded": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_write_failed": 0 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 51678, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 51678, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 62, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 62, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 6, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 58532608, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4560, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 14.212528246, 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003116782 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 35, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 3396, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 3361, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 37, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 1564, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 1527, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 82, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 8599, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 8517, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 2, 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 3327, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 3325, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 157172, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 375205888 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 60186, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 111, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 50084, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 24, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 3205, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1807, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 131.369527515, 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.072700347 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 420, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.164953865, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000392747 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 34880, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 16.727856595, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000479583 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.406 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.407 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 16, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.020267124, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001266695 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.408 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 472, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.042153567, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002207952 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 237, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.499516081, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002107662 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1458, 2024-09-21T06:21:55.409 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 79.205229546, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.054324574 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 10, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.141265345, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.014126534 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.411 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001330719, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000665359 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.412 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 10, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.023914480, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002391448 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.413 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.002727420, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000909140 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2761, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 22.073227712, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.007994649 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.414 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 3, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 2, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 7853, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 7853, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 551, 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-21T06:21:55.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:55.416 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 294647, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 100, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:55.418 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8856, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 166, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T06:21:55.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 198270, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 1791, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 12648, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 56546345, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 37, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 12648, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 12648, 2024-09-21T06:21:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 65.263755324, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.005160005 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 12648, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 13223 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 12648, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 237, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 12411, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-09-21T06:21:55.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 11, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 237, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 4797, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 165, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 12, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 7035, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 0, 2024-09-21T06:21:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 22, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 4, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-21T06:21:55.423 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-21T06:21:55.424 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 84, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 10, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 709, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 231 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-09-21T06:21:55.425 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 17, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 9, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 6511, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 3261, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:55.426 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 216910, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 56556241, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 216910, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 216910, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 56556241, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.427 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 12648, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 56901706, 2024-09-21T06:21:55.428 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 12648, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 56901706, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 12648, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 12648, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 12648, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 12648, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:55.430 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 3261, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 355361, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 3261, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 237, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 355361, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.431 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x559bc4f315f0": { 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 51678, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 54338304, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 51678, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 4560, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 54338304, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:55.432 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 10675 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:55.433 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:21:56.352 INFO:tasks.check_counter:Daemon mds.b mds.exported=110 2024-09-21T06:21:56.352 INFO:tasks.check_counter:Daemon mds.b mds.imported=26 2024-09-21T06:21:56.352 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1095 2024-09-21T06:21:56.352 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=4413 2024-09-21T06:21:56.352 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=12 2024-09-21T06:21:56.352 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:21:56.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:21:56.599 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:21:56.720 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:56 smithi081 ceph-mon[33870]: pgmap v649: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 KiB/s wr, 34 op/s 2024-09-21T06:21:56.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:56 smithi089 ceph-mon[33879]: pgmap v649: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 KiB/s wr, 34 op/s 2024-09-21T06:21:56.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:56 smithi017 ceph-mon[31080]: pgmap v649: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 KiB/s wr, 34 op/s 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 520, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 522, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 12718711, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 165424, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.057829782, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.024880085, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.016153958, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.012150305, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 520, 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.017741361, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000034118 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 926, 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 910, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 22734471, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 346373, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.116946848, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.043966036, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.053810414, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.019656603, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 910, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.037198577, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000040877 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 588928, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 122496 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 870, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1018, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 12857444, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 608294, 2024-09-21T06:21:57.149 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.125842594, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.053293844, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.032603142, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.030337213, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1016, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.045487536, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000044771 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 331952 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3553, 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.096056416, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000027035 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 2861, 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 2861, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 2861, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 1, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:21:57.155 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-21T06:21:57.156 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-21T06:21:57.157 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_started": 0, 2024-09-21T06:21:57.158 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_succeeded": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_write_failed": 0 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 43085, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 51, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 5, 2024-09-21T06:21:57.159 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 51328417, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 51327279, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 43085 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 13, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 2975, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 2962, 2024-09-21T06:21:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 11, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 202, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 191, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 2861, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 8345, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 5484, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 121956, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 331366400 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-21T06:21:57.161 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.163 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.166 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.170 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 1660, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:57.176 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 215231, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 67, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8856, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 166, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 1989632, 2024-09-21T06:21:57.177 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 11572, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2093, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2093, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2093, 2024-09-21T06:21:57.178 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.185977383, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000566639 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2093, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2094 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2093, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2093, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1210, 2024-09-21T06:21:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 881, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-21T06:21:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-21T06:21:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 84, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 8, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 8, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-21T06:21:57.182 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:21:57.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2312, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 48088467, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2312, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:57.184 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2312, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 48088467, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:57.185 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2093, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 47135262, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2093, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 47135262, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-21T06:21:57.186 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2093, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2093, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2093, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2093, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:57.188 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x55dc2a7cd2b0": { 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:57.189 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:57.190 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:21:58.001 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T06:21:58.001 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T06:21:58.002 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T06:21:58.002 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T06:21:58.002 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-21T06:21:58.002 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:21:58.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:21:58.246 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1405, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1407, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 71717558, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 446797, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 8, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.175229726, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.063521040, 2024-09-21T06:21:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.065633846, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.035458445, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1405, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.048833444, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000034756 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 486, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 631, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 71510044, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 486876, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.086836781, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.024661496, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.046027639, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.011780347, 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 630, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.023805983, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000037787 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 333856 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 675, 2024-09-21T06:21:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 661, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 64426705, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 266730, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.100836948, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.032265285, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.063239179, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.009722647, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 660, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.022813018, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000034565 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 585440, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 120768 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-21T06:21:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3906, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.102830978, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000026326 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-21T06:21:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-21T06:21:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 4756, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 510, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 4246, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 4026, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-21T06:21:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-21T06:21:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:21:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-21T06:21:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:21:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_started": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_succeeded": 0, 2024-09-21T06:21:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "uninline_write_failed": 0 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 152667, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-21T06:21:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 140, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 14, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 62300829, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 210521757, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 210520619, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 152667 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 16, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 7704, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 7688, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 28, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 446, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 418, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 4756, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 17655, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 12899, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 128344, 2024-09-21T06:21:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 340713472 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.790 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-21T06:21:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.793 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.794 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-21T06:21:58.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.798 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.799 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-21T06:21:58.800 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:21:58.802 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 1, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 0, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 1, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-21T06:21:58.803 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 1663, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:21:58.804 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:21:58.805 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:21:58.806 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 239448, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 79, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8856, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 166, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:21:58.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 3308022, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 19520, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-21T06:21:58.808 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2345, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2345, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2345, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.747966647, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000745401 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2345, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2346 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.809 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2345, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2345, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1342, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 1001, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-21T06:21:58.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-21T06:21:58.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:21:58.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-21T06:21:58.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:21:58.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-21T06:21:58.812 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-21T06:21:58.812 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-21T06:21:58.812 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-21T06:21:58.813 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 84, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 2, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 11, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 11, 2024-09-21T06:21:58.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-21T06:21:58.815 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-21T06:21:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:21:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-21T06:21:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-21T06:21:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-21T06:21:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-21T06:21:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.818 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:21:58.818 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:58.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:21:58.818 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2562, 2024-09-21T06:21:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 207409752, 2024-09-21T06:21:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2562, 2024-09-21T06:21:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2562, 2024-09-21T06:21:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 207409752, 2024-09-21T06:21:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.821 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-21T06:21:58.821 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:58.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:21:58.821 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2345, 2024-09-21T06:21:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 206413279, 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2345, 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 206413279, 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.824 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-21T06:21:58.824 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:58.824 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-21T06:21:58.824 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:58.824 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2345, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2345, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2345, 2024-09-21T06:21:58.825 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2345, 2024-09-21T06:21:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:58.827 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:58.828 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x56198beab5f0": { 2024-09-21T06:21:58.829 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:21:58.830 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-21T06:21:58.830 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:21:58.830 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-21T06:21:58.830 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-21T06:21:58.830 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:21:58.830 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-21T06:21:58.831 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:21:58.831 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:21:58.831 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-21T06:21:58.831 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-21T06:21:58.831 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:21:58.831 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:21:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:21:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:21:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:21:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: "trackedop": { 2024-09-21T06:21:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-21T06:21:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:21:58.833 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:21:59.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:21:58 smithi081 ceph-mon[33870]: pgmap v650: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-09-21T06:21:59.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:21:58 smithi089 ceph-mon[33879]: pgmap v650: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-09-21T06:21:59.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:21:58 smithi017 ceph-mon[31080]: pgmap v650: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-09-21T06:21:59.613 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T06:21:59.613 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T06:21:59.613 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T06:21:59.613 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-21T06:21:59.613 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-21T06:21:59.613 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:21:59.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:21:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:22:00.401 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:22:00.401 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:22:00.401 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 4, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2944, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 448, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.002890149, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000046713, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.002135816, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3, 2024-09-21T06:22:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.003812989, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001270996 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 203, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 200, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 523808, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 122784, 2024-09-21T06:22:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.033343147, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.016507728, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.021579599, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 199, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010933012, 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000054939 2024-09-21T06:22:00.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 523808, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 152, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 106944, 2024-09-21T06:22:00.405 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 3, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.011980226, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009235304, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001013450, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 150, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.009053212, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000060354 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:22:00.406 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 106944 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:22:00.407 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:22:00.408 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T06:22:00.409 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 149007, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 30, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:22:00.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 968, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T06:22:00.411 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 204, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 495147, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:00.412 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 204, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 204, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 495147, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:22:00.413 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:22:01.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:00 smithi089 ceph-mon[33879]: pgmap v651: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:22:01.120 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:00 smithi081 ceph-mon[33870]: pgmap v651: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:22:01.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:00 smithi017 ceph-mon[31080]: pgmap v651: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:22:01.149 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T06:22:01.149 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T06:22:01.149 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T06:22:01.149 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T06:22:01.149 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-21T06:22:01.149 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:22:01.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:22:01.409 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:22:02.083 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T06:22:02.083 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:22:02.083 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 4181, 2024-09-21T06:22:02.083 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 4165, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 1601754, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 18108012, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 11, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 7, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.437210663, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.202975324, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.098342897, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.112086377, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 4165, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.289094302, 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000069410 2024-09-21T06:22:02.084 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000176, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000088 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 598944, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 127648 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 206530, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 84218, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 69677492, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 55257440, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 12, 2024-09-21T06:22:02.085 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 7, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 7.923653579, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 3.653530985, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 5.722525753, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.111761278, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 84216, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 1.751097524, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000020792 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 277233, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.034303086, 2024-09-21T06:22:02.086 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000123 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 333600 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 43511, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 36087, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 17231200, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 21611317, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 8, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 6, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 2.740256112, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 1.385166691, 2024-09-21T06:22:02.087 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 1.589329530, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.111449193, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 36085, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.810468583, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000022459 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 73304, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.010752701, 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000146 2024-09-21T06:22:02.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 1, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-MDSRank": { 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 7541, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 5.309931101, 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000704141 2024-09-21T06:22:02.089 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-PurgeQueue": { 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 5243, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.594179510, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000113328 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 58306, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "reply": 55312, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "reply_latency": { 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 55312, 2024-09-21T06:22:02.090 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 204.936614708, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.003705102 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_reply": 0, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "forward": 2994, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_complete": 0, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_keys": 0, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_commit": 119, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_split": 12, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_merge": 0, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes": 21, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_top": 4, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_bottom": 6, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pin_tail": 11, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pinned": 14, 2024-09-21T06:22:02.091 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_expired": 473, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_with_caps": 0, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 0, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "subtrees": 4, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse": 125073, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_hit": 56484, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_forward": 2994, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_discover": 274, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_remote_ino": 0, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_lock": 4, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "load_cent": 0, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "q": 0, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "exported": 123, 2024-09-21T06:22:02.092 INFO:teuthology.orchestra.run.smithi089.stdout: "exported_inodes": 122, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "imported": 39, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "imported_inodes": 3199, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_dir_fetch": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_peer_discover": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rfiles": 4, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rbytes": 234, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rsnaps": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_set_tag": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_file_inodes": 0, 2024-09-21T06:22:02.093 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_inode_file_caps": 20, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_revoke": 8801, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_grant": 5409, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps": 144655, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps_dirty": 1223, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_cap_release": 102, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "process_request_cap_release": 10410 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache": { 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update": 1034, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update_receipt": 5842, 2024-09-21T06:22:02.094 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_try_discover": 4615, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_send_discover": 5218, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_handle_discover": 1240, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_delayed": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_created": 2851, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_enqueued": 2851, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_reintegrated": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_migrated": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_processing": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_started": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_completed": 0, 2024-09-21T06:22:02.095 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_path": 9, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_inode": 11671, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_exportdir": 131, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_flush": 0, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragmentdir": 12, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragstats": 0, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_inodestats": 0, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_started": 0, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_succeeded": 0, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_write_failed": 0 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.096 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log": { 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "evlrg": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "evadd": 43085, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "evex": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "evtrm": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "ev": 43085, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "evexg": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "evexd": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "segadd": 51, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "segex": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "segtrm": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "seg": 51, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "segmjr": 5, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "segexg": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "segexd": 0, 2024-09-21T06:22:02.097 INFO:teuthology.orchestra.run.smithi089.stdout: "expos": 4194304, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "wrpos": 51328417, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "rdpos": 0, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "jlat": { 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 3614, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 8.966824606, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.002481135 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "replayed": 0 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mem": { 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 27, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "ino+": 3016, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "ino-": 2989, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "dir": 33, 2024-09-21T06:22:02.098 INFO:teuthology.orchestra.run.smithi089.stdout: "dir+": 753, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "dir-": 720, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "dn": 114, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "dn+": 8876, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "dn-": 8762, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "cap": 0, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "cap+": 2910, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "cap-": 2910, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "rss": 156356, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "heap": 370028544 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server": { 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_client_request": 66102, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_server_request": 502, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_request": 58306, 2024-09-21T06:22:02.099 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_session": 36, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_peer_request": 3048, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "req_create_latency": { 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1218, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 69.163560206, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.056784532 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getattr_latency": { 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.722344640, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.361172320 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getfilelock_latency": { 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.100 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "req_link_latency": { 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookup_latency": { 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 49372, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 34.771827413, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000704282 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookuphash_latency": { 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupino_latency": { 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupname_latency": { 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupparent_latency": { 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupsnap_latency": { 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lssnap_latency": { 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.103 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mkdir_latency": { 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mknod_latency": { 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mksnap_latency": { 2024-09-21T06:22:02.104 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "req_open_latency": { 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 556, 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 8.836009539, 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.015892103 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "req_readdir_latency": { 2024-09-21T06:22:02.105 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 219, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.156200710, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000713245 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rename_latency": { 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1216, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 87.970388932, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.072344069 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "req_renamesnap_latency": { 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.106 INFO:teuthology.orchestra.run.smithi089.stdout: "req_snapdiff_latency": { 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmdir_latency": { 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmsnap_latency": { 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.107 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmxattr_latency": { 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setattr_latency": { 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setdirlayout_latency": { 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.108 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setfilelock_latency": { 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setlayout_latency": { 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setxattr_latency": { 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "req_symlink_latency": { 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "req_unlink_latency": { 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2729, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 3.316283268, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001215200 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getvxattr_latency": { 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.110 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessions": { 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "session_count": 1, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "session_add": 1, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "session_remove": 0, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_open": 1, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_stale": 0, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "total_load": 9872, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "average_load": 9872, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "avg_session_uptime": 557, 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: "mdthresh_evicted": 0 2024-09-21T06:22:02.111 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:22:02.112 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:22:02.113 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 295639, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 106, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-21T06:22:02.114 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 8856, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 166, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 202537, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 1795, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-21T06:22:02.115 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter": { 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_active": 0, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_laggy": 0, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send": 10150, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send_bytes": 49233480, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_resend": 33, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_reply": 10150, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_latency": { 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 10150, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 41.110011897, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.004050247 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "op_inflight": 0, 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "oplen_avg": { 2024-09-21T06:22:02.116 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 10150, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 10684 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "op": 10150, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "op_r": 155, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "op_w": 9995, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "op_rmw": 0, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "op_pg": 0, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_stat": 0, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_create": 10, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_read": 155, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_write": 3769, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writefull": 119, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writesame": 0, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_append": 0, 2024-09-21T06:22:02.117 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_zero": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_truncate": 12, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_delete": 5725, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_mapext": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_sparse_read": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_clonerange": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_getxattr": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_setxattr": 20, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_rmxattr": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_call": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_watch": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_notify": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:22:02.118 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_other": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_active": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_send": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_resend": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_ping": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_active": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_send": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_resend": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_active": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_send": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_resend": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_active": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_send": 0, 2024-09-21T06:22:02.119 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_resend": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "command_active": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "command_send": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "command_resend": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "map_epoch": 84, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "map_full": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "map_inc": 2, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_sessions": 12, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_open": 12, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_close": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_laggy": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_wr": 664, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_rd": 0, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_del": 210 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.120 INFO:teuthology.orchestra.run.smithi089.stdout: "oft": { 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_objs": 1, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_updates": 0, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_removes": 0 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "purge_queue": { 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops": 0, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops_high_water": 16, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing": 0, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_high_water": 8, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed_ops": 5702, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed": 2851, 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_item_in_journal": 0 2024-09-21T06:22:02.121 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 254218, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 65615271, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 254218, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 254218, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 65615271, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.122 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_bytes": { 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 10150, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 49544239, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 10150, 2024-09-21T06:22:02.123 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 49544239, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_ops": { 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 1024, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 10150, 2024-09-21T06:22:02.124 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 10150, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 10150, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 10150, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 2851, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 310759, 2024-09-21T06:22:02.125 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 2851, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 155, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 310759, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle-0x5628fe2f3520": { 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-21T06:22:02.126 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 43085, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 47134113, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 43085, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 3614, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 47134113, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:02.127 INFO:teuthology.orchestra.run.smithi089.stdout: "trackedop": { 2024-09-21T06:22:02.128 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_ops_count": 11683 2024-09-21T06:22:02.128 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:02.128 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T06:22:03.075 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:02 smithi089 ceph-mon[33879]: pgmap v652: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:22:03.104 INFO:tasks.check_counter:Daemon mds.c mds.exported=123 2024-09-21T06:22:03.104 INFO:tasks.check_counter:Daemon mds.c mds.imported=39 2024-09-21T06:22:03.104 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=1034 2024-09-21T06:22:03.104 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=5842 2024-09-21T06:22:03.104 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=12 2024-09-21T06:22:03.104 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:22:03.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:22:03.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:02 smithi017 ceph-mon[31080]: pgmap v652: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:22:03.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:02 smithi081 ceph-mon[33870]: pgmap v652: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:22:03.353 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:22:03.908 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T06:22:03.908 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:22:03.908 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 232, 2024-09-21T06:22:03.908 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 234, 2024-09-21T06:22:03.908 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 12453973, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 73782, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 7, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 3, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.030577575, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.010381609, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.011455234, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.006091808, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 232, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.008721237, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000037591 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.909 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 1534, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 1681, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 34003378, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 822139, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 6, 2024-09-21T06:22:03.910 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 5, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.188812711, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.075115227, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.057410038, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.043869187, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 1680, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.062621328, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000037274 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.911 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.912 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:22:03.912 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 335856 2024-09-21T06:22:03.912 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.913 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:22:03.913 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 724, 2024-09-21T06:22:03.913 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 710, 2024-09-21T06:22:03.913 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 9100961, 2024-09-21T06:22:03.913 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 283130, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 4, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 3, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.088582101, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.039468564, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.037570490, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.014231277, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 709, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.027391840, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000038634 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.914 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 586416, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 122848 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 1, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-MDSRank": { 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-21T06:22:03.915 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 3797, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.098376559, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000025909 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-PurgeQueue": { 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.916 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "reply": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "reply_latency": { 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_reply": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "forward": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_complete": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_keys": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_commit": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_split": 0, 2024-09-21T06:22:03.917 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_merge": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes": 3344, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_top": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_bottom": 3344, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pin_tail": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pinned": 3344, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_expired": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_with_caps": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "subtrees": 2, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_hit": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_forward": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_discover": 0, 2024-09-21T06:22:03.918 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_remote_ino": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_lock": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "load_cent": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "q": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "exported": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "exported_inodes": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "imported": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "imported_inodes": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_dir_fetch": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_peer_discover": 0, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rfiles": 4, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rbytes": 234, 2024-09-21T06:22:03.919 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rsnaps": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_set_tag": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_file_inodes": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:22:03.920 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_cap_release": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "process_request_cap_release": 0 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache": { 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update_receipt": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_try_discover": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_send_discover": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_handle_discover": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_delayed": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:22:03.921 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_created": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_enqueued": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_reintegrated": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_migrated": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_processing": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_started": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_completed": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_exportdir": 0, 2024-09-21T06:22:03.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_flush": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragstats": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_inodestats": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_started": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_succeeded": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_write_failed": 0 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log": { 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "evlrg": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "evadd": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "evex": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "evtrm": 0, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ev": 51678, 2024-09-21T06:22:03.923 INFO:teuthology.orchestra.run.smithi089.stdout: "evexg": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "evexd": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "segadd": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "segex": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "segtrm": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "seg": 62, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "segmjr": 6, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "segexg": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "segexd": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "expos": 4194304, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "wrpos": 58532608, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "rdpos": 58527936, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "jlat": { 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.924 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "replayed": 51678 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mem": { 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 25, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "ino+": 3364, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "ino-": 3339, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dir": 20, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dir+": 175, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dir-": 155, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dn": 3344, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dn+": 8348, 2024-09-21T06:22:03.925 INFO:teuthology.orchestra.run.smithi089.stdout: "dn-": 5004, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "cap": 0, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "cap+": 0, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "cap-": 0, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "rss": 124460, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "heap": 332443648 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server": { 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_client_request": 0, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_server_request": 0, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_request": 0, 2024-09-21T06:22:03.926 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_session": 0, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_peer_request": 0, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "req_create_latency": { 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getattr_latency": { 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getfilelock_latency": { 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.927 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "req_link_latency": { 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookup_latency": { 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookuphash_latency": { 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.928 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupino_latency": { 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupname_latency": { 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupparent_latency": { 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.929 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupsnap_latency": { 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lssnap_latency": { 2024-09-21T06:22:03.930 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mkdir_latency": { 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mknod_latency": { 2024-09-21T06:22:03.931 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mksnap_latency": { 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "req_open_latency": { 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.932 INFO:teuthology.orchestra.run.smithi089.stdout: "req_readdir_latency": { 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rename_latency": { 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "req_renamesnap_latency": { 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.933 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "req_snapdiff_latency": { 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmdir_latency": { 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmsnap_latency": { 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.934 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmxattr_latency": { 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setattr_latency": { 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setdirlayout_latency": { 2024-09-21T06:22:03.935 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setfilelock_latency": { 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setlayout_latency": { 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setxattr_latency": { 2024-09-21T06:22:03.936 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "req_symlink_latency": { 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "req_unlink_latency": { 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.937 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getvxattr_latency": { 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessions": { 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "session_count": 1, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "session_add": 3, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "session_remove": 2, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_open": 1, 2024-09-21T06:22:03.938 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_stale": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "total_load": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "average_load": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "avg_session_uptime": 1664, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "mdthresh_evicted": 0 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:22:03.939 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:22:03.940 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 215191, 2024-09-21T06:22:03.941 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 66, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 8856, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 166, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-21T06:22:03.942 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 2357149, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 13938, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter": { 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "op_active": 0, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "op_laggy": 0, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send": 2265, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send_bytes": 26, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "op_resend": 4, 2024-09-21T06:22:03.943 INFO:teuthology.orchestra.run.smithi089.stdout: "op_reply": 2265, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op_latency": { 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2265, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 1.325967936, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000585416 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op_inflight": 0, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "oplen_avg": { 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2265, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 2266 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op": 2265, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op_r": 2265, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op_w": 0, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op_rmw": 0, 2024-09-21T06:22:03.944 INFO:teuthology.orchestra.run.smithi089.stdout: "op_pg": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_stat": 1322, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_create": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_read": 940, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_write": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writefull": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writesame": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_append": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_zero": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_truncate": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_delete": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_mapext": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_sparse_read": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_clonerange": 0, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_getxattr": 2, 2024-09-21T06:22:03.945 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_setxattr": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_rmxattr": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_call": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_watch": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_notify": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_other": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_active": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_send": 0, 2024-09-21T06:22:03.946 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_resend": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_ping": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_active": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_send": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_resend": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_active": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_send": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_resend": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_active": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_send": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_resend": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "command_active": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "command_send": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "command_resend": 0, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "map_epoch": 84, 2024-09-21T06:22:03.947 INFO:teuthology.orchestra.run.smithi089.stdout: "map_full": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "map_inc": 2, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_sessions": 8, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_open": 8, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_close": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_laggy": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_wr": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_rd": 2, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_del": 0 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "oft": { 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_objs": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_updates": 0, 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_removes": 0 2024-09-21T06:22:03.948 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "purge_queue": { 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_high_water": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed_ops": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_item_in_journal": 0 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 2486, 2024-09-21T06:22:03.949 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 55320395, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 2486, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2486, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 55320395, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_bytes": { 2024-09-21T06:22:03.950 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 2265, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 54338534, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2265, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 54338534, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.951 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_ops": { 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 1024, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 2265, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 2265, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 2265, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 2265, 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:03.952 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:03.953 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle-0x563faece7520": { 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:03.954 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "trackedop": { 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_ops_count": 0 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:03.955 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T06:22:04.730 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T06:22:04.730 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T06:22:04.730 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T06:22:04.730 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T06:22:04.731 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-21T06:22:04.731 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:22:04.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:22:04.976 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:22:05.096 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:04 smithi089 ceph-mon[33879]: pgmap v653: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T06:22:05.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:04 smithi017 ceph-mon[31080]: pgmap v653: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T06:22:05.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:04 smithi081 ceph-mon[33870]: pgmap v653: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 35328, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 40234, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 9846291, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 58394405, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 11, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 7, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 2.660676747, 2024-09-21T06:22:05.566 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 1.376837326, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 1.240173596, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.172516117, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 40231, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 2.666970947, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000066291 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 62526, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.010038922, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000160 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 599216, 2024-09-21T06:22:05.567 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 126240 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 618783, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 269278, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 206961044, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 157412492, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 12, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 7, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 21.303414105, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 10.180893338, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 15.083587569, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.198472573, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 269279, 2024-09-21T06:22:05.568 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 5.967790270, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000022162 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 851562, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.102476204, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000120 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 337328 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 13311, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 13313, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 4013762, 2024-09-21T06:22:05.569 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 121614595, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 8, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 6, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 1.546345118, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.766359781, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.225792273, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.482378965, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 13311, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 8.328220076, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000625664 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.570 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 1, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-MDSRank": { 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 18682, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 29.142759829, 2024-09-21T06:22:05.571 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001559937 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "finisher-PurgeQueue": { 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "queue_len": 0, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "complete_latency": { 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 8637, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 1.429053889, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000165457 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "request": 154436, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "reply": 116622, 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "reply_latency": { 2024-09-21T06:22:05.572 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 116622, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 1130.218838722, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.009691300 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_reply": 0, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "forward": 37814, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_complete": 0, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_fetch_keys": 0, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_commit": 289, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_split": 20, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_merge": 0, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes": 95, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_top": 43, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_bottom": 40, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pin_tail": 12, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_pinned": 15, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_expired": 9414, 2024-09-21T06:22:05.573 INFO:teuthology.orchestra.run.smithi089.stdout: "inodes_with_caps": 3, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "caps": 3, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "subtrees": 4, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse": 256887, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_hit": 106787, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_forward": 37389, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_discover": 71, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_remote_ino": 0, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "traverse_lock": 6, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "load_cent": 0, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "q": 0, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "exported": 65, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "exported_inodes": 6203, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "imported": 233, 2024-09-21T06:22:05.574 INFO:teuthology.orchestra.run.smithi089.stdout: "imported_inodes": 261, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_dir_fetch": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "openino_peer_discover": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rfiles": 4, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rbytes": 234, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "root_rsnaps": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_set_tag": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "scrub_file_inodes": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_revoke": 28735, 2024-09-21T06:22:05.575 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_grant": 14558, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_trunc": 2, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps": 428857, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_caps_dirty": 7544, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_cap_release": 225, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "process_request_cap_release": 38160 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache": { 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update": 294, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_update_receipt": 25, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_try_discover": 16, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_send_discover": 79, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "dir_handle_discover": 8706, 2024-09-21T06:22:05.576 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays": 3, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_delayed": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_created": 4539, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_enqueued": 4536, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_reintegrated": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "strays_migrated": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_processing": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_started": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_completed": 0, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_path": 9, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_quiesce_inode": 19839, 2024-09-21T06:22:05.577 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_exportdir": 76, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_flush": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragmentdir": 20, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_fragstats": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "ireq_inodestats": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_started": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_succeeded": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "uninline_write_failed": 0 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log": { 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "evlrg": 0, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "evadd": 152667, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "evex": 46719, 2024-09-21T06:22:05.578 INFO:teuthology.orchestra.run.smithi089.stdout: "evtrm": 36871, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "ev": 115796, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "evexg": 0, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "evexd": 9848, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "segadd": 182, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "segex": 54, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "segtrm": 42, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "seg": 140, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "segmjr": 10, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "segexg": 0, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "segexd": 12, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "expos": 62300829, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "wrpos": 210521757, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "rdpos": 0, 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "jlat": { 2024-09-21T06:22:05.579 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 10051, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 30.270412468, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.003011681 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "replayed": 0 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mem": { 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "ino": 36, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "ino+": 7740, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "ino-": 7704, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "dir": 49, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "dir+": 467, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "dir-": 418, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "dn": 95, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "dn+": 19117, 2024-09-21T06:22:05.580 INFO:teuthology.orchestra.run.smithi089.stdout: "dn-": 19022, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "cap": 3, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "cap+": 7704, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "cap-": 7701, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "rss": 168608, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "heap": 389955584 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_server": { 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_client_request": 163353, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "dispatch_server_request": 5885, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_request": 154436, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_client_session": 90, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "handle_peer_request": 11752, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "req_create_latency": { 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 7552, 2024-09-21T06:22:05.581 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 289.122359117, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.038284210 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getattr_latency": { 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 301, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 11.546314252, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.038359848 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getfilelock_latency": { 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.582 INFO:teuthology.orchestra.run.smithi089.stdout: "req_link_latency": { 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookup_latency": { 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 95448, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 396.182398305, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.004150766 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookuphash_latency": { 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.583 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupino_latency": { 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupname_latency": { 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupparent_latency": { 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lookupsnap_latency": { 2024-09-21T06:22:05.584 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "req_lssnap_latency": { 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mkdir_latency": { 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 67, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 19.270452194, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.287618689 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mknod_latency": { 2024-09-21T06:22:05.585 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "req_mksnap_latency": { 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "req_open_latency": { 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 2101, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 24.008211703, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.011427040 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "req_readdir_latency": { 2024-09-21T06:22:05.586 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 253, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.177340824, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000700951 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rename_latency": { 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 7525, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 383.054079811, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.050904196 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "req_renamesnap_latency": { 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "req_snapdiff_latency": { 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.587 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmdir_latency": { 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 67, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 2.104401057, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.031408971 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmsnap_latency": { 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "req_rmxattr_latency": { 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.588 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setattr_latency": { 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setdirlayout_latency": { 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setfilelock_latency": { 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.589 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setlayout_latency": { 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "req_setxattr_latency": { 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "req_symlink_latency": { 2024-09-21T06:22:05.590 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "req_unlink_latency": { 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 3308, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 4.753281459, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.001436904 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "req_getvxattr_latency": { 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.591 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessions": { 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "session_count": 1, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "session_add": 1, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "session_remove": 0, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_open": 1, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "sessions_stale": 0, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "total_load": 15254, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "average_load": 15254, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "avg_session_uptime": 562, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mdthresh_evicted": 0 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:22:05.593 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:22:05.594 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:22:05.595 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:22:05.595 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:22:05.595 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:22:05.595 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:22:05.596 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 279817, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 102, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 8856, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 166, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:22:05.597 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 216147, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 1399, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter": { 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "op_active": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "op_laggy": 0, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send": 25526, 2024-09-21T06:22:05.598 INFO:teuthology.orchestra.run.smithi089.stdout: "op_send_bytes": 213789988, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "op_resend": 32, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "op_reply": 25526, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "op_latency": { 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 25526, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 221.474652468, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.008676433 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "op_inflight": 0, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "oplen_avg": { 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 25526, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 33143 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.599 INFO:teuthology.orchestra.run.smithi089.stdout: "op": 25526, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "op_r": 402, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "op_w": 25124, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "op_rmw": 0, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "op_pg": 0, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_stat": 92, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_create": 4368, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_read": 402, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_write": 10453, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writefull": 259, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_writesame": 0, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_append": 0, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_zero": 0, 2024-09-21T06:22:05.600 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_truncate": 20, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_delete": 9418, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_mapext": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_sparse_read": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_clonerange": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_getxattr": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_setxattr": 6583, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_rmxattr": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_call": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_watch": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_notify": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls": 0, 2024-09-21T06:22:05.601 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "osdop_other": 2, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_active": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_send": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_resend": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "linger_ping": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_active": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_send": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "poolop_resend": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_active": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_send": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "poolstat_resend": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_active": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_send": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "statfs_resend": 0, 2024-09-21T06:22:05.602 INFO:teuthology.orchestra.run.smithi089.stdout: "command_active": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "command_send": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "command_resend": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "map_epoch": 84, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "map_full": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "map_inc": 2, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_sessions": 12, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_open": 12, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_session_close": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_laggy": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_wr": 1151, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_rd": 0, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_del": 395 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.603 INFO:teuthology.orchestra.run.smithi089.stdout: "oft": { 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_objs": 1, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_updates": 0, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "omap_total_removes": 0 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "purge_queue": { 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops": 0, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_ops_high_water": 24, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing": 0, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executing_high_water": 9, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed_ops": 9344, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_executed": 4536, 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: "pq_item_in_journal": 0 2024-09-21T06:22:05.604 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 667418, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 160737982, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 667418, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 667418, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 160737982, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.605 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_bytes": { 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 25526, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 214284236, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 25526, 2024-09-21T06:22:05.606 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 214284236, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-objecter_ops": { 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 1024, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 0, 2024-09-21T06:22:05.607 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 25526, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 25526, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 25526, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 25526, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 4536, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 494248, 2024-09-21T06:22:05.608 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 4536, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 402, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 494248, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-write_buf_throttle-0x561f58a275f0": { 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 3758096384, 2024-09-21T06:22:05.609 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 152667, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 206327453, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 152667, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 10051, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 206327453, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:05.610 INFO:teuthology.orchestra.run.smithi089.stdout: "trackedop": { 2024-09-21T06:22:05.611 INFO:teuthology.orchestra.run.smithi089.stdout: "slow_ops_count": 19874 2024-09-21T06:22:05.611 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:05.611 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T06:22:06.416 INFO:tasks.check_counter:Daemon mds.i mds.exported=65 2024-09-21T06:22:06.416 INFO:tasks.check_counter:Daemon mds.i mds.imported=233 2024-09-21T06:22:06.416 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=294 2024-09-21T06:22:06.416 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=25 2024-09-21T06:22:06.416 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=20 2024-09-21T06:22:06.416 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:22:06.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:22:06.662 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:22:07.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:06 smithi089 ceph-mon[33879]: pgmap v654: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:22:07.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:06 smithi017 ceph-mon[31080]: pgmap v654: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:22:07.198 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T06:22:07.198 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 0, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 2, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 0, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 4, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 0, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.000959242, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.000168861, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:07.199 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 206, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 203, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 524624, 2024-09-21T06:22:07.200 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 124704, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 2, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 1, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.032416234, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.015775633, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.022341810, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 202, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.010649694, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000052721 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:07.201 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 524624, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 124704 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_messages": 5, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages": 156, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_bytes": 107744, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_created_connections": 3, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_active_connections": 2, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_total_time": 0.014359230, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_send_time": 0.009998122, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_recv_time": 0.002735548, 2024-09-21T06:22:07.202 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 155, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.011789512, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000076061 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "msgr_send_encrypted_bytes": 107744 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.203 INFO:teuthology.orchestra.run.smithi089.stdout: "cct": { 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "total_workers": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "unhealthy_workers": 0 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool": { 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bloom_filter_items": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:22:07.204 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blob_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:22:07.205 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_txc_items": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_writing_items": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_bytes": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_items": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_anon_items": 29, 2024-09-21T06:22:07.206 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "buffer_meta_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mapbl_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pglog_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_bytes": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "pgmap_items": 0, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_bytes": 968, 2024-09-21T06:22:07.207 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_co_items": 2, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_bytes": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_1_items": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_bytes": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "unittest_2_items": 0 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "max": 104857600, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "get_started": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "get": 207, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "get_sum": 495537, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_fail": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "get_or_fail_success": 207, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "take": 0, 2024-09-21T06:22:07.208 INFO:teuthology.orchestra.run.smithi089.stdout: "take_sum": 0, 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: "put": 207, 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: "put_sum": 495537, 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: "wait": { 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: "avgcount": 0, 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: "sum": 0.000000000, 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: "avgtime": 0.000000000 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T06:22:07.209 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T06:22:07.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:06 smithi081 ceph-mon[33870]: pgmap v654: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:22:07.884 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T06:22:07.884 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T06:22:07.884 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-21T06:22:07.885 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-21T06:22:07.885 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-21T06:22:07.885 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T06:22:07.896 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T06:22:07.896 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:22:07.896 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:22:07.918 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:22:07.918 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:22:07.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:22:08.284 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:08.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 -- 172.21.15.17:0/3413772152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 msgr2=0x7f7d6c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:08.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/3413772152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c102e70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009900 tx=0x7f7d5402a410 comp rx=0 tx=0).stop 2024-09-21T06:22:08.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 -- 172.21.15.17:0/3413772152 shutdown_connections 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/3413772152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 0x7f7d6c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/3413772152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1083a0 0x7f7d6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/3413772152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c102e70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 -- 172.21.15.17:0/3413772152 >> 172.21.15.17:0/3413772152 conn(0x7f7d6c079730 msgr2=0x7f7d6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 -- 172.21.15.17:0/3413772152 shutdown_connections 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.800+0000 7f7d70b8b640 1 -- 172.21.15.17:0/3413772152 wait complete. 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.801+0000 7f7d70b8b640 1 Processor -- start 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.801+0000 7f7d70b8b640 1 -- start start 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.801+0000 7f7d70b8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d70b8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1083a0 0x7f7d6c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d70b8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 0x7f7d6c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d70b8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c113930 con 0x7f7d6c102a60 2024-09-21T06:22:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d70b8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1137b0 con 0x7f7d6c108cf0 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d70b8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c113ab0 con 0x7f7d6c1083a0 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34694/0 (socket says 172.21.15.17:34694) 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6a59c640 1 -- 172.21.15.17:0/1648299719 learned_addr learned my addr 172.21.15.17:0/1648299719 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 0x7f7d6c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d69d9b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1083a0 0x7f7d6c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 -- 172.21.15.17:0/1648299719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1083a0 msgr2=0x7f7d6c19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1083a0 0x7f7d6c19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 -- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 msgr2=0x7f7d6c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 -- 172.21.15.17:0/1648299719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c1a0350 con 0x7f7d6c108cf0 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6a59c640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:08.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.802+0000 7f7d6ad9d640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 0x7f7d6c19fc20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009fd0 tx=0x7f7d6400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.803+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400ce20 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.803+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c1a0640 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.803+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d64005020 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.803+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64010690 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.803+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c1a6da0 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.804+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6c102e70 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.805+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7d64004b20 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.806+0000 7f7d637fe640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d580b6510 0x7f7d580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.806+0000 7f7d6a59c640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d580b6510 0x7f7d580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.806+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f7d640e7c80 con 0x7f7d6c108cf0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.807+0000 7f7d6a59c640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d580b6510 0x7f7d580b8a20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7d54032fd0 tx=0x7f7d540095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:08.811+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d640ae180 con 0x7f7d6c108cf0 2024-09-21T06:22:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.014+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d6c02e640 con 0x7f7d6c108cf0 2024-09-21T06:22:09.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:08 smithi017 ceph-mon[31080]: pgmap v655: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T06:22:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.015+0000 7f7d637fe640 1 -- 172.21.15.17:0/1648299719 <== mon.2 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+592 (secure 0 0 0) 0x7f7d64004e10 con 0x7f7d6c108cf0 2024-09-21T06:22:09.018 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2587374974 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:09.018 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3130109001 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:09.018 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1617037506 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4105480071 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1076932999 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1328055657 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:09.020 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d580b6510 msgr2=0x7f7d580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d580b6510 0x7f7d580b8a20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7d54032fd0 tx=0x7f7d540095c0 comp rx=0 tx=0).stop 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 msgr2=0x7f7d6c19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 0x7f7d6c19fc20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009fd0 tx=0x7f7d6400ef10 comp rx=0 tx=0).stop 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 shutdown_connections 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f7d580b6510 0x7f7d580b8a20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d6c108cf0 0x7f7d6c19fc20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.017+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d6c1083a0 0x7f7d6c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.018+0000 7f7d70b8b640 1 --2- 172.21.15.17:0/1648299719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d6c102a60 0x7f7d6c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.018+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 >> 172.21.15.17:0/1648299719 conn(0x7f7d6c079730 msgr2=0x7f7d6c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.018+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 shutdown_connections 2024-09-21T06:22:09.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:09.018+0000 7f7d70b8b640 1 -- 172.21.15.17:0/1648299719 wait complete. 2024-09-21T06:22:09.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:08 smithi089 ceph-mon[33879]: pgmap v655: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T06:22:09.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:08 smithi081 ceph-mon[33870]: pgmap v655: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T06:22:10.015 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-21T06:22:10.015 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:22:10.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:22:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:09 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1648299719' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:22:10.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:09 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1648299719' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:22:10.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:09 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1648299719' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:22:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/1357830470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf81083c0 msgr2=0x7fdbf81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/1357830470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf81083c0 0x7fdbf81087d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009900 tx=0x7fdbe002a410 comp rx=0 tx=0).stop 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/1357830470 shutdown_connections 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/1357830470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf81083c0 0x7fdbf81087d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/1357830470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf8108d10 0x7fdbf810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/1357830470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf8102a80 0x7fdbf8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/1357830470 >> 172.21.15.17:0/1357830470 conn(0x7fdbf8079740 msgr2=0x7fdbf8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.832+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/1357830470 shutdown_connections 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.833+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/1357830470 wait complete. 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.833+0000 7fdbfd4fe640 1 Processor -- start 2024-09-21T06:22:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.833+0000 7fdbfd4fe640 1 -- start start 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbfd4fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 0x7fdbf819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbfd4fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf81083c0 0x7fdbf819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbfd4fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf8108d10 0x7fdbf819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbfd4fe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8112830 con 0x7fdbf8102a80 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbfd4fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81126b0 con 0x7fdbf81083c0 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbfd4fe640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81129b0 con 0x7fdbf8108d10 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 0x7fdbf819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 0x7fdbf819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34716/0 (socket says 172.21.15.17:34716) 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 -- 172.21.15.17:0/2608183699 learned_addr learned my addr 172.21.15.17:0/2608183699 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf77fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf8108d10 0x7fdbf819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbee7fc640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf81083c0 0x7fdbf819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 -- 172.21.15.17:0/2608183699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf8108d10 msgr2=0x7fdbf819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf8108d10 0x7fdbf819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 -- 172.21.15.17:0/2608183699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf81083c0 msgr2=0x7fdbf819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf81083c0 0x7fdbf819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 -- 172.21.15.17:0/2608183699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf81a0340 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbee7fc640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf81083c0 0x7fdbf819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.834+0000 7fdbf6ffd640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 0x7fdbf819a3d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800d950 tx=0x7fdbe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.835+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8017070 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.835+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf81a0630 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.835+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe8009c30 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.835+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe800f620 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.835+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf81a6d90 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.836+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf8103d00 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.837+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdbe8005030 con 0x7fdbf8102a80 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.838+0000 7fdbf4ff9640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbe40b6510 0x7fdbe40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.838+0000 7fdbee7fc640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbe40b6510 0x7fdbe40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.838+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fdbe80e72c0 con 0x7fdbf8102a80 2024-09-21T06:22:10.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.839+0000 7fdbee7fc640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbe40b6510 0x7fdbe40b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0006010 tx=0x7fdbe0005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:10.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:10.841+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdbe80ad760 con 0x7fdbf8102a80 2024-09-21T06:22:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.043+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdbf81a7050 con 0x7fdbf8102a80 2024-09-21T06:22:11.045 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:10 smithi017 ceph-mon[31080]: pgmap v656: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:22:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.043+0000 7fdbf4ff9640 1 -- 172.21.15.17:0/2608183699 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+592 (secure 0 0 0) 0x7fdbe8009de0 con 0x7fdbf8102a80 2024-09-21T06:22:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2587374974 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3130109001 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1617037506 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2990540179 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4105480071 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3524627554 2024-09-22T06:02:45.023002+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1076932999 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1328055657 2024-09-22T06:02:18.519832+0000 2024-09-21T06:22:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbe40b6510 msgr2=0x7fdbe40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbe40b6510 0x7fdbe40b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0006010 tx=0x7fdbe0005de0 comp rx=0 tx=0).stop 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 msgr2=0x7fdbf819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 0x7fdbf819a3d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800d950 tx=0x7fdbe800de10 comp rx=0 tx=0).stop 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 shutdown_connections 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fdbe40b6510 0x7fdbe40b8a20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf8108d10 0x7fdbf819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf81083c0 0x7fdbf819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 --2- 172.21.15.17:0/2608183699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf8102a80 0x7fdbf819a3d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 >> 172.21.15.17:0/2608183699 conn(0x7fdbf8079740 msgr2=0x7fdbf8101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 shutdown_connections 2024-09-21T06:22:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:11.046+0000 7fdbfd4fe640 1 -- 172.21.15.17:0/2608183699 wait complete. 2024-09-21T06:22:11.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:10 smithi089 ceph-mon[33879]: pgmap v656: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:22:11.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:10 smithi081 ceph-mon[33870]: pgmap v656: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:22:11.871 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-21T06:22:11.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:22:11.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T06:22:11.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[85618]: fuse finished with error 0 and tester_r 0 2024-09-21T06:22:11.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:22:12.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:11 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2608183699' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:22:12.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:11 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2608183699' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:22:12.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:11 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2608183699' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:22:13.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:12 smithi089 ceph-mon[33879]: pgmap v657: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:22:13.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:12 smithi017 ceph-mon[31080]: pgmap v657: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:22:13.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:12 smithi081 ceph-mon[33870]: pgmap v657: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:22:15.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:14 smithi089 ceph-mon[33879]: pgmap v658: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:22:15.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:14 smithi017 ceph-mon[31080]: pgmap v658: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:22:15.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:14 smithi081 ceph-mon[33870]: pgmap v658: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:22:17.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:16 smithi089 ceph-mon[33879]: pgmap v659: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:22:17.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:16 smithi017 ceph-mon[31080]: pgmap v659: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:22:17.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:16 smithi081 ceph-mon[33870]: pgmap v659: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:22:18.045 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T06:22:18.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:22:18.046 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:22:18.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:22:18.066 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-21T06:22:18.127 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:22:18.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:22:18.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:22:18.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:22:18.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-21T06:22:18.295 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:22:18.305 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:22:18.305 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:22:18.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:22:18.569 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:19.035 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:18 smithi017 ceph-mon[31080]: pgmap v660: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:19.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:18 smithi089 ceph-mon[33879]: pgmap v660: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:19.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:18 smithi081 ceph-mon[33870]: pgmap v660: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 -- 172.21.15.17:0/3193787433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce010de20 msgr2=0x7efce0110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 --2- 172.21.15.17:0/3193787433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce010de20 0x7efce0110310 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009ca0 tx=0x7efcd802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 -- 172.21.15.17:0/3193787433 shutdown_connections 2024-09-21T06:22:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 --2- 172.21.15.17:0/3193787433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce010de20 0x7efce0110310 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 --2- 172.21.15.17:0/3193787433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0105310 0x7efce010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 --2- 172.21.15.17:0/3193787433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce01049c0 0x7efce0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 -- 172.21.15.17:0/3193787433 >> 172.21.15.17:0/3193787433 conn(0x7efce0079710 msgr2=0x7efce0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 -- 172.21.15.17:0/3193787433 shutdown_connections 2024-09-21T06:22:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 -- 172.21.15.17:0/3193787433 wait complete. 2024-09-21T06:22:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 Processor -- start 2024-09-21T06:22:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.268+0000 7efce6a11640 1 -- start start 2024-09-21T06:22:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce6a11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce01049c0 0x7efce019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce6a11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 0x7efce019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce6a11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce010de20 0x7efce019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce6a11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efce0113980 con 0x7efce0105310 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce6a11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efce0113800 con 0x7efce010de20 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce6a11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efce0113b00 con 0x7efce01049c0 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 0x7efce019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 0x7efce019a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37164/0 (socket says 172.21.15.17:37164) 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 -- 172.21.15.17:0/3818998755 learned_addr learned my addr 172.21.15.17:0/3818998755 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdffff640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce01049c0 0x7efce019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efce4fae640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce010de20 0x7efce019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 -- 172.21.15.17:0/3818998755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce01049c0 msgr2=0x7efce019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce01049c0 0x7efce019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 -- 172.21.15.17:0/3818998755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce010de20 msgr2=0x7efce019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.269+0000 7efcdf7fe640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce010de20 0x7efce019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efcdf7fe640 1 -- 172.21.15.17:0/3818998755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce01a01c0 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efcdf7fe640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 0x7efce019a8b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efcd400e9f0 tx=0x7efcd400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd400ccc0 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce01a04b0 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcd40108c0 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4018660 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.270+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce01a6cd0 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.271+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce006c280 con 0x7efce0105310 2024-09-21T06:22:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.273+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7efcd4010430 con 0x7efce0105310 2024-09-21T06:22:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.274+0000 7efcdd7fa640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efcc80b6540 0x7efcc80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.274+0000 7efcdffff640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efcc80b6540 0x7efcc80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.274+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7efcd40e79b0 con 0x7efce0105310 2024-09-21T06:22:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.274+0000 7efcdffff640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efcc80b6540 0x7efcc80b8a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcd000abe0 tx=0x7efcd000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:19.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.279+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcd40adeb0 con 0x7efce0105310 2024-09-21T06:22:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.505+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efce01080a0 con 0x7efce0105310 2024-09-21T06:22:19.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.505+0000 7efcdd7fa640 1 -- 172.21.15.17:0/3818998755 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11894 (secure 0 0 0) 0x7efcd40b2290 con 0x7efce0105310 2024-09-21T06:22:19.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:22:19.507 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"btime":"2024-09-21T06:21:16:911958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:21:16.799396+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:22:19.508 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2024-09-21T06:22:19.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efcc80b6540 msgr2=0x7efcc80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efcc80b6540 0x7efcc80b8a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efcd000abe0 tx=0x7efcd000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 msgr2=0x7efce019a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 0x7efce019a8b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efcd400e9f0 tx=0x7efcd400edf0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 shutdown_connections 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7efcc80b6540 0x7efcc80b8a50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efce0105310 0x7efce019a8b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce010de20 0x7efce019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 --2- 172.21.15.17:0/3818998755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efce01049c0 0x7efce019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 >> 172.21.15.17:0/3818998755 conn(0x7efce0079710 msgr2=0x7efce0105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 shutdown_connections 2024-09-21T06:22:19.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:19.508+0000 7efce6a11640 1 -- 172.21.15.17:0/3818998755 wait complete. 2024-09-21T06:22:20.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:19 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3818998755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:20.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:19 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3818998755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:20.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:22:20.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:19 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3818998755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:20.600 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:20.992 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:20 smithi017 ceph-mon[31080]: pgmap v661: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 -- 172.21.15.17:0/2164771201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0103b90 msgr2=0x7f28a0103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2164771201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0103b90 0x7f28a0103fa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f289c009900 tx=0x7f289c02a410 comp rx=0 tx=0).stop 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 -- 172.21.15.17:0/2164771201 shutdown_connections 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2164771201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a0109e20 0x7f28a0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2164771201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a01094d0 0x7f28a01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2164771201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0103b90 0x7f28a0103fa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 -- 172.21.15.17:0/2164771201 >> 172.21.15.17:0/2164771201 conn(0x7f28a00ff600 msgr2=0x7f28a0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 -- 172.21.15.17:0/2164771201 shutdown_connections 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.083+0000 7f28a7e96640 1 -- 172.21.15.17:0/2164771201 wait complete. 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 Processor -- start 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 -- start start 2024-09-21T06:22:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a0103b90 0x7f28a019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a01094d0 0x7f28a019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 0x7f28a019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0113990 con 0x7f28a0109e20 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0113810 con 0x7f28a01094d0 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.084+0000 7f28a7e96640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0113b10 con 0x7f28a0103b90 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 0x7f28a019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 0x7f28a019fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37180/0 (socket says 172.21.15.17:37180) 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 -- 172.21.15.17:0/2741267402 learned_addr learned my addr 172.21.15.17:0/2741267402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a5431640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a01094d0 0x7f28a019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a5c32640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a0103b90 0x7f28a019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 -- 172.21.15.17:0/2741267402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a0103b90 msgr2=0x7f28a019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a0103b90 0x7f28a019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 -- 172.21.15.17:0/2741267402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a01094d0 msgr2=0x7f28a019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a01094d0 0x7f28a019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 -- 172.21.15.17:0/2741267402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a01a0330 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a6433640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 0x7f28a019fc00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f289800eaa0 tx=0x7f289800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289800cdb0 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2898005020 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.085+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01a0620 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.086+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28980116d0 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.086+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01a6d80 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.087+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a0103fa0 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.088+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f28980051d0 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.089+0000 7f2892ffd640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f288c0b6510 0x7f288c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.089+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f28980e7b70 con 0x7f28a0109e20 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.089+0000 7f28a5c32640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f288c0b6510 0x7f288c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.090+0000 7f28a5c32640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f288c0b6510 0x7f288c0b8a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f289c0057c0 tx=0x7f289c0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.098+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2898016030 con 0x7f28a0109e20 2024-09-21T06:22:21.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:20 smithi081 ceph-mon[33870]: pgmap v661: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:21.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.338+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28a002e640 con 0x7f28a0109e20 2024-09-21T06:22:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.338+0000 7f2892ffd640 1 -- 172.21.15.17:0/2741267402 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11894 (secure 0 0 0) 0x7f28980b23f0 con 0x7f28a0109e20 2024-09-21T06:22:21.340 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:22:21.340 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"btime":"2024-09-21T06:21:16:911958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14688,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/426359055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":426359055},{"type":"v1","addr":"172.21.15.17:6835","nonce":426359055}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/154694548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":154694548},{"type":"v1","addr":"172.21.15.17:6837","nonce":154694548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14754,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/4125758530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":4125758530},{"type":"v1","addr":"172.21.15.17:6839","nonce":4125758530}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3494298881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3494298881},{"type":"v1","addr":"172.21.15.17:6841","nonce":3494298881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/4192055797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4192055797},{"type":"v1","addr":"172.21.15.81:6833","nonce":4192055797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/838110195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":838110195},{"type":"v1","addr":"172.21.15.89:6833","nonce":838110195}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:10:17.202602+0000","modified":"2024-09-21T06:21:16.799396+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24656,"mds_1":24649,"mds_2":24631},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24602":{"gid":24602,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6835/1978692137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1978692137},{"type":"v1","addr":"172.21.15.81:6835","nonce":1978692137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/3289455904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3289455904},{"type":"v1","addr":"172.21.15.81:6837","nonce":3289455904}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6835/1688371803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1688371803},{"type":"v1","addr":"172.21.15.89:6835","nonce":1688371803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.89:6837/857098251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":857098251},{"type":"v1","addr":"172.21.15.89:6837","nonce":857098251}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.89:6839/326704663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6838","nonce":326704663},{"type":"v1","addr":"172.21.15.89:6839","nonce":326704663}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6839/84773565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":84773565},{"type":"v1","addr":"172.21.15.81:6839","nonce":84773565}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24656,"qdb_cluster":[24631,24649,24656]},"id":1}]} 2024-09-21T06:22:21.341 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f288c0b6510 msgr2=0x7f288c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f288c0b6510 0x7f288c0b8a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f289c0057c0 tx=0x7f289c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 msgr2=0x7f28a019fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 0x7f28a019fc00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f289800eaa0 tx=0x7f289800ef60 comp rx=0 tx=0).stop 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 shutdown_connections 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f288c0b6510 0x7f288c0b8a20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a0109e20 0x7f28a019fc00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a01094d0 0x7f28a019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 --2- 172.21.15.17:0/2741267402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a0103b90 0x7f28a019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:21.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 >> 172.21.15.17:0/2741267402 conn(0x7f28a00ff600 msgr2=0x7f28a0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:21.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 shutdown_connections 2024-09-21T06:22:21.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:21.341+0000 7f28a7e96640 1 -- 172.21.15.17:0/2741267402 wait complete. 2024-09-21T06:22:21.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:20 smithi089 ceph-mon[33879]: pgmap v661: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:22.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:21 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/2741267402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:22.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:22:22.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:21 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/2741267402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:22.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:21 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/2741267402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:22.371 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:22.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 -- 172.21.15.17:0/4168764902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc105380 msgr2=0x7fcecc10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 --2- 172.21.15.17:0/4168764902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc105380 0x7fcecc10d8d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009900 tx=0x7fcec002a410 comp rx=0 tx=0).stop 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 -- 172.21.15.17:0/4168764902 shutdown_connections 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 --2- 172.21.15.17:0/4168764902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc105380 0x7fcecc10d8d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 --2- 172.21.15.17:0/4168764902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc10de60 0x7fcecc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 --2- 172.21.15.17:0/4168764902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc104a30 0x7fcecc104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 -- 172.21.15.17:0/4168764902 >> 172.21.15.17:0/4168764902 conn(0x7fcecc079760 msgr2=0x7fcecc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 -- 172.21.15.17:0/4168764902 shutdown_connections 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.859+0000 7fced2762640 1 -- 172.21.15.17:0/4168764902 wait complete. 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 Processor -- start 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 -- start start 2024-09-21T06:22:22.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 0x7fcecc102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc105380 0x7fcecc102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc10de60 0x7fcecc1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc113950 con 0x7fcecc104a30 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc1137d0 con 0x7fcecc10de60 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.860+0000 7fced2762640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc113ad0 con 0x7fcecc105380 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 0x7fcecc102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 0x7fcecc102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37206/0 (socket says 172.21.15.17:37206) 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 -- 172.21.15.17:0/3954314034 learned_addr learned my addr 172.21.15.17:0/3954314034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fced0cff640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc10de60 0x7fcecc1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecb7fe640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc105380 0x7fcecc102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 -- 172.21.15.17:0/3954314034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc105380 msgr2=0x7fcecc102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc105380 0x7fcecc102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 -- 172.21.15.17:0/3954314034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc10de60 msgr2=0x7fcecc1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc10de60 0x7fcecc1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 -- 172.21.15.17:0/3954314034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc1a87c0 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcecbfff640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 0x7fcecc102770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00d950 tx=0x7fcebc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc017020 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcebc009c30 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc1a8ab0 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00f620 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.861+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc1a9010 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.863+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc06c1f0 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.864+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcebc01a020 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.865+0000 7fcec97fa640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fceb40b6590 0x7fceb40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.865+0000 7fcecb7fe640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fceb40b6590 0x7fceb40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.865+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7fcebc0e7310 con 0x7fcecc104a30 2024-09-21T06:22:22.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.866+0000 7fcecb7fe640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fceb40b6590 0x7fceb40b8aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcec00057c0 tx=0x7fcec0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:22.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:22.868+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcebc021070 con 0x7fcecc104a30 2024-09-21T06:22:23.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.058+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcecc104e40 con 0x7fcecc104a30 2024-09-21T06:22:23.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:22 smithi017 ceph-mon[31080]: pgmap v662: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.059+0000 7fcec97fa640 1 -- 172.21.15.17:0/3954314034 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24775 (secure 0 0 0) 0x7fcecc104e40 con 0x7fcecc104a30 2024-09-21T06:22:23.061 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-21T06:22:23.062 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":84,"fsid":"dc6785ee-77de-11ef-baf5-efdc52797490","created":"2024-09-21T06:01:54.962201+0000","modified":"2024-09-21T06:11:47.669754+0000","last_up_change":"2024-09-21T06:09:25.651381+0000","last_in_change":"2024-09-21T06:09:01.307362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:05:35.514229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:10:12.685383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:10:15.181624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:10:21.569947+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da504fcf-fc17-4c8b-a419-69189bf1b15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6803","nonce":4212452176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6805","nonce":4212452176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6809","nonce":4212452176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4212452176},{"type":"v1","addr":"172.21.15.17:6807","nonce":4212452176}]},"public_addr":"172.21.15.17:6803/4212452176","cluster_addr":"172.21.15.17:6805/4212452176","heartbeat_back_addr":"172.21.15.17:6809/4212452176","heartbeat_front_addr":"172.21.15.17:6807/4212452176","state":["exists","up"]},{"osd":1,"uuid":"df0069ef-5308-4521-958f-4c40caa8055c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6801","nonce":3959009249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6803","nonce":3959009249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6807","nonce":3959009249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3959009249},{"type":"v1","addr":"172.21.15.81:6805","nonce":3959009249}]},"public_addr":"172.21.15.81:6801/3959009249","cluster_addr":"172.21.15.81:6803/3959009249","heartbeat_back_addr":"172.21.15.81:6807/3959009249","heartbeat_front_addr":"172.21.15.81:6805/3959009249","state":["exists","up"]},{"osd":2,"uuid":"51f5eff4-8860-44d4-a452-8c34286ceca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6801","nonce":4023376220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6803","nonce":4023376220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6807","nonce":4023376220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":4023376220},{"type":"v1","addr":"172.21.15.89:6805","nonce":4023376220}]},"public_addr":"172.21.15.89:6801/4023376220","cluster_addr":"172.21.15.89:6803/4023376220","heartbeat_back_addr":"172.21.15.89:6807/4023376220","heartbeat_front_addr":"172.21.15.89:6805/4023376220","state":["exists","up"]},{"osd":3,"uuid":"e7b1c53e-ef58-4c7b-8af8-4f3b6401336b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6811","nonce":1314832581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6813","nonce":1314832581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6817","nonce":1314832581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1314832581},{"type":"v1","addr":"172.21.15.17:6815","nonce":1314832581}]},"public_addr":"172.21.15.17:6811/1314832581","cluster_addr":"172.21.15.17:6813/1314832581","heartbeat_back_addr":"172.21.15.17:6817/1314832581","heartbeat_front_addr":"172.21.15.17:6815/1314832581","state":["exists","up"]},{"osd":4,"uuid":"1daaade6-5a17-4875-9622-9e9a5760a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6809","nonce":4268623175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6811","nonce":4268623175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6815","nonce":4268623175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":4268623175},{"type":"v1","addr":"172.21.15.81:6813","nonce":4268623175}]},"public_addr":"172.21.15.81:6809/4268623175","cluster_addr":"172.21.15.81:6811/4268623175","heartbeat_back_addr":"172.21.15.81:6815/4268623175","heartbeat_front_addr":"172.21.15.81:6813/4268623175","state":["exists","up"]},{"osd":5,"uuid":"ea0cf7ef-eab3-43dc-80e8-c2112eb30951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6809","nonce":1915302245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6811","nonce":1915302245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6815","nonce":1915302245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1915302245},{"type":"v1","addr":"172.21.15.89:6813","nonce":1915302245}]},"public_addr":"172.21.15.89:6809/1915302245","cluster_addr":"172.21.15.89:6811/1915302245","heartbeat_back_addr":"172.21.15.89:6815/1915302245","heartbeat_front_addr":"172.21.15.89:6813/1915302245","state":["exists","up"]},{"osd":6,"uuid":"a163a2eb-95c9-4fee-919f-3b378b3ffa2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6819","nonce":1345802272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6821","nonce":1345802272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6825","nonce":1345802272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":1345802272},{"type":"v1","addr":"172.21.15.17:6823","nonce":1345802272}]},"public_addr":"172.21.15.17:6819/1345802272","cluster_addr":"172.21.15.17:6821/1345802272","heartbeat_back_addr":"172.21.15.17:6825/1345802272","heartbeat_front_addr":"172.21.15.17:6823/1345802272","state":["exists","up"]},{"osd":7,"uuid":"3ac915b5-3e8a-4938-bbd4-3566c15b6294","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6817","nonce":900845162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6819","nonce":900845162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6823","nonce":900845162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":900845162},{"type":"v1","addr":"172.21.15.81:6821","nonce":900845162}]},"public_addr":"172.21.15.81:6817/900845162","cluster_addr":"172.21.15.81:6819/900845162","heartbeat_back_addr":"172.21.15.81:6823/900845162","heartbeat_front_addr":"172.21.15.81:6821/900845162","state":["exists","up"]},{"osd":8,"uuid":"f0758ec6-f4cd-41ac-a4d7-90cb888f86a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6817","nonce":4122778161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6819","nonce":4122778161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6823","nonce":4122778161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4122778161},{"type":"v1","addr":"172.21.15.89:6821","nonce":4122778161}]},"public_addr":"172.21.15.89:6817/4122778161","cluster_addr":"172.21.15.89:6819/4122778161","heartbeat_back_addr":"172.21.15.89:6823/4122778161","heartbeat_front_addr":"172.21.15.89:6821/4122778161","state":["exists","up"]},{"osd":9,"uuid":"dcb3df1a-b4b5-49db-91e9-c4e2d23a4b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6827","nonce":1763624071}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6829","nonce":1763624071}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6833","nonce":1763624071}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1763624071},{"type":"v1","addr":"172.21.15.17:6831","nonce":1763624071}]},"public_addr":"172.21.15.17:6827/1763624071","cluster_addr":"172.21.15.17:6829/1763624071","heartbeat_back_addr":"172.21.15.17:6833/1763624071","heartbeat_front_addr":"172.21.15.17:6831/1763624071","state":["exists","up"]},{"osd":10,"uuid":"ef256d78-3f6d-4e30-989e-11eb7aba5c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6825","nonce":4282741036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6827","nonce":4282741036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6831","nonce":4282741036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4282741036},{"type":"v1","addr":"172.21.15.81:6829","nonce":4282741036}]},"public_addr":"172.21.15.81:6825/4282741036","cluster_addr":"172.21.15.81:6827/4282741036","heartbeat_back_addr":"172.21.15.81:6831/4282741036","heartbeat_front_addr":"172.21.15.81:6829/4282741036","state":["exists","up"]},{"osd":11,"uuid":"8307455c-8674-4fb4-b0f4-2ab076db2a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6825","nonce":1527798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6827","nonce":1527798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6831","nonce":1527798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1527798982},{"type":"v1","addr":"172.21.15.89:6829","nonce":1527798982}]},"public_addr":"172.21.15.89:6825/1527798982","cluster_addr":"172.21.15.89:6827/1527798982","heartbeat_back_addr":"172.21.15.89:6831/1527798982","heartbeat_front_addr":"172.21.15.89:6829/1527798982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:04:40.927181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:06.322073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:31.856834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:05:56.926441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:23.418849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:06:48.870304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:15.500214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:07:41.332679+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:05.931453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:32.210651+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:08:57.449709+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:09:23.217998+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2587374974":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/3130109001":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6800/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1617037506":"2024-09-22T06:02:18.519832+0000","172.21.15.17:6800/2990540179":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/4105480071":"2024-09-22T06:02:45.023002+0000","172.21.15.17:6801/3524627554":"2024-09-22T06:02:45.023002+0000","172.21.15.17:0/1076932999":"2024-09-22T06:02:18.519832+0000","172.21.15.17:0/1328055657":"2024-09-22T06:02:18.519832+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fceb40b6590 msgr2=0x7fceb40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fceb40b6590 0x7fceb40b8aa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcec00057c0 tx=0x7fcec0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 msgr2=0x7fcecc102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 0x7fcecc102770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00d950 tx=0x7fcebc00de10 comp rx=0 tx=0).stop 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 shutdown_connections 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fceb40b6590 0x7fceb40b8aa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcecc10de60 0x7fcecc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcecc105380 0x7fcecc102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 --2- 172.21.15.17:0/3954314034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcecc104a30 0x7fcecc102770 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 >> 172.21.15.17:0/3954314034 conn(0x7fcecc079760 msgr2=0x7fcecc0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 shutdown_connections 2024-09-21T06:22:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:23.062+0000 7fced2762640 1 -- 172.21.15.17:0/3954314034 wait complete. 2024-09-21T06:22:23.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:22 smithi081 ceph-mon[33870]: pgmap v662: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:23.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:22 smithi089 ceph-mon[33879]: pgmap v662: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:23.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:22:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:24.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:23 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3954314034' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:22:24.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:23 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3954314034' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:22:24.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:23 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3954314034' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 -- 172.21.15.17:0/1280932194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108480 msgr2=0x7f4de0108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 --2- 172.21.15.17:0/1280932194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108480 0x7f4de0108890 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009900 tx=0x7f4dd402a410 comp rx=0 tx=0).stop 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 -- 172.21.15.17:0/1280932194 shutdown_connections 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 --2- 172.21.15.17:0/1280932194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108480 0x7f4de0108890 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 --2- 172.21.15.17:0/1280932194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de0108dd0 0x7f4de010f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 --2- 172.21.15.17:0/1280932194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de0102b40 0x7f4de0102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 -- 172.21.15.17:0/1280932194 >> 172.21.15.17:0/1280932194 conn(0x7f4de0079750 msgr2=0x7f4de0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 -- 172.21.15.17:0/1280932194 shutdown_connections 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.527+0000 7f4de5919640 1 -- 172.21.15.17:0/1280932194 wait complete. 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 Processor -- start 2024-09-21T06:22:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 -- start start 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de0102b40 0x7f4de019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de0108480 0x7f4de019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 0x7f4de019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0113970 con 0x7f4de0108dd0 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4de01137f0 con 0x7f4de0108480 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4de5919640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0113af0 con 0x7f4de0102b40 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4ddf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 0x7f4de019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4ddf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 0x7f4de019fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37226/0 (socket says 172.21.15.17:37226) 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4ddf7fe640 1 -- 172.21.15.17:0/1339447572 learned_addr learned my addr 172.21.15.17:0/1339447572 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4dde7fc640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de0108480 0x7f4de019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.528+0000 7f4ddeffd640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de0102b40 0x7f4de019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4ddf7fe640 1 -- 172.21.15.17:0/1339447572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de0102b40 msgr2=0x7f4de019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4ddf7fe640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de0102b40 0x7f4de019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4ddf7fe640 1 -- 172.21.15.17:0/1339447572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de0108480 msgr2=0x7f4de019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4ddf7fe640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de0108480 0x7f4de019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4ddf7fe640 1 -- 172.21.15.17:0/1339447572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de01a02f0 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4ddf7fe640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 0x7f4de019fbc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800eaa0 tx=0x7f4dd800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800cdb0 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dd8005020 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80116d0 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de01a05e0 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.529+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de01a6d40 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.530+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de0103dc0 con 0x7f4de0108dd0 2024-09-21T06:22:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.532+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4dd80051d0 con 0x7f4de0108dd0 2024-09-21T06:22:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.533+0000 7f4de4917640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4dc80b6510 0x7f4dc80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.533+0000 7f4ddeffd640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4dc80b6510 0x7f4dc80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.533+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9150+0+0 (secure 0 0 0) 0x7f4dd80e7bb0 con 0x7f4de0108dd0 2024-09-21T06:22:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.533+0000 7f4ddeffd640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4dc80b6510 0x7f4dc80b8a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000bbe0 tx=0x7f4dd000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:24.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.536+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4dd8016030 con 0x7f4de0108dd0 2024-09-21T06:22:24.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.768+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4de0102f50 con 0x7f4de0108dd0 2024-09-21T06:22:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.771+0000 7f4de4917640 1 -- 172.21.15.17:0/1339447572 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7f4dd80b2430 con 0x7f4de0108dd0 2024-09-21T06:22:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:22:24.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4dc80b6510 msgr2=0x7f4dc80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:24.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4dc80b6510 0x7f4dc80b8a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000bbe0 tx=0x7f4dd000b390 comp rx=0 tx=0).stop 2024-09-21T06:22:24.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 msgr2=0x7f4de019fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:24.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 0x7f4de019fbc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800eaa0 tx=0x7f4dd800ef60 comp rx=0 tx=0).stop 2024-09-21T06:22:24.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 shutdown_connections 2024-09-21T06:22:24.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f4dc80b6510 0x7f4dc80b8a20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4de0108dd0 0x7f4de019fbc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de0108480 0x7f4de019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 --2- 172.21.15.17:0/1339447572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4de0102b40 0x7f4de019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:24.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.775+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 >> 172.21.15.17:0/1339447572 conn(0x7f4de0079750 msgr2=0x7f4de01053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:24.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.776+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 shutdown_connections 2024-09-21T06:22:24.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:24.776+0000 7f4de5919640 1 -- 172.21.15.17:0/1339447572 wait complete. 2024-09-21T06:22:25.116 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: pgmap v663: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1339447572' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1339447572' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mon[33879]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c[62381]: ignoring --setuser ceph since I am not root 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c[62381]: ignoring --setgroup ceph since I am not root 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mds[62385]: -- 172.21.15.89:0/2378975600 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c557c45860 con 0x55c55bded180 2024-09-21T06:22:25.117 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c[62381]: starting mds.c at 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f[62110]: ignoring --setuser ceph since I am not root 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f[62110]: ignoring --setgroup ceph since I am not root 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mds[62114]: -- 172.21.15.89:0/1344221190 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d78c041c20 con 0x55d7901e9a80 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f[62110]: starting mds.f at 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i[62652]: ignoring --setuser ceph since I am not root 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i[62652]: ignoring --setgroup ceph since I am not root 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-mds[62662]: -- 172.21.15.89:0/2506147733 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557cdfe5f860 con 0x557ce4007180 2024-09-21T06:22:25.118 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:22:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i[62652]: starting mds.i at 2024-09-21T06:22:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a[31076]: 2024-09-21T06:22:24.770+0000 7fecb86c0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:22:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: pgmap v663: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1339447572' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:22:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:22:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:22:25.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1339447572' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:22:25.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:22:25.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:24 smithi017 ceph-mon[31080]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:22:25.257 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e[61327]: ignoring --setuser ceph since I am not root 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e[61327]: ignoring --setgroup ceph since I am not root 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mds[61331]: -- 172.21.15.81:0/2066247418 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf1bd4fc20 con 0x55cf1fef7600 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e[61327]: starting mds.e at 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h[61596]: ignoring --setuser ceph since I am not root 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h[61596]: ignoring --setgroup ceph since I am not root 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mds[61600]: -- 172.21.15.81:0/190270178 <== mon.1 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e5af5fc20 con 0x557e5f107a80 2024-09-21T06:22:25.258 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h[61596]: starting mds.h at 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: pgmap v663: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1339447572' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1339447572' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mon[33870]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: ignoring --setuser ceph since I am not root 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: ignoring --setgroup ceph since I am not root 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-mds[61886]: -- 172.21.15.81:0/3537014044 <== mon.2 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563393b0bc20 con 0x563397cb3a80 2024-09-21T06:22:25.259 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:22:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: starting mds.b at 2024-09-21T06:22:25.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:22:25.935 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6835/1992300629,v1:172.21.15.89:6838/1992300629] up:boot 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6834/3898300775,v1:172.21.15.89:6837/3898300775] up:boot 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.89:6836/2573738872,v1:172.21.15.89:6839/2573738872] up:boot 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6834/3523130928,v1:172.21.15.81:6835/3523130928] up:boot 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6836/2127936400,v1:172.21.15.81:6837/2127936400] up:boot 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: mds.? [v2:172.21.15.81:6838/2719771110,v1:172.21.15.81:6839/2719771110] up:boot 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:22:25.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:25 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6835/1992300629,v1:172.21.15.89:6838/1992300629] up:boot 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6834/3898300775,v1:172.21.15.89:6837/3898300775] up:boot 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.89:6836/2573738872,v1:172.21.15.89:6839/2573738872] up:boot 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6834/3523130928,v1:172.21.15.81:6835/3523130928] up:boot 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6836/2127936400,v1:172.21.15.81:6837/2127936400] up:boot 2024-09-21T06:22:26.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: mds.? [v2:172.21.15.81:6838/2719771110,v1:172.21.15.81:6839/2719771110] up:boot 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:22:26.009 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:25 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:22:26.137 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6835/1992300629,v1:172.21.15.89:6838/1992300629] up:boot 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6834/3898300775,v1:172.21.15.89:6837/3898300775] up:boot 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.89:6836/2573738872,v1:172.21.15.89:6839/2573738872] up:boot 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6834/3523130928,v1:172.21.15.81:6835/3523130928] up:boot 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6836/2127936400,v1:172.21.15.81:6837/2127936400] up:boot 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: mds.? [v2:172.21.15.81:6838/2719771110,v1:172.21.15.81:6839/2719771110] up:boot 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:22:26.138 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:25 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:22:26.369 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 -- 172.21.15.17:0/342134569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214108d20 msgr2=0x7f021410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 --2- 172.21.15.17:0/342134569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214108d20 0x7f021410f550 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f020c009ca0 tx=0x7f020c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 -- 172.21.15.17:0/342134569 shutdown_connections 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 --2- 172.21.15.17:0/342134569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214108d20 0x7f021410f550 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 --2- 172.21.15.17:0/342134569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02141083d0 0x7f02141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 --2- 172.21.15.17:0/342134569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0214102ae0 0x7f0214102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.876+0000 7f021c41a640 1 -- 172.21.15.17:0/342134569 >> 172.21.15.17:0/342134569 conn(0x7f02140797b0 msgr2=0x7f0214079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.877+0000 7f021c41a640 1 -- 172.21.15.17:0/342134569 shutdown_connections 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.877+0000 7f021c41a640 1 -- 172.21.15.17:0/342134569 wait complete. 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.877+0000 7f021c41a640 1 Processor -- start 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 -- start start 2024-09-21T06:22:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 0x7f02141992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02141083d0 0x7f0214199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0214108d20 0x7f021419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f02141128e0 con 0x7f0214102ae0 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0214112760 con 0x7f02141083d0 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021c41a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0214112a60 con 0x7f0214108d20 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 0x7f02141992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 0x7f02141992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37250/0 (socket says 172.21.15.17:37250) 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 -- 172.21.15.17:0/3671492441 learned_addr learned my addr 172.21.15.17:0/3671492441 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f02199b5640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02141083d0 0x7f0214199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a9b7640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0214108d20 0x7f021419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 -- 172.21.15.17:0/3671492441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0214108d20 msgr2=0x7f021419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0214108d20 0x7f021419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 -- 172.21.15.17:0/3671492441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02141083d0 msgr2=0x7f0214199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02141083d0 0x7f0214199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.878+0000 7f021a1b6640 1 -- 172.21.15.17:0/3671492441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021419f260 con 0x7f0214102ae0 2024-09-21T06:22:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.879+0000 7f021a1b6640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 0x7f02141992f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f021000e9f0 tx=0x7f021000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.879+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021000cd80 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.879+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02100108c0 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.879+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021419f550 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.879+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02100187c0 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.879+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02141a5cb0 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.880+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0214102ef0 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.881+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0210010430 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.882+0000 7f020b7fe640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f02000b6510 0x7f02000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.883+0000 7f02199b5640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f02000b6510 0x7f02000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.883+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9408+0+0 (secure 0 0 0) 0x7f02100e7fd0 con 0x7f0214102ae0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.883+0000 7f02199b5640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f02000b6510 0x7f02000b8a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0214079cd0 tx=0x7f0204005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:26.886+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02100b27b0 con 0x7f0214102ae0 2024-09-21T06:22:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.130+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f021402e640 con 0x7f0214102ae0 2024-09-21T06:22:27.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:26 smithi017 ceph-mon[31080]: pgmap v665: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:22:27.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.133 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:26 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:26 smithi081 ceph-mon[33870]: pgmap v665: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:22:27.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:26 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:26 smithi089 ceph-mon[33879]: pgmap v665: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:22:27.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:26 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:27.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.901+0000 7f020b7fe640 1 -- 172.21.15.17:0/3671492441 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f02100b76f0 con 0x7f0214102ae0 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f02000b6510 msgr2=0x7f02000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f02000b6510 0x7f02000b8a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0214079cd0 tx=0x7f0204005f90 comp rx=0 tx=0).stop 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 msgr2=0x7f02141992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 0x7f02141992f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f021000e9f0 tx=0x7f021000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 shutdown_connections 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f02000b6510 0x7f02000b8a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0214108d20 0x7f021419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02141083d0 0x7f0214199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:27.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 --2- 172.21.15.17:0/3671492441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102ae0 0x7f02141992f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:27.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 >> 172.21.15.17:0/3671492441 conn(0x7f02140797b0 msgr2=0x7f02141043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:27.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 shutdown_connections 2024-09-21T06:22:27.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:27.903+0000 7f021c41a640 1 -- 172.21.15.17:0/3671492441 wait complete. 2024-09-21T06:22:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:27 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3671492441' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:22:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:28.230 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:27 smithi017 ceph-mon[31080]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:27 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3671492441' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:22:28.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:28.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:28.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:27 smithi081 ceph-mon[33870]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:27 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3671492441' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:22:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:28.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:27 smithi089 ceph-mon[33879]: from='mgr.14152 172.21.15.17:0/4107312927' entity='mgr.x' 2024-09-21T06:22:28.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:22:28.825 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:29.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:28 smithi017 ceph-mon[31080]: pgmap v666: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:22:29.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:28 smithi017 ceph-mon[31080]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:22:29.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:28 smithi017 ceph-mon[31080]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:22:29.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:28 smithi017 ceph-mon[31080]: Cluster is now healthy 2024-09-21T06:22:29.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:28 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3671492441' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:22:29.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:28 smithi017 ceph-mon[31080]: fsmap 12 up:standby 2024-09-21T06:22:29.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:28 smithi081 ceph-mon[33870]: pgmap v666: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:22:29.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:28 smithi081 ceph-mon[33870]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:22:29.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:28 smithi081 ceph-mon[33870]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:22:29.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:28 smithi081 ceph-mon[33870]: Cluster is now healthy 2024-09-21T06:22:29.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:28 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3671492441' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:22:29.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:28 smithi081 ceph-mon[33870]: fsmap 12 up:standby 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 -- 172.21.15.17:0/2876966934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10108d20 msgr2=0x7fcd1010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 --2- 172.21.15.17:0/2876966934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10108d20 0x7fcd1010f550 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009ca0 tx=0x7fcd0802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 -- 172.21.15.17:0/2876966934 shutdown_connections 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 --2- 172.21.15.17:0/2876966934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10108d20 0x7fcd1010f550 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 --2- 172.21.15.17:0/2876966934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101083d0 0x7fcd101087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 --2- 172.21.15.17:0/2876966934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd10102ae0 0x7fcd10102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 -- 172.21.15.17:0/2876966934 >> 172.21.15.17:0/2876966934 conn(0x7fcd10079760 msgr2=0x7fcd10079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:29.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 -- 172.21.15.17:0/2876966934 shutdown_connections 2024-09-21T06:22:29.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.312+0000 7fcd187f2640 1 -- 172.21.15.17:0/2876966934 wait complete. 2024-09-21T06:22:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 Processor -- start 2024-09-21T06:22:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 -- start start 2024-09-21T06:22:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 0x7fcd1019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101083d0 0x7fcd1019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd10108d20 0x7fcd1019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10112890 con 0x7fcd10102ae0 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10112710 con 0x7fcd101083d0 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd187f2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10112a10 con 0x7fcd10108d20 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 0x7fcd1019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 0x7fcd1019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39284/0 (socket says 172.21.15.17:39284) 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 -- 172.21.15.17:0/3860892884 learned_addr learned my addr 172.21.15.17:0/3860892884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd15d8d640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101083d0 0x7fcd1019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd16d8f640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd10108d20 0x7fcd1019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 -- 172.21.15.17:0/3860892884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd10108d20 msgr2=0x7fcd1019fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd10108d20 0x7fcd1019fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 -- 172.21.15.17:0/3860892884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101083d0 msgr2=0x7fcd1019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101083d0 0x7fcd1019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.313+0000 7fcd1658e640 1 -- 172.21.15.17:0/3860892884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd101a01e0 con 0x7fcd10102ae0 2024-09-21T06:22:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.314+0000 7fcd1658e640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 0x7fcd1019a330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00d950 tx=0x7fcd0c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.314+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c017070 con 0x7fcd10102ae0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.314+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd0c00de80 con 0x7fcd10102ae0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.314+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00f620 con 0x7fcd10102ae0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.314+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd101a04d0 con 0x7fcd10102ae0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.314+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd101a6cf0 con 0x7fcd10102ae0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.315+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd10103d10 con 0x7fcd10102ae0 2024-09-21T06:22:29.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.317+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fcd0c009c30 con 0x7fcd10102ae0 2024-09-21T06:22:29.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.317+0000 7fcd077fe640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fccfc0b65c0 0x7fccfc0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:29.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.318+0000 7fcd15d8d640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fccfc0b65c0 0x7fccfc0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:29.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.318+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9408+0+0 (secure 0 0 0) 0x7fcd0c0e71e0 con 0x7fcd10102ae0 2024-09-21T06:22:29.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.318+0000 7fcd15d8d640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fccfc0b65c0 0x7fccfc0b8ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcd1006cc20 tx=0x7fcd0000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:29.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.321+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd0c0ad660 con 0x7fcd10102ae0 2024-09-21T06:22:29.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:28 smithi089 ceph-mon[33879]: pgmap v666: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:22:29.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:28 smithi089 ceph-mon[33879]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:22:29.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:28 smithi089 ceph-mon[33879]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:22:29.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:28 smithi089 ceph-mon[33879]: Cluster is now healthy 2024-09-21T06:22:29.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:28 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3671492441' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:22:29.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:28 smithi089 ceph-mon[33879]: fsmap 12 up:standby 2024-09-21T06:22:29.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.513+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd10102ef0 con 0x7fcd10102ae0 2024-09-21T06:22:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.897+0000 7fcd077fe640 1 -- 172.21.15.17:0/3860892884 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7fcd0c0b1a40 con 0x7fcd10102ae0 2024-09-21T06:22:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:22:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.901+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fccfc0b65c0 msgr2=0x7fccfc0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.901+0000 7fcd187f2640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fccfc0b65c0 0x7fccfc0b8ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcd1006cc20 tx=0x7fcd0000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.901+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 msgr2=0x7fcd1019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.901+0000 7fcd187f2640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 0x7fcd1019a330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00d950 tx=0x7fcd0c00dd50 comp rx=0 tx=0).stop 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 shutdown_connections 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7fccfc0b65c0 0x7fccfc0b8ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd10108d20 0x7fcd1019fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd101083d0 0x7fcd1019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 --2- 172.21.15.17:0/3860892884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd10102ae0 0x7fcd1019a330 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 >> 172.21.15.17:0/3860892884 conn(0x7fcd10079760 msgr2=0x7fcd10101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 shutdown_connections 2024-09-21T06:22:29.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:29.902+0000 7fcd187f2640 1 -- 172.21.15.17:0/3860892884 wait complete. 2024-09-21T06:22:30.212 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:29 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3860892884' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:30.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:29 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3860892884' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:30.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:29 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3860892884' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:30.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:22:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:31.226 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:30 smithi017 ceph-mon[31080]: pgmap v667: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-21T06:22:31.226 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:30 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3860892884' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:31.226 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:30 smithi017 ceph-mon[31080]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:22:31.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:30 smithi081 ceph-mon[33870]: pgmap v667: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-21T06:22:31.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:30 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3860892884' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:31.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:30 smithi081 ceph-mon[33870]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 -- 172.21.15.17:0/326333674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff754108d00 msgr2=0x7ff75410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 --2- 172.21.15.17:0/326333674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff754108d00 0x7ff75410f530 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009ca0 tx=0x7ff74c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 -- 172.21.15.17:0/326333674 shutdown_connections 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 --2- 172.21.15.17:0/326333674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff754108d00 0x7ff75410f530 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 --2- 172.21.15.17:0/326333674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7541083b0 0x7ff7541087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 --2- 172.21.15.17:0/326333674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102ac0 0x7ff754102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 -- 172.21.15.17:0/326333674 >> 172.21.15.17:0/326333674 conn(0x7ff754079720 msgr2=0x7ff754079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:31.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 -- 172.21.15.17:0/326333674 shutdown_connections 2024-09-21T06:22:31.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.320+0000 7ff75b42c640 1 -- 172.21.15.17:0/326333674 wait complete. 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 Processor -- start 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 -- start start 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff754102ac0 0x7ff75419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 0x7ff75419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754108d00 0x7ff7541a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff7541128c0 con 0x7ff7541083b0 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff754112740 con 0x7ff754108d00 2024-09-21T06:22:31.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff75b42c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff754112a40 con 0x7ff754102ac0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff7589c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 0x7ff75419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff7589c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 0x7ff75419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39306/0 (socket says 172.21.15.17:39306) 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff7589c7640 1 -- 172.21.15.17:0/3950539311 learned_addr learned my addr 172.21.15.17:0/3950539311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff7599c9640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754108d00 0x7ff7541a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.321+0000 7ff7591c8640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff754102ac0 0x7ff75419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7589c7640 1 -- 172.21.15.17:0/3950539311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff754102ac0 msgr2=0x7ff75419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7589c7640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff754102ac0 0x7ff75419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7589c7640 1 -- 172.21.15.17:0/3950539311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754108d00 msgr2=0x7ff7541a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7589c7640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754108d00 0x7ff7541a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7589c7640 1 -- 172.21.15.17:0/3950539311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7541a2500 con 0x7ff7541083b0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7599c9640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754108d00 0x7ff7541a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff7589c7640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 0x7ff75419cb30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff74400d950 tx=0x7ff74400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744017070 con 0x7ff7541083b0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff744009c30 con 0x7ff7541083b0 2024-09-21T06:22:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7541a27f0 con 0x7ff7541083b0 2024-09-21T06:22:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7440047a0 con 0x7ff7541083b0 2024-09-21T06:22:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.322+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7541a8f50 con 0x7ff7541083b0 2024-09-21T06:22:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.323+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff754102ed0 con 0x7ff7541083b0 2024-09-21T06:22:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.324+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff744004020 con 0x7ff7541083b0 2024-09-21T06:22:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.325+0000 7ff74a7fc640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff7400b6590 0x7ff7400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.325+0000 7ff7591c8640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff7400b6590 0x7ff7400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.325+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8854+0+0 (secure 0 0 0) 0x7ff7440e76a0 con 0x7ff7541083b0 2024-09-21T06:22:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.326+0000 7ff7591c8640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff7400b6590 0x7ff7400b8aa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff750005fd0 tx=0x7ff750005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:31.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.328+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff744020020 con 0x7ff7541083b0 2024-09-21T06:22:31.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:30 smithi089 ceph-mon[33879]: pgmap v667: 129 pgs: 129 active+clean; 243 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-21T06:22:31.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:30 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3860892884' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:31.367 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:30 smithi089 ceph-mon[33879]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:22:31.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.519+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff7541a91b0 con 0x7ff7541083b0 2024-09-21T06:22:31.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.907+0000 7ff74a7fc640 1 -- 172.21.15.17:0/3950539311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7ff7440add40 con 0x7ff7541083b0 2024-09-21T06:22:31.909 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-21T06:22:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff7400b6590 msgr2=0x7ff7400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff7400b6590 0x7ff7400b8aa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff750005fd0 tx=0x7ff750005850 comp rx=0 tx=0).stop 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 msgr2=0x7ff75419cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 0x7ff75419cb30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff74400d950 tx=0x7ff74400de10 comp rx=0 tx=0).stop 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 shutdown_connections 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7ff7400b6590 0x7ff7400b8aa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7541083b0 0x7ff75419cb30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754108d00 0x7ff7541a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 --2- 172.21.15.17:0/3950539311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff754102ac0 0x7ff75419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 >> 172.21.15.17:0/3950539311 conn(0x7ff754079720 msgr2=0x7ff75406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 shutdown_connections 2024-09-21T06:22:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:31.910+0000 7ff75b42c640 1 -- 172.21.15.17:0/3950539311 wait complete. 2024-09-21T06:22:32.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:31 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3950539311' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:32.268 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:31 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3950539311' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:32.279 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:31 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3950539311' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:32.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid dc6785ee-77de-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T06:22:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:33.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:32 smithi017 ceph-mon[31080]: pgmap v669: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:22:33.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:32 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/3950539311' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:33.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:32 smithi017 ceph-mon[31080]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:22:33.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:32 smithi081 ceph-mon[33870]: pgmap v669: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:22:33.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:32 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/3950539311' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:33.258 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:32 smithi081 ceph-mon[33870]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:22:33.287 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:32 smithi089 ceph-mon[33879]: pgmap v669: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:22:33.287 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:32 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/3950539311' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:33.287 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:32 smithi089 ceph-mon[33879]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:22:33.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.396+0000 7f143ee53640 1 -- 172.21.15.17:0/1066185255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438102080 msgr2=0x7f1438102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:33.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.396+0000 7f143ee53640 1 --2- 172.21.15.17:0/1066185255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438102080 0x7f1438102490 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1434009900 tx=0x7f143402a410 comp rx=0 tx=0).stop 2024-09-21T06:22:33.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 -- 172.21.15.17:0/1066185255 shutdown_connections 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 --2- 172.21.15.17:0/1066185255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1438106c20 0x7f14381106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 --2- 172.21.15.17:0/1066185255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14381062d0 0x7f14381066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 --2- 172.21.15.17:0/1066185255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438102080 0x7f1438102490 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 -- 172.21.15.17:0/1066185255 >> 172.21.15.17:0/1066185255 conn(0x7f1438079f90 msgr2=0x7f143807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 -- 172.21.15.17:0/1066185255 shutdown_connections 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 -- 172.21.15.17:0/1066185255 wait complete. 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 Processor -- start 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.397+0000 7f143ee53640 1 -- start start 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143ee53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1438102080 0x7f143819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143ee53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14381062d0 0x7f143819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143ee53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 0x7f143819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143ee53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1438113a70 con 0x7f1438106c20 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143ee53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14381138f0 con 0x7f14381062d0 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143ee53640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1438113bf0 con 0x7f1438102080 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 0x7f143819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 0x7f143819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39310/0 (socket says 172.21.15.17:39310) 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 -- 172.21.15.17:0/1267523726 learned_addr learned my addr 172.21.15.17:0/1267523726 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f142ffff640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14381062d0 0x7f143819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143cbef640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1438102080 0x7f143819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 -- 172.21.15.17:0/1267523726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1438102080 msgr2=0x7f143819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1438102080 0x7f143819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 -- 172.21.15.17:0/1267523726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14381062d0 msgr2=0x7f143819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14381062d0 0x7f143819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 -- 172.21.15.17:0/1267523726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14381a0430 con 0x7f1438106c20 2024-09-21T06:22:33.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f143d3f0640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 0x7f143819fd00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f143000b970 tx=0x7f143000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.398+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430019070 con 0x7f1438106c20 2024-09-21T06:22:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.399+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1430014440 con 0x7f1438106c20 2024-09-21T06:22:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.399+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14300075d0 con 0x7f1438106c20 2024-09-21T06:22:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.399+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14381a0720 con 0x7f1438106c20 2024-09-21T06:22:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.399+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14381a6e80 con 0x7f1438106c20 2024-09-21T06:22:33.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.400+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1438102490 con 0x7f1438106c20 2024-09-21T06:22:33.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.401+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f143001c070 con 0x7f1438106c20 2024-09-21T06:22:33.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.402+0000 7f142dffb640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f14200b6510 0x7f14200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:33.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.402+0000 7f143cbef640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f14200b6510 0x7f14200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:33.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.402+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8324+0+0 (secure 0 0 0) 0x7f14300e6870 con 0x7f1438106c20 2024-09-21T06:22:33.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.403+0000 7f143cbef640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f14200b6510 0x7f14200b8a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1434006010 tx=0x7f1434000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:33.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.406+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14300b1420 con 0x7f1438106c20 2024-09-21T06:22:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.594+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f143802e640 con 0x7f1438106c20 2024-09-21T06:22:33.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.914+0000 7f142dffb640 1 -- 172.21.15.17:0/1267523726 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v88) ==== 178+0+0 (secure 0 0 0) 0x7f14300b6360 con 0x7f1438106c20 2024-09-21T06:22:33.916 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' removed 2024-09-21T06:22:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f14200b6510 msgr2=0x7f14200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f14200b6510 0x7f14200b8a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1434006010 tx=0x7f1434000bc0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 msgr2=0x7f143819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 0x7f143819fd00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f143000b970 tx=0x7f143000be30 comp rx=0 tx=0).stop 2024-09-21T06:22:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 shutdown_connections 2024-09-21T06:22:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:6800/1923174301,v1:172.21.15.17:6801/1923174301] conn(0x7f14200b6510 0x7f14200b8a20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1438106c20 0x7f143819fd00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14381062d0 0x7f143819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 --2- 172.21.15.17:0/1267523726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1438102080 0x7f143819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 >> 172.21.15.17:0/1267523726 conn(0x7f1438079f90 msgr2=0x7f14381075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 shutdown_connections 2024-09-21T06:22:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-21T06:22:33.918+0000 7f143ee53640 1 -- 172.21.15.17:0/1267523726 wait complete. 2024-09-21T06:22:34.255 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:33 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1267523726' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:34.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:33 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1267523726' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:34.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:33 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1267523726' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:22:34.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:22:34.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:22:34.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:22:34.718 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:22:34.719 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:22:34.736 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:22:34.755 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:22:34.774 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:22:34.774 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:22:34.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:22:34.887 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:34 smithi017 systemd[1]: Stopping Ceph mon.a for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:35.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:34 smithi081 ceph-mon[33870]: pgmap v671: 33 pgs: 33 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:22:35.007 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:34 smithi081 ceph-mon[33870]: from='client.? 172.21.15.17:0/1267523726' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:35.008 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:34 smithi081 ceph-mon[33870]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:22:35.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:34 smithi089 ceph-mon[33879]: pgmap v671: 33 pgs: 33 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:22:35.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:34 smithi089 ceph-mon[33879]: from='client.? 172.21.15.17:0/1267523726' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:35.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:34 smithi089 ceph-mon[33879]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:22:35.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:34 smithi017 ceph-mon[31080]: pgmap v671: 33 pgs: 33 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:22:35.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:34 smithi017 ceph-mon[31080]: from='client.? 172.21.15.17:0/1267523726' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:22:35.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:34 smithi017 ceph-mon[31080]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:22:35.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a[31076]: 2024-09-21T06:22:35.075+0000 7fecbdecb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:35.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a[31076]: 2024-09-21T06:22:35.075+0000 7fecbdecb640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:22:35.388 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:35 smithi017 podman[168042]: 2024-09-21 06:22:35.138054512 +0000 UTC m=+0.161511049 container died 82321d5f106e85835f6bf0f9793190fa7bd52b4d39a62575a2a844cba963759e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:22:35.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:35 smithi017 podman[168042]: 2024-09-21 06:22:35.526111915 +0000 UTC m=+0.549568457 container cleanup 82321d5f106e85835f6bf0f9793190fa7bd52b4d39a62575a2a844cba963759e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:22:35.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Sep 21 06:22:35 smithi017 bash[168042]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:22:35.952 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:22:36.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:36.000 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:22:36.000 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:22:36.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:22:36.313 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:36 smithi081 systemd[1]: Stopping Ceph mon.b for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:36.757 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-b[33866]: 2024-09-21T06:22:36.310+0000 7efd78f53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:36.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-b[33866]: 2024-09-21T06:22:36.310+0000 7efd78f53640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:22:36.758 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:36 smithi081 podman[65617]: 2024-09-21 06:22:36.46441587 +0000 UTC m=+0.274365101 container died 12b0bdb4e82101577e07f02b031ce3ec871291dd3493110a5ee102c874b2f3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T06:22:37.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:36 smithi081 podman[65617]: 2024-09-21 06:22:36.925257514 +0000 UTC m=+0.735206735 container cleanup 12b0bdb4e82101577e07f02b031ce3ec871291dd3493110a5ee102c874b2f3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T06:22:37.257 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:36 smithi081 bash[65617]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:22:37.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:22:37.516 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:37 smithi081 podman[65629]: 2024-09-21 06:22:37.288928514 +0000 UTC m=+0.827845042 container remove 12b0bdb4e82101577e07f02b031ce3ec871291dd3493110a5ee102c874b2f3e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T06:22:37.516 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:37 smithi081 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T06:22:37.516 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:37 smithi081 systemd[1]: Stopped Ceph mon.b for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:22:37.517 INFO:journalctl@ceph.mon.b.smithi081.stdout:Sep 21 06:22:37 smithi081 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.b.service: Consumed 11.675s CPU time. 2024-09-21T06:22:37.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:37.549 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:22:37.549 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:22:37.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:22:37.866 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:37 smithi089 systemd[1]: Stopping Ceph mon.c for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:38.366 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-c[33875]: 2024-09-21T06:22:37.921+0000 7f1aaf19a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:38.426 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-c[33875]: 2024-09-21T06:22:37.921+0000 7f1aaf19a640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:22:38.427 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:38 smithi089 podman[66143]: 2024-09-21 06:22:38.126480213 +0000 UTC m=+0.377822604 container died 1ccfa4ff6ac29bda93f9cfc563373e9023bb3ceeb64e135212d40fc0b373a221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:22:38.784 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:38 smithi089 podman[66143]: 2024-09-21 06:22:38.564408944 +0000 UTC m=+0.815751324 container cleanup 1ccfa4ff6ac29bda93f9cfc563373e9023bb3ceeb64e135212d40fc0b373a221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:22:38.784 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:38 smithi089 bash[66143]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:22:39.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:22:39.041 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:38 smithi089 podman[66156]: 2024-09-21 06:22:38.783157545 +0000 UTC m=+0.651321519 container remove 1ccfa4ff6ac29bda93f9cfc563373e9023bb3ceeb64e135212d40fc0b373a221 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:22:39.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:39 smithi089 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-21T06:22:39.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:39 smithi089 systemd[1]: Stopped Ceph mon.c for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:22:39.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 06:22:39 smithi089 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mon.c.service: Consumed 11.772s CPU time. 2024-09-21T06:22:39.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:39.071 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:22:39.072 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:22:39.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:22:39.387 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:39 smithi017 systemd[1]: Stopping Ceph mgr.x for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:39.669 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:22:39.422+0000 7f4c2d629640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:39.670 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x[31307]: 2024-09-21T06:22:39.422+0000 7f4c2d629640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T06:22:39.670 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:39 smithi017 podman[168163]: 2024-09-21 06:22:39.463999496 +0000 UTC m=+0.188074217 container died f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:22:40.127 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:39 smithi017 podman[168163]: 2024-09-21 06:22:39.882090275 +0000 UTC m=+0.606164986 container cleanup f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:22:40.127 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:39 smithi017 bash[168163]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:22:40.377 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Sep 21 06:22:40 smithi017 podman[168177]: 2024-09-21 06:22:40.125747681 +0000 UTC m=+0.658038728 container remove f112c35d4efb028167de8cee1ac12759e9df1eee7fd17d8b37772f8341d4604b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:22:40.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:22:40.436 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:40.436 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:22:40.436 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:22:40.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:22:40.758 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:22:40 smithi081 systemd[1]: Stopping Ceph mgr.y for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:41.120 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:22:40 smithi081 podman[65751]: 2024-09-21 06:22:40.797284554 +0000 UTC m=+0.162896253 container died ec8a87428cd0b78a68e2bb1ecc585b529d51ab4dc956912f25c5688022850dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:22:41.454 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:22:41 smithi081 podman[65751]: 2024-09-21 06:22:41.201776416 +0000 UTC m=+0.567388115 container cleanup ec8a87428cd0b78a68e2bb1ecc585b529d51ab4dc956912f25c5688022850dd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:22:41.455 INFO:journalctl@ceph.mgr.y.smithi081.stdout:Sep 21 06:22:41 smithi081 bash[65751]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:22:41.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:22:41.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:41.614 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:22:41.614 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:22:41.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:22:41.960 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:22:41 smithi089 systemd[1]: Stopping Ceph mgr.z for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:42.238 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:22:41 smithi089 podman[66267]: 2024-09-21 06:22:41.959011142 +0000 UTC m=+0.151771959 container died b145c045349aa45d4812fbfd72ad358f054fa6eb3a3b68ffe5e20952207472e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:22:42.616 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:22:42 smithi089 podman[66267]: 2024-09-21 06:22:42.356543199 +0000 UTC m=+0.549304014 container cleanup b145c045349aa45d4812fbfd72ad358f054fa6eb3a3b68ffe5e20952207472e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-21T06:22:42.616 INFO:journalctl@ceph.mgr.z.smithi089.stdout:Sep 21 06:22:42 smithi089 bash[66267]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:22:42.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:22:42.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:42.785 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:22:42.786 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:22:42.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:22:43.137 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:42 smithi017 systemd[1]: Stopping Ceph osd.0 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:43.637 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0[47023]: 2024-09-21T06:22:43.136+0000 7fe69386c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:43.637 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0[47023]: 2024-09-21T06:22:43.137+0000 7fe69386c640 -1 osd.0 88 *** Got signal Terminated *** 2024-09-21T06:22:43.637 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0[47023]: 2024-09-21T06:22:43.137+0000 7fe69386c640 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:22:48.887 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:48 smithi017 podman[168294]: 2024-09-21 06:22:48.625280792 +0000 UTC m=+5.631566145 container died b541b6a5905ded2fb524eb8388bd9ad946a45b564b504d454eb535d6c2d89914 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T06:22:49.383 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:49 smithi017 podman[168294]: 2024-09-21 06:22:49.112752721 +0000 UTC m=+6.119038071 container cleanup b541b6a5905ded2fb524eb8388bd9ad946a45b564b504d454eb535d6c2d89914 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:22:49.383 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:49 smithi017 bash[168294]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:22:49.637 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:49 smithi017 podman[168309]: 2024-09-21 06:22:49.381134665 +0000 UTC m=+0.750750972 container remove b541b6a5905ded2fb524eb8388bd9ad946a45b564b504d454eb535d6c2d89914 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:22:49.903 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:49 smithi017 podman[168396]: 2024-09-21 06:22:49.600946121 +0000 UTC m=+0.016521689 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:22:49.904 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:49 smithi017 podman[168396]: 2024-09-21 06:22:49.748953512 +0000 UTC m=+0.164529065 container create e7ec7f9ad6bbd1258eb45ac3b0604d5bbbe7f8db0f9bf45b004858e83a3e5d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T06:22:50.156 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:50 smithi017 podman[168396]: 2024-09-21 06:22:50.03481989 +0000 UTC m=+0.450395452 container init e7ec7f9ad6bbd1258eb45ac3b0604d5bbbe7f8db0f9bf45b004858e83a3e5d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:22:50.156 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:50 smithi017 podman[168396]: 2024-09-21 06:22:50.038959672 +0000 UTC m=+0.454535231 container start e7ec7f9ad6bbd1258eb45ac3b0604d5bbbe7f8db0f9bf45b004858e83a3e5d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:22:50.548 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:50 smithi017 podman[168396]: 2024-09-21 06:22:50.155128581 +0000 UTC m=+0.570704152 container attach e7ec7f9ad6bbd1258eb45ac3b0604d5bbbe7f8db0f9bf45b004858e83a3e5d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:22:50.548 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 21 06:22:50 smithi017 podman[168396]: 2024-09-21 06:22:50.239369003 +0000 UTC m=+0.654944579 container died e7ec7f9ad6bbd1258eb45ac3b0604d5bbbe7f8db0f9bf45b004858e83a3e5d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T06:22:50.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:22:51.007 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:51.007 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:22:51.008 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:22:51.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:22:51.308 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:51 smithi081 systemd[1]: Stopping Ceph osd.1 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:51.757 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1[37832]: 2024-09-21T06:22:51.306+0000 7f5e6f947640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:51.757 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1[37832]: 2024-09-21T06:22:51.306+0000 7f5e6f947640 -1 osd.1 88 *** Got signal Terminated *** 2024-09-21T06:22:51.758 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1[37832]: 2024-09-21T06:22:51.306+0000 7f5e6f947640 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:22:56.967 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:56 smithi081 podman[65877]: 2024-09-21 06:22:56.696037484 +0000 UTC m=+5.498002621 container died dc3a5ad952ef0e6545494193edf7a27fe3ab778b0de9ec6e63ea0e5296c42115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-21T06:22:57.257 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 podman[65877]: 2024-09-21 06:22:57.096433843 +0000 UTC m=+5.898398980 container cleanup dc3a5ad952ef0e6545494193edf7a27fe3ab778b0de9ec6e63ea0e5296c42115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:22:57.258 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 bash[65877]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:22:57.705 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 podman[65893]: 2024-09-21 06:22:57.350829138 +0000 UTC m=+0.656627304 container remove dc3a5ad952ef0e6545494193edf7a27fe3ab778b0de9ec6e63ea0e5296c42115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:22:57.972 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 podman[65979]: 2024-09-21 06:22:57.606606696 +0000 UTC m=+0.015368303 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:22:57.972 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 podman[65979]: 2024-09-21 06:22:57.735226656 +0000 UTC m=+0.143988245 container create 3a39d77c4febe89c1dbba2f2599ddc0b36700495ec4215f150d78c7d74b6796c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T06:22:58.258 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 podman[65979]: 2024-09-21 06:22:57.971277556 +0000 UTC m=+0.380039163 container init 3a39d77c4febe89c1dbba2f2599ddc0b36700495ec4215f150d78c7d74b6796c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:22:58.258 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:57 smithi081 podman[65979]: 2024-09-21 06:22:57.974902866 +0000 UTC m=+0.383664464 container start 3a39d77c4febe89c1dbba2f2599ddc0b36700495ec4215f150d78c7d74b6796c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:22:58.258 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:58 smithi081 podman[65979]: 2024-09-21 06:22:58.07172145 +0000 UTC m=+0.480483057 container attach 3a39d77c4febe89c1dbba2f2599ddc0b36700495ec4215f150d78c7d74b6796c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:22:58.259 INFO:journalctl@ceph.osd.1.smithi081.stdout:Sep 21 06:22:58 smithi081 podman[65979]: 2024-09-21 06:22:58.159317213 +0000 UTC m=+0.568078810 container died 3a39d77c4febe89c1dbba2f2599ddc0b36700495ec4215f150d78c7d74b6796c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T06:22:58.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:22:58.849 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:22:58.849 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:22:58.849 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:22:58.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:22:59.236 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:22:58 smithi089 systemd[1]: Stopping Ceph osd.2 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:22:59.616 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:22:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2[38266]: 2024-09-21T06:22:59.233+0000 7fb0ca66d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:22:59.616 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:22:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2[38266]: 2024-09-21T06:22:59.234+0000 7fb0ca66d640 -1 osd.2 88 *** Got signal Terminated *** 2024-09-21T06:22:59.617 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:22:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2[38266]: 2024-09-21T06:22:59.234+0000 7fb0ca66d640 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:05.023 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:04 smithi089 podman[66392]: 2024-09-21 06:23:04.76567067 +0000 UTC m=+5.721004149 container died b287bca3fef2c2fe3917a4dba18bb68896e13b902f4c2e09c51c82c7cc0d5615 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:23:05.366 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:05 smithi089 podman[66392]: 2024-09-21 06:23:05.174820398 +0000 UTC m=+6.130153876 container cleanup b287bca3fef2c2fe3917a4dba18bb68896e13b902f4c2e09c51c82c7cc0d5615 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:23:05.366 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:05 smithi089 bash[66392]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:23:05.849 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:05 smithi089 podman[66409]: 2024-09-21 06:23:05.451738341 +0000 UTC m=+0.686727249 container remove b287bca3fef2c2fe3917a4dba18bb68896e13b902f4c2e09c51c82c7cc0d5615 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:23:06.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:05 smithi089 podman[66497]: 2024-09-21 06:23:05.750788551 +0000 UTC m=+0.015980825 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:06.117 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:05 smithi089 podman[66497]: 2024-09-21 06:23:05.903804401 +0000 UTC m=+0.168996672 container create f95213249d29d0a7fceff0832fb3253892551b21f45f276f6e75be9237fbeb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:23:06.390 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:06 smithi089 podman[66497]: 2024-09-21 06:23:06.189140281 +0000 UTC m=+0.454332555 container init f95213249d29d0a7fceff0832fb3253892551b21f45f276f6e75be9237fbeb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:23:06.391 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:06 smithi089 podman[66497]: 2024-09-21 06:23:06.192636864 +0000 UTC m=+0.457829146 container start f95213249d29d0a7fceff0832fb3253892551b21f45f276f6e75be9237fbeb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:23:06.391 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:06 smithi089 podman[66497]: 2024-09-21 06:23:06.272490105 +0000 UTC m=+0.537682421 container attach f95213249d29d0a7fceff0832fb3253892551b21f45f276f6e75be9237fbeb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T06:23:06.752 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 06:23:06 smithi089 podman[66497]: 2024-09-21 06:23:06.390007726 +0000 UTC m=+0.655199999 container died f95213249d29d0a7fceff0832fb3253892551b21f45f276f6e75be9237fbeb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T06:23:07.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:23:07.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:07.131 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:23:07.131 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:23:07.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:23:07.460 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:07 smithi017 systemd[1]: Stopping Ceph osd.3 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:07.887 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:07 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:23:07.457+0000 7f368f58d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:07.887 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:07 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:23:07.458+0000 7f368f58d640 -1 osd.3 88 *** Got signal Terminated *** 2024-09-21T06:23:07.887 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:07 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:23:07.458+0000 7f368f58d640 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:10.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:09 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:09.882+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:11.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:10 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:10.931+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:11.867 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:11.386+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:12.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:11 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:11.965+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:12.387 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:11 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3[53387]: 2024-09-21T06:23:11.912+0000 7f3687b70640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:45.731448+0000 front 2024-09-21T06:22:45.731417+0000 (oldest deadline 2024-09-21T06:23:11.631625+0000) 2024-09-21T06:23:12.866 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:12.391+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:13.126 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:12 smithi017 podman[168504]: 2024-09-21 06:23:12.839449147 +0000 UTC m=+5.508111120 container died 051b6271b488d76dad2a657455d7c85dfae8be9a73dc8cc4613fe932d0eb6908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:23:13.126 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:12 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:12.874+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:13.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:12 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:12.963+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:13.387 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:13 smithi017 podman[168504]: 2024-09-21 06:23:13.334420326 +0000 UTC m=+6.003082296 container cleanup 051b6271b488d76dad2a657455d7c85dfae8be9a73dc8cc4613fe932d0eb6908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:23:13.387 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:13 smithi017 bash[168504]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:23:13.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:13 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:13.123+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:13.866 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:13.372+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:13.887 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:13 smithi017 podman[168518]: 2024-09-21 06:23:13.611400116 +0000 UTC m=+0.764331634 container remove 051b6271b488d76dad2a657455d7c85dfae8be9a73dc8cc4613fe932d0eb6908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:23:14.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:13 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:13.919+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:14.265 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:13 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:13.920+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:14.266 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:14 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:14.154+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:14.266 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:13 smithi017 podman[168608]: 2024-09-21 06:23:13.866710835 +0000 UTC m=+0.016197135 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:14.266 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:13 smithi017 podman[168608]: 2024-09-21 06:23:13.995704806 +0000 UTC m=+0.145191111 container create e4e9f48e6378ac8b52c66eed6bba58fcfe0485cec98a4026b464fe8642bdbb2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:23:14.356 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:14.023+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:14.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:14.355+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:14.637 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:14 smithi017 podman[168608]: 2024-09-21 06:23:14.26482066 +0000 UTC m=+0.414306960 container init e4e9f48e6378ac8b52c66eed6bba58fcfe0485cec98a4026b464fe8642bdbb2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:23:14.638 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:14 smithi017 podman[168608]: 2024-09-21 06:23:14.268377056 +0000 UTC m=+0.417863361 container start e4e9f48e6378ac8b52c66eed6bba58fcfe0485cec98a4026b464fe8642bdbb2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:23:14.638 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:14 smithi017 podman[168608]: 2024-09-21 06:23:14.364786861 +0000 UTC m=+0.514273160 container attach e4e9f48e6378ac8b52c66eed6bba58fcfe0485cec98a4026b464fe8642bdbb2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:23:14.638 INFO:journalctl@ceph.osd.3.smithi017.stdout:Sep 21 06:23:14 smithi017 podman[168608]: 2024-09-21 06:23:14.460900277 +0000 UTC m=+0.610386587 container died e4e9f48e6378ac8b52c66eed6bba58fcfe0485cec98a4026b464fe8642bdbb2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T06:23:15.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:14 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:14.893+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:15.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:14 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:14.907+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:15.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:23:15.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:15.314 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:23:15.314 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:23:15.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:23:15.344 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:15.010+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:15.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:15.342+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:15.631 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:15 smithi081 systemd[1]: Stopping Ceph osd.4 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:15.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:15 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:15.155+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:15.881 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:15 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:23:15.628+0000 7f382962a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:15.881 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:15 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:23:15.628+0000 7f382962a640 -1 osd.4 88 *** Got signal Terminated *** 2024-09-21T06:23:15.881 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:15 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:23:15.629+0000 7f382962a640 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:16.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:15 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:15.883+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:16.137 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:16 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:16.132+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:16.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:15 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:15.879+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:16.309 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:16.048+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:16.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:16.306+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:17.116 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:17 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:16.999+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:17.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:16 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:16.912+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:17.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:16 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:16.897+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:17.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:17 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:17.122+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:17.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:17 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:17.319+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:17.867 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:17 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:23:17.583+0000 7f3825c15640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:53.762112+0000 front 2024-09-21T06:22:53.762142+0000 (oldest deadline 2024-09-21T06:23:17.262242+0000) 2024-09-21T06:23:18.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:17 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:17.865+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:18.301 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:18 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:18.019+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:18.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:17 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:17.924+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:18.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:18 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:18.131+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:18.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:18 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:18.299+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:18.618 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:18 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:18.310+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:18.884 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:18 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:23:18.617+0000 7f3825c15640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:53.762112+0000 front 2024-09-21T06:22:53.762142+0000 (oldest deadline 2024-09-21T06:23:17.262242+0000) 2024-09-21T06:23:19.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:18 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:18.883+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:19.329 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:19 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:19.028+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:19.330 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:19 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:19.160+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:19.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:18 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:18.936+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:19.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:18 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:18.936+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:19.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:19 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:19.104+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:19.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:19 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:19.104+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:19.602 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:19 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:19.333+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:19.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:19 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:19.328+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:19.895 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:19 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4[44217]: 2024-09-21T06:23:19.599+0000 7f3825c15640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:53.762112+0000 front 2024-09-21T06:22:53.762142+0000 (oldest deadline 2024-09-21T06:23:17.262242+0000) 2024-09-21T06:23:20.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:19 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:19.892+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:20.328 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:20 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:20.114+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:20.328 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:20 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:20.016+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:20.328 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:20 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:20.016+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:20.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:19 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:19.919+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:20.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:19 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:19.919+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:20.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:20 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:20.070+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:20.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:20 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:20.070+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:20.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:20 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:20.326+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:20.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:20 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:20.383+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:21.258 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:21 smithi081 podman[66098]: 2024-09-21 06:23:21.092400815 +0000 UTC m=+5.580704120 container died 2b445c0d3112bce708e2f9fc021b15e3f8f91bd65843181dbf6069c81b13d3d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:23:21.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:20 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:20.864+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:21.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:20 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:20.864+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:21.366 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:21 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:21.140+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:21.367 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:21 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:21.027+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:21.367 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:21 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:21.027+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:21.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:20 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:20.931+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:21.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:20 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:20.931+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:21.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:21.113+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:21.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:21.113+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:21.740 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:21 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:21.404+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:21.741 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:21 smithi081 podman[66098]: 2024-09-21 06:23:21.521259247 +0000 UTC m=+6.009562552 container cleanup 2b445c0d3112bce708e2f9fc021b15e3f8f91bd65843181dbf6069c81b13d3d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:23:21.741 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:21 smithi081 bash[66098]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:23:21.866 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:21 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:21.368+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:22.007 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:21 smithi081 podman[66114]: 2024-09-21 06:23:21.739502072 +0000 UTC m=+0.649461990 container remove 2b445c0d3112bce708e2f9fc021b15e3f8f91bd65843181dbf6069c81b13d3d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:23:22.008 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:21 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:21.872+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:22.008 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:21 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:21.872+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:22.366 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:22 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:22.161+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:22.367 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:21 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:21.987+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:22.367 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:21 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:21.987+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:22.386 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:22 smithi081 podman[66200]: 2024-09-21 06:23:22.037624764 +0000 UTC m=+0.015844853 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:22.386 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:22 smithi081 podman[66200]: 2024-09-21 06:23:22.144775714 +0000 UTC m=+0.122995802 container create 8d9379bac000b02f91c38e7af88df9bae8b3ae075b44cea27dc4e4ea7ac88f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:23:22.386 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:22 smithi081 podman[66200]: 2024-09-21 06:23:22.385229657 +0000 UTC m=+0.363449746 container init 8d9379bac000b02f91c38e7af88df9bae8b3ae075b44cea27dc4e4ea7ac88f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:23:22.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:21.980+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:22.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:21 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:21.980+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:22.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:22 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:22.154+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:22.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:22 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:22.154+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:22.758 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:22 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:22.427+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:22.758 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:22 smithi081 podman[66200]: 2024-09-21 06:23:22.388548648 +0000 UTC m=+0.366768745 container start 8d9379bac000b02f91c38e7af88df9bae8b3ae075b44cea27dc4e4ea7ac88f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T06:23:22.758 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:22 smithi081 podman[66200]: 2024-09-21 06:23:22.485042968 +0000 UTC m=+0.463263072 container attach 8d9379bac000b02f91c38e7af88df9bae8b3ae075b44cea27dc4e4ea7ac88f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:23:22.758 INFO:journalctl@ceph.osd.4.smithi081.stdout:Sep 21 06:23:22 smithi081 podman[66200]: 2024-09-21 06:23:22.583936222 +0000 UTC m=+0.562156313 container died 8d9379bac000b02f91c38e7af88df9bae8b3ae075b44cea27dc4e4ea7ac88f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:23:22.866 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:22 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:22.374+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:23.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:22 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:22.859+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:23.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:22 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:22.859+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:23.340 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:23.131+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:23.340 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:23.021+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:23.340 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:23.021+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:23.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:23:23.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:23.387 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:23:23.387 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:23:23.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:23:23.388 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:22 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:22.967+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:23.388 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:22 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:22.967+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:23.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:23 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:23.143+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:23.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:23 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:23.143+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:23.617 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:23 smithi089 systemd[1]: Stopping Ceph osd.5 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:23.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:23.338+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:23.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:23 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:23.444+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:24.017 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:23.688+0000 7f53d010e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:24.017 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:23.688+0000 7f53d010e640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-21T06:23:24.017 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:23 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:23.688+0000 7f53d010e640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:24.017 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:24.014+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:24.017 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:24.014+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:24.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:23 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:23.901+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:24.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:23 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:23.901+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:24.312 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:24.134+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:24.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:23 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:23.972+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:24.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:23 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:23.972+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:24.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:24.184+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:24.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:24.184+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:24.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:24.311+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:24.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:24.445+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:25.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:24.890+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:25.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:24 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:24.890+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:25.297 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:25 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:25.181+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:25.297 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:25 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:25.181+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:25.297 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:24.984+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:25.298 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:24 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:24.984+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:25.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:24.998+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:25.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:24.998+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:25.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:25.162+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:25.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:25.162+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:25.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:25.162+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:25.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:25 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:25.295+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:25.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:25 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:25.451+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:26.207 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:25 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:25.950+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:26.207 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:25 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:25.950+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:26.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:25 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:25.931+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:26.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:25 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:25.931+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:26.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:25.971+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:26.388 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:25.971+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:26.388 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:25 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:25.971+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:26.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:26 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:26.173+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:26.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:26 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:26.173+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:26.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:26 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:26.173+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:26.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:26 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:26.327+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:26.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:26 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:26.205+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:26.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:26 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:26.205+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:26.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:26 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:26.454+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:27.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:26 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:26.890+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:27.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:26 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:26.890+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:27.324 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:27 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:27.169+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:27.324 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:27 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:27.169+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:27.324 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:26 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:26.949+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:27.325 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:26 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:26.949+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:27.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:27.005+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:27.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:27.005+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:27.388 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:27.005+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:27.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:27.199+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:27.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:27.199+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:27.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:27.199+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:27.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:27 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:27.323+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:27.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:27 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:27.323+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:27.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:27 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:27.480+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:27.757 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:27 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:27.480+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:28.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:27 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:27.880+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:28.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:27 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:27.880+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:28.293 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:27 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:27.950+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.393068+0000 front 2024-09-21T06:22:47.393088+0000 (oldest deadline 2024-09-21T06:23:13.293114+0000) 2024-09-21T06:23:28.293 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:27 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5[44518]: 2024-09-21T06:23:27.950+0000 7f53cc6f9640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.994373+0000 front 2024-09-21T06:22:54.994194+0000 (oldest deadline 2024-09-21T06:23:19.094165+0000) 2024-09-21T06:23:28.293 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:28 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:28.192+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:28.293 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:28 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:28.192+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:28.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:27.991+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:28.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:27.991+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:28.388 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:27 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:27.991+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:28.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:28 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:28.218+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:28.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:28 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:28.218+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:28.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:28 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:28.218+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:28.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:28 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:28.291+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:28.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:28 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:28.291+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:28.897 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:28 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:28.530+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:28.897 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:28 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:28.530+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:29.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:28 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:28.894+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:29.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:28 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:28.894+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:29.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:28 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:28.894+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:29.340 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:29 smithi089 podman[66612]: 2024-09-21 06:23:29.036841237 +0000 UTC m=+5.455262749 container died 7009066fd8c4ff79924825c6aea5a1b7d039e753304d43fc587fb5f6ce2312a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T06:23:29.340 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:29 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:29.238+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:29.340 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:29 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:29.238+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:29.341 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:29 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:29.253+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:29.341 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:29 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:29.253+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:29.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:28 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:28.947+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:29.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:28 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:28.947+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:29.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:28 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:28.947+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:29.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:29.174+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:29.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:29.174+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:29.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:29.174+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:29.616 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:29 smithi089 podman[66612]: 2024-09-21 06:23:29.438356936 +0000 UTC m=+5.856778448 container cleanup 7009066fd8c4ff79924825c6aea5a1b7d039e753304d43fc587fb5f6ce2312a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:23:29.617 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:29 smithi089 bash[66612]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:23:29.943 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:29 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:29.560+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:29.943 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:29 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:29.560+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:30.056 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:29 smithi089 podman[66627]: 2024-09-21 06:23:29.698405855 +0000 UTC m=+0.658244573 container remove 7009066fd8c4ff79924825c6aea5a1b7d039e753304d43fc587fb5f6ce2312a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T06:23:30.204 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:29.915+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:30.204 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:29.915+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:30.204 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:29.915+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:30.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:29 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:29.941+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:30.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:29 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:29.941+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:30.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:29 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:29.941+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:30.336 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:30 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:30.253+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:30.336 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:30 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:30.253+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:30.336 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:30 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:30.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:30.336 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:30 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:30.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:30.337 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:30 smithi089 podman[66719]: 2024-09-21 06:23:29.958077923 +0000 UTC m=+0.015650302 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:30.337 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:30 smithi089 podman[66719]: 2024-09-21 06:23:30.074162652 +0000 UTC m=+0.131735004 container create 1e90c67f6a92a09730d21930c73c15f35fec7510f8fdd628eed5eb7fd606ff64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T06:23:30.616 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:30 smithi089 podman[66719]: 2024-09-21 06:23:30.335260482 +0000 UTC m=+0.392832843 container init 1e90c67f6a92a09730d21930c73c15f35fec7510f8fdd628eed5eb7fd606ff64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:23:30.617 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:30 smithi089 podman[66719]: 2024-09-21 06:23:30.338714697 +0000 UTC m=+0.396287052 container start 1e90c67f6a92a09730d21930c73c15f35fec7510f8fdd628eed5eb7fd606ff64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T06:23:30.617 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:30 smithi089 podman[66719]: 2024-09-21 06:23:30.426981145 +0000 UTC m=+0.484553522 container attach 1e90c67f6a92a09730d21930c73c15f35fec7510f8fdd628eed5eb7fd606ff64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T06:23:30.617 INFO:journalctl@ceph.osd.5.smithi089.stdout:Sep 21 06:23:30 smithi089 podman[66719]: 2024-09-21 06:23:30.523217134 +0000 UTC m=+0.580789494 container died 1e90c67f6a92a09730d21930c73c15f35fec7510f8fdd628eed5eb7fd606ff64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T06:23:30.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:30 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:30.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:30.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:30 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:30.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:30.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:30 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:30.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:30.968 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:30 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:30.583+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:30.969 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:30 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:30.583+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:31.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:30 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:30.866+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:31.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:30 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:30.866+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:31.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:30 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:30.866+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:31.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:23:31.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:31.215 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:23:31.215 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:23:31.215 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:23:31.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:30 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:30.966+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:31.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:30 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:30.966+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:31.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:30 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:30.966+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:31.531 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 systemd[1]: Stopping Ceph osd.6 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:31.531 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:31.168+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:31.531 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:31.168+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:31.531 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:31.168+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:31.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:31 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:31.264+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:31.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:31 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:31.264+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:31.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:31 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:31.210+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:31.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:31 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:31.210+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:31.836 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:31.528+0000 7fa5d5b7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:31.836 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:31.528+0000 7fa5d5b7c640 -1 osd.6 88 *** Got signal Terminated *** 2024-09-21T06:23:31.836 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:31.528+0000 7fa5d5b7c640 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:31.836 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:31.834+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:31.836 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:31.834+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:31.836 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:31 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:31.834+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:31.999 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:31 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:31.623+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:31.999 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:31 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:31.623+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:32.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:31 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:31.997+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:32.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:31 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:31.997+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:32.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:31 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:31.997+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:32.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:32 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:32.231+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:32.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:32 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:32.231+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:32.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:32 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:32.177+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:32.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:32 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:32.177+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:32.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:32 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:32.157+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:32.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:32 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:32.157+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:32.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:32 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:32.157+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:33.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:32 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:32.642+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:33.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:32 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:32.642+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:33.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:32 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:32.859+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:33.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:32 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:32.859+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:33.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:32 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:32.859+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:33.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:33 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:33.016+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:33.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:33 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:33.016+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:33.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:33 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:33.016+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:33.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:33 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:33.270+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:33.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:33 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:33.270+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:33.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:33 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:33.183+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:33.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:33 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:33.183+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:33.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:33.201+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:33.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:33.201+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:33.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:33.201+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:34.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:33 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:33.682+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:34.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:33 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:33.682+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:34.250 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:33.903+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:34.250 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:33.903+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:34.250 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:33.903+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:34.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:34 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:34.025+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:34.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:34 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:34.025+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:34.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:34 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:34.025+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:34.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:34 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:34.261+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:34.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:34 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:34.261+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:34.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:34 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:34.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:34.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:34 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:34.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:34.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:34.248+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:34.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:34.248+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:34.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:34.248+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:34.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:34.248+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:35.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:34 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:34.701+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:35.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:34 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:34.701+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:35.209 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:34.937+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:35.209 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:34.937+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:35.209 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:34 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:34.937+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:35.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:35 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:35.018+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:35.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:35 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:35.018+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:35.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:35 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:35.018+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:35.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:35 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:35.018+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:35.517 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:35 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:35.241+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:35.518 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:35 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:35.241+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:35.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:35 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:35.189+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:35.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:35 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:35.189+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:35.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:35.207+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:35.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:35.207+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:35.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:35.207+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:35.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:35.207+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:36.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:35 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:35.660+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:36.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:35 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:35.660+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:36.248 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:35.936+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.975784+0000 front 2024-09-21T06:22:47.975551+0000 (oldest deadline 2024-09-21T06:23:12.675795+0000) 2024-09-21T06:23:36.248 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:35.936+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.676232+0000 front 2024-09-21T06:22:52.676401+0000 (oldest deadline 2024-09-21T06:23:18.576391+0000) 2024-09-21T06:23:36.248 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:35.936+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:22:59.077865+0000 front 2024-09-21T06:22:59.077735+0000 (oldest deadline 2024-09-21T06:23:25.478255+0000) 2024-09-21T06:23:36.248 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:35 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6[60003]: 2024-09-21T06:23:35.936+0000 7fa5ce15f640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.579161+0000 front 2024-09-21T06:23:09.579204+0000 (oldest deadline 2024-09-21T06:23:35.479326+0000) 2024-09-21T06:23:36.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:36.023+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:36.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:36.023+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:36.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:36.023+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:36.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:36.023+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:36.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:36 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:36.213+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:36.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:36 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:36.213+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:36.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:36 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:36.285+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:36.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:36 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:36.285+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:36.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:36 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:36.285+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:36.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:36 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:36.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:36.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:36 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:36.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:36.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:36 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:36.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:36.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:36 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:36.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:37.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:36.693+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:37.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:36 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:36.693+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:37.387 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:36 smithi017 podman[168709]: 2024-09-21 06:23:36.975383534 +0000 UTC m=+5.557063190 container died b2f897a88a139f107faf5d6ab53026894e24747ad47bd943efff0a72ceb51c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:23:37.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:37 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:37.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:37.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:37 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:37.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:37.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:37 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:37.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:37.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:37 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:37.202+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:37.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:37.032+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:37.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:37.032+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:37.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:37.032+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:37.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:37.032+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:37.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:37.244+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:37.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:37.244+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:37.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:37.328+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:37.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:37.328+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:37.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:37 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:37.328+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:37.815 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:37 smithi017 podman[168709]: 2024-09-21 06:23:37.587965965 +0000 UTC m=+6.169645651 container cleanup b2f897a88a139f107faf5d6ab53026894e24747ad47bd943efff0a72ceb51c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T06:23:37.815 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:37 smithi017 bash[168709]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:23:38.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:37.707+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:38.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:37 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:37.707+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:38.137 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:37 smithi017 podman[168724]: 2024-09-21 06:23:37.814236422 +0000 UTC m=+0.835853675 container remove b2f897a88a139f107faf5d6ab53026894e24747ad47bd943efff0a72ceb51c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:23:38.502 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:38 smithi017 podman[168809]: 2024-09-21 06:23:38.166592442 +0000 UTC m=+0.016239714 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:38.502 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:38 smithi017 podman[168809]: 2024-09-21 06:23:38.264937228 +0000 UTC m=+0.114584544 container create e2e0bc93fc8d9ad1b1a2d23435fba432fde13f56a10ec2a5160a21290bd5d9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:23:38.502 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:38 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:38.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:38.502 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:38 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:38.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:38.502 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:38 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:38.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:38.502 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:38 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:38.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:38.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:38.009+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:38.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:38.009+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:38.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:38.009+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:38.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:38.009+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:38.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:38 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:38.374+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:38.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:38 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:38.374+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:38.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:38 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:38.374+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:38.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:38 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:38.257+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:38.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:38 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:38.257+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:38.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:38 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:38.257+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:38.887 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:38 smithi017 podman[168809]: 2024-09-21 06:23:38.500970395 +0000 UTC m=+0.350617676 container init e2e0bc93fc8d9ad1b1a2d23435fba432fde13f56a10ec2a5160a21290bd5d9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:23:38.888 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:38 smithi017 podman[168809]: 2024-09-21 06:23:38.504722272 +0000 UTC m=+0.354369544 container start e2e0bc93fc8d9ad1b1a2d23435fba432fde13f56a10ec2a5160a21290bd5d9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:23:38.888 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:38 smithi017 podman[168809]: 2024-09-21 06:23:38.609179873 +0000 UTC m=+0.458827157 container attach e2e0bc93fc8d9ad1b1a2d23435fba432fde13f56a10ec2a5160a21290bd5d9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:23:38.888 INFO:journalctl@ceph.osd.6.smithi017.stdout:Sep 21 06:23:38 smithi017 podman[168809]: 2024-09-21 06:23:38.700776594 +0000 UTC m=+0.550423868 container died e2e0bc93fc8d9ad1b1a2d23435fba432fde13f56a10ec2a5160a21290bd5d9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:23:39.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:38.687+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:39.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:38.687+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:39.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:38.687+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:07.794178+0000 front 2024-09-21T06:23:07.794204+0000 (oldest deadline 2024-09-21T06:23:37.794707+0000) 2024-09-21T06:23:39.289 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:39.037+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:39.289 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:39.037+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:39.289 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:39.037+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:39.289 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:39.037+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:39.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:39.286+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:39.387 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:39.286+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:39.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:39.286+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:39.388 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:39 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:39.286+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:39.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:23:39.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:39.483 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:23:39.483 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:23:39.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:23:39.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:39 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:39.376+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:39.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:39 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:39.376+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:39.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:39 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:39.376+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:39.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:39 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:39.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:39.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:39 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:39.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:39.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:39 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:39.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:39.711 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 systemd[1]: Stopping Ceph osd.7 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:40.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:39.709+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:40.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:39.709+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:40.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:39.709+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:07.794178+0000 front 2024-09-21T06:23:07.794204+0000 (oldest deadline 2024-09-21T06:23:37.794707+0000) 2024-09-21T06:23:40.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:39.808+0000 7facfb821640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:40.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:39.808+0000 7facfb821640 -1 osd.7 88 *** Got signal Terminated *** 2024-09-21T06:23:40.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:39 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:39.808+0000 7facfb821640 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:40.298 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:40.045+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:40.299 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:40.045+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:40.299 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:40.045+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:40.299 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:40.045+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:40.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:40 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:40.422+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:40.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:40 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:40.422+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:40.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:40 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:40.422+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:40.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:40 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:40.184+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:40.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:40 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:40.184+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:40.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:40 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:40.184+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:40.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:40 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:40.284+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:40.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:40 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:40.285+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:40.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:40 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:40.285+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:40.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:40 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:40.285+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:41.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:40.746+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:41.007 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:40.746+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:41.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:40 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:40.746+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:07.794178+0000 front 2024-09-21T06:23:07.794204+0000 (oldest deadline 2024-09-21T06:23:37.794707+0000) 2024-09-21T06:23:41.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:41.031+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:41.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:41.031+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:41.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:41.031+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:41.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:41.031+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:41.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:41 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:41.448+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:41.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:41 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:41.448+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:41.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:41 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:41.448+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:41.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:41 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:41.228+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:41.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:41 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:41.228+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:41.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:41 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:41.228+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:41.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:41 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:41.273+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:41.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:41 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:41.273+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:41.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:41 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:41.273+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:41.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:41 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:41.273+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:42.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:42.010+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:42.010+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:42.010+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:42.010+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:42.010+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:41.792+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:41.792+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:42.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:41 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:41.792+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:07.794178+0000 front 2024-09-21T06:23:07.794204+0000 (oldest deadline 2024-09-21T06:23:37.794707+0000) 2024-09-21T06:23:42.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:42.491+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:42.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:42.491+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:42.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:42.491+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:42.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:42.247+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:42.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:42.247+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:42.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:42.247+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:42.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:42 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:42.247+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:42.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:42 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:42.303+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:42.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:42 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:42.303+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:42.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:42 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:42.303+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:42.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:42 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:42.303+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:42.833+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:42.833+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:42.833+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:07.794178+0000 front 2024-09-21T06:23:07.794204+0000 (oldest deadline 2024-09-21T06:23:37.794707+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:42.833+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.495781+0000 front 2024-09-21T06:23:19.495819+0000 (oldest deadline 2024-09-21T06:23:41.795895+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:43.053+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:43.053+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:43.053+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:43.053+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:43.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:43.053+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:43.541 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:43.248+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:43.541 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:43.248+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:43.542 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:43.248+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:43.542 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:43.248+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:43.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:43.268+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:43.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:43.268+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:43.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:43.268+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:43.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:43 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:43.268+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:43.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:43.539+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:43.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:43.539+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:43.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:43 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:43.539+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:43.824+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.391577+0000 front 2024-09-21T06:22:54.391533+0000 (oldest deadline 2024-09-21T06:23:17.891587+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:43.824+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:01.993075+0000 front 2024-09-21T06:23:01.992758+0000 (oldest deadline 2024-09-21T06:23:26.692820+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:43.824+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:07.794178+0000 front 2024-09-21T06:23:07.794204+0000 (oldest deadline 2024-09-21T06:23:37.794707+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:43 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7[50816]: 2024-09-21T06:23:43.824+0000 7facf3e04640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.495781+0000 front 2024-09-21T06:23:19.495819+0000 (oldest deadline 2024-09-21T06:23:41.795895+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:44 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:44.035+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:44 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:44.035+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:44 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:44.035+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:44 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:44.035+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:44.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:44 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:44.035+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:44.525 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:44.231+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:44.525 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:44.231+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:44.525 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:44.231+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:44.525 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:44.231+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:44.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:44 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:44.308+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:44.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:44 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:44.308+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:44.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:44 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:44.308+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:44.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:44 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:44.308+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:44.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:44.523+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:44.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:44.523+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:44.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:44.523+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:44.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:44 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:44.523+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:45.331 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:45 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:45.057+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:45.332 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:45 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:45.057+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:45.332 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:45 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:45.057+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:45.332 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:45 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:45.057+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:45.332 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:45 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:45.057+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:45.535 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:45.262+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:45.535 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:45.262+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:45.535 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:45.262+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:45.535 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:45.262+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:45.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:45 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:45.277+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:45.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:45 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:45.277+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:45.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:45 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:45.277+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:45.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:45 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:45.277+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:45.661 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:45 smithi081 podman[66311]: 2024-09-21 06:23:45.330584413 +0000 UTC m=+5.650746943 container died d0dc9dee8cd6670a1bf87ede079ed02ff1941a929b0df49ecd4297c8f287f184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T06:23:45.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:45.533+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:45.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:45.533+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:45.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:45.533+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:45.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:45 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:45.533+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:46.004 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:45 smithi081 podman[66311]: 2024-09-21 06:23:45.767632508 +0000 UTC m=+6.087795071 container cleanup d0dc9dee8cd6670a1bf87ede079ed02ff1941a929b0df49ecd4297c8f287f184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:23:46.004 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:45 smithi081 bash[66311]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:23:46.257 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66329]: 2024-09-21 06:23:46.002302418 +0000 UTC m=+0.666313184 container remove d0dc9dee8cd6670a1bf87ede079ed02ff1941a929b0df49ecd4297c8f287f184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:23:46.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:46.076+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:46.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:46.076+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:46.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:46.076+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:46.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:46.076+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:46.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:46.076+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:46.561 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:46.288+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:46.561 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:46.288+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:46.561 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:46.288+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:46.561 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:46.288+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:46.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:46.239+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:46.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:46.239+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:46.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:46.239+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:46.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:46.239+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:46.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:46 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:46.239+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:46.682 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66417]: 2024-09-21 06:23:46.331766659 +0000 UTC m=+0.015344916 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:46.682 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66417]: 2024-09-21 06:23:46.453381783 +0000 UTC m=+0.136960056 container create 098b49cc3635b3d80ab10d63a1716200e00437efff0d4a2f2e44be93814914a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:23:46.682 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66417]: 2024-09-21 06:23:46.6812861 +0000 UTC m=+0.364864342 container init 098b49cc3635b3d80ab10d63a1716200e00437efff0d4a2f2e44be93814914a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:23:46.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:46.559+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:46.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:46.559+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:46.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:46.559+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:46.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:46 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:46.559+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:47.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66417]: 2024-09-21 06:23:46.684970038 +0000 UTC m=+0.368548269 container start 098b49cc3635b3d80ab10d63a1716200e00437efff0d4a2f2e44be93814914a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:23:47.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66417]: 2024-09-21 06:23:46.781008067 +0000 UTC m=+0.464586309 container attach 098b49cc3635b3d80ab10d63a1716200e00437efff0d4a2f2e44be93814914a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:23:47.008 INFO:journalctl@ceph.osd.7.smithi081.stdout:Sep 21 06:23:46 smithi081 podman[66417]: 2024-09-21 06:23:46.873588506 +0000 UTC m=+0.557166740 container died 098b49cc3635b3d80ab10d63a1716200e00437efff0d4a2f2e44be93814914a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T06:23:47.460 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:47 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:47.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:47.461 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:47 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:47.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:47.461 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:47 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:47.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:47.461 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:47 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:47.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:47.461 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:47 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:47.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:47.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:23:47.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:47.530 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:23:47.530 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:23:47.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:47.283+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:47.283+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:47.283+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:47.283+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.514+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.514+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.514+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:47.557 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.514+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:47.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:47 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:47.227+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:47.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:47 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:47.227+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:47.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:47 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:47.227+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:47.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:47 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:47.227+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:47.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:47 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:47.227+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:47.843 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 systemd[1]: Stopping Ceph osd.8 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:48.116 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.841+0000 7ff0027ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:48.117 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.841+0000 7ff0027ec640 -1 osd.8 88 *** Got signal Terminated *** 2024-09-21T06:23:48.117 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:47 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:47.841+0000 7ff0027ec640 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:48.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:48 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:48.093+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:48.510 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:48 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:48.093+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:48.510 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:48 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:48.093+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:48.510 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:48 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:48.093+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:48.510 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:48 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:48.093+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:48.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:48.494+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:48.494+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:48.494+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:48.494+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:48.301+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:48.301+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:48.301+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:48.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:48 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:48.301+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:48.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:48 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:48.263+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:48.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:48 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:48.263+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:48.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:48 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:48.263+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:48.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:48 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:48.263+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:48.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:48 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:48.263+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:49.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:49 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:49.081+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:49.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:49 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:49.081+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:49.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:49 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:49.081+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:49.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:49 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:49.081+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:49.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:49 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:49.081+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:49.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:49.502+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:49.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:49.502+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:49.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:49.502+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:49.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:49.502+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:49.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:49.312+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:49.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:49.312+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:49.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:49.312+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:49.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:49 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:49.312+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:49.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:49 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:49.214+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:49.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:49 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:49.214+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:49.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:49 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:49.214+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:49.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:49 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:49.214+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:49.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:49 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:49.214+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:50.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:50.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:50.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:50.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:50.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:50.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:50.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:50.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:50.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:50.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:50.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:50.343+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:50.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:50.343+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:50.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:50.343+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:50.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:50.343+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:50.618 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:50.519+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:50.618 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:50.519+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:50.618 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:50.519+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:50.618 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:50 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:50.519+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:50.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:50 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:50.209+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:50.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:50 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:50.209+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:50.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:50 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:50.209+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:50.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:50 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:50.209+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:50.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:50 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:50.209+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:51.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:51.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:51.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:51.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:51.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:51.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:51.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:51.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:51.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:51 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:51.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:51.536+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:51.536+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:51.536+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:51.536+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:51.536+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.839487+0000 front 2024-09-21T06:23:25.839509+0000 (oldest deadline 2024-09-21T06:23:51.139680+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:51.349+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:51.349+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:51.349+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:51.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:51 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:51.349+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:51.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:51 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:51.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:51.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:51 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:51.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:51.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:51 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:51.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:51.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:51 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:51.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:51.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:51 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:51.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:51.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:51 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:51.241+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:52.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:52 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:52.049+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:52.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:52 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:52.049+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:52.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:52 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:52.049+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:52.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:52 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:52.049+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:52.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:52 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:52.049+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:52.616 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:52.574+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:56.234696+0000 front 2024-09-21T06:22:56.234713+0000 (oldest deadline 2024-09-21T06:23:19.134507+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:52.574+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.235565+0000 front 2024-09-21T06:23:03.235735+0000 (oldest deadline 2024-09-21T06:23:24.935633+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:52.574+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:12.437477+0000 front 2024-09-21T06:23:12.437541+0000 (oldest deadline 2024-09-21T06:23:35.937637+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:52.574+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:20.038514+0000 front 2024-09-21T06:23:20.038411+0000 (oldest deadline 2024-09-21T06:23:44.138538+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8[50674]: 2024-09-21T06:23:52.574+0000 7feffedd7640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.839487+0000 front 2024-09-21T06:23:25.839509+0000 (oldest deadline 2024-09-21T06:23:51.139680+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:52.353+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:52.353+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:52.353+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:52.353+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:52.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:52 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:52.353+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:52.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:52 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:52.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:52.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:52 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:52.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:52.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:52 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:52.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:52.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:52 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:52.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:52.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:52 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:52.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:52.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:52 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:52.246+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:53.493 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:53 smithi089 podman[66821]: 2024-09-21 06:23:53.216608612 +0000 UTC m=+5.498249222 container died 448f3d942e6aee84485a2aadcd333e4a0b3cdbd23663a37817761d17d15a53fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:23:53.494 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:53 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:53.345+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:53.494 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:53 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:53.345+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:53.494 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:53 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:53.345+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:53.494 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:53 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:53.346+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:53.494 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:53 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:53.346+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:53.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:53 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:53.071+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:53.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:53 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:53.071+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:53.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:53 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:53.071+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:53.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:53 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:53.071+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:53.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:53 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:53.071+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:53.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:53 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:53.245+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:53.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:53 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:53.245+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:53.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:53 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:53.245+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:53.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:53 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:53.245+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:53.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:53 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:53.245+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:53.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:53 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:53.245+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:53.866 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:53 smithi089 podman[66821]: 2024-09-21 06:23:53.591800394 +0000 UTC m=+5.873441004 container cleanup 448f3d942e6aee84485a2aadcd333e4a0b3cdbd23663a37817761d17d15a53fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T06:23:53.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:53 smithi089 bash[66821]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:23:54.205 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:53 smithi089 podman[66838]: 2024-09-21 06:23:53.867985161 +0000 UTC m=+0.648249485 container remove 448f3d942e6aee84485a2aadcd333e4a0b3cdbd23663a37817761d17d15a53fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:23:54.458 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:54 smithi089 podman[66928]: 2024-09-21 06:23:54.106944456 +0000 UTC m=+0.015866735 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:54 smithi089 podman[66928]: 2024-09-21 06:23:54.210454121 +0000 UTC m=+0.119376384 container create eec833ebe378fd775a765763323e572475134b71771d96c583413b722fcd48ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:54 smithi089 podman[66928]: 2024-09-21 06:23:54.454320645 +0000 UTC m=+0.363242918 container init eec833ebe378fd775a765763323e572475134b71771d96c583413b722fcd48ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:54 smithi089 podman[66928]: 2024-09-21 06:23:54.457562085 +0000 UTC m=+0.366484350 container start eec833ebe378fd775a765763323e572475134b71771d96c583413b722fcd48ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:54.314+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:54.314+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:54.314+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:54.314+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:54.459 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:54.314+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:54.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:54 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:54.109+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:54.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:54 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:54.109+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:54.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:54 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:54.109+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:54.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:54 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:54.109+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:54.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:54 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:54.109+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:54.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:54 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:54.109+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:23:54.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:54 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:54.242+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:54.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:54 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:54.242+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:54.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:54 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:54.242+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:54.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:54 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:54.242+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:54.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:54 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:54.242+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:54.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:54 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:54.242+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:54.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:54 smithi089 podman[66928]: 2024-09-21 06:23:54.563214038 +0000 UTC m=+0.472136313 container attach eec833ebe378fd775a765763323e572475134b71771d96c583413b722fcd48ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:23:54.867 INFO:journalctl@ceph.osd.8.smithi089.stdout:Sep 21 06:23:54 smithi089 podman[66928]: 2024-09-21 06:23:54.642291693 +0000 UTC m=+0.551213958 container died eec833ebe378fd775a765763323e572475134b71771d96c583413b722fcd48ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:23:55.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:23:55.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:23:55.375 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:23:55.375 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:23:55.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:23:55.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:55.150+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:55.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:55.150+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:55.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:55.150+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:55.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:55.150+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:55.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:55.150+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:55.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:55 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:55.150+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:23:55.546 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:55 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:55.290+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:55.546 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:55 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:55.291+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:55.546 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:55 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:55.291+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:55.546 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:55 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:55.291+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:55.547 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:55 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:55.291+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:55.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.264+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:55.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.264+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:55.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.264+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:55.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.264+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:55.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.264+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:55.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.264+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:55.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 systemd[1]: Stopping Ceph osd.9 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:23:56.137 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.707+0000 7f5771be1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:23:56.137 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.707+0000 7f5771be1640 -1 osd.9 88 *** Got signal Terminated *** 2024-09-21T06:23:56.137 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:55 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:55.707+0000 7f5771be1640 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:23:56.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:56.128+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:56.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:56.128+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:56.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:56.128+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:56.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:56.128+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:56.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:56.128+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:56.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:56 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:56.128+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:23:56.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:56 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:56.286+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:56.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:56 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:56.286+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:56.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:56 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:56.286+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:56.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:56 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:56.286+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:56.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:56 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:56.286+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:56.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:56 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:56.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:56.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:56 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:56.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:56.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:56 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:56.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:56.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:56 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:56.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:56.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:56 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:56.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:56.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:56 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:56.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:57.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:57 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:57.124+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:57.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:57 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:57.124+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:57.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:57 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:57.124+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:57.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:57 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:57.124+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:57.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:57 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:57.124+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:57.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:57 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:57.124+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:23:57.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:57 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:57.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:57.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:57 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:57.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:57.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:57 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:57.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:57.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:57 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:57.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:57.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:57 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:57.238+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:57.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:57 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:57.328+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:57.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:57 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:57.328+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:57.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:57 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:57.328+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:57.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:57 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:57.328+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:57.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:57 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:57.328+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:57.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:57 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:57.328+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:58.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:58.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:58.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:58.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:58.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:58.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:58.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:58.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:58.510 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:58.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:58.510 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:58 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:58.102+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:23:58.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:58.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:58.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:58.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:58.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:58.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:58.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:58.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:58.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:58.214+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:58.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:58.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:58.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:58.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:58.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:58.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:58.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:58.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:58.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:58.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:58.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:58 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:58.305+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:23:59.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:59 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:59.101+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:23:59.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:59 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:59.101+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:23:59.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:59 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:59.101+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:23:59.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:59 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:59.101+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:23:59.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:59 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:59.101+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:23:59.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:23:59 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:23:59.101+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:23:59.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:59.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:23:59.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:59.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:23:59.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:59.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:23:59.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:59.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:23:59.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:23:59 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:23:59.199+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:23:59.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:59.255+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:23:59.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:59.255+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:23:59.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:59.255+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:23:59.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:59.255+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:23:59.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:59.255+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:23:59.638 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:23:59 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:23:59.255+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:24:00.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:00 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:00.069+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:00.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:00 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:00.069+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:00.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:00 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:00.069+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:00.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:00 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:00.069+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:00.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:00 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:00.069+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:00.509 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:00 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:00.069+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:00.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:00 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:00.168+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:00.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:00 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:00.168+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:00.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:00 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:00.168+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:00.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:00 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:00.168+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:00.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:00 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:00.168+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:00.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:00 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:00.168+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:00.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:24:00.235+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:47.786903+0000 front 2024-09-21T06:22:47.787053+0000 (oldest deadline 2024-09-21T06:23:12.486629+0000) 2024-09-21T06:24:00.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:24:00.235+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:52.487343+0000 front 2024-09-21T06:22:52.487098+0000 (oldest deadline 2024-09-21T06:23:18.387099+0000) 2024-09-21T06:24:00.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:24:00.235+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.088396+0000 front 2024-09-21T06:23:03.088505+0000 (oldest deadline 2024-09-21T06:23:24.788293+0000) 2024-09-21T06:24:00.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:24:00.235+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:09.989619+0000 front 2024-09-21T06:23:09.989670+0000 (oldest deadline 2024-09-21T06:23:34.089909+0000) 2024-09-21T06:24:00.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:24:00.235+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:19.391259+0000 front 2024-09-21T06:23:19.391119+0000 (oldest deadline 2024-09-21T06:23:45.291057+0000) 2024-09-21T06:24:00.637 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:00 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9[66513]: 2024-09-21T06:24:00.235+0000 7f576a1c4640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:25.291491+0000 front 2024-09-21T06:23:25.291567+0000 (oldest deadline 2024-09-21T06:23:51.191544+0000) 2024-09-21T06:24:01.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:01 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:01.075+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:01.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:01 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:01.075+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:01.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:01 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:01.075+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:01.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:01 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:01.075+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:01.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:01 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:01.075+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:01.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:01 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:01.075+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:01.518 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:01 smithi017 podman[168924]: 2024-09-21 06:24:01.227015759 +0000 UTC m=+5.642433428 container died 718ba0251aae6fbdadbb856f006464b21bb8b3a670fa6a0dd1171410238bec55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:01.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:01 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:01.212+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:01.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:01 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:01.212+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:01.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:01 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:01.212+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:01.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:01 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:01.212+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:01.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:01 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:01.212+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:01.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:01 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:01.212+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:01.859 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:01 smithi017 podman[168924]: 2024-09-21 06:24:01.66522994 +0000 UTC m=+6.080647650 container cleanup 718ba0251aae6fbdadbb856f006464b21bb8b3a670fa6a0dd1171410238bec55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:24:01.859 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:01 smithi017 bash[168924]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:24:02.137 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:01 smithi017 podman[168939]: 2024-09-21 06:24:01.857995129 +0000 UTC m=+0.629520406 container remove 718ba0251aae6fbdadbb856f006464b21bb8b3a670fa6a0dd1171410238bec55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:24:02.507 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:02.082+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:02.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:02.082+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:02.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:02.082+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:02.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:02.082+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:02.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:02.082+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:02.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:02 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:02.082+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:02.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:02.182+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:02.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:02.182+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:02.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:02.182+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:02.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:02.182+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:02.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:02.182+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:02.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:02.182+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:02.620 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:02 smithi017 podman[169026]: 2024-09-21 06:24:02.19722772 +0000 UTC m=+0.016000599 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:24:02.620 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:02 smithi017 podman[169026]: 2024-09-21 06:24:02.308807505 +0000 UTC m=+0.127580373 container create 85511cf19ef631370ba2bf9d581c21a564b9fff3f79c8be1028f115e5cd92263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T06:24:02.620 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:02 smithi017 podman[169026]: 2024-09-21 06:24:02.535892013 +0000 UTC m=+0.354664894 container init 85511cf19ef631370ba2bf9d581c21a564b9fff3f79c8be1028f115e5cd92263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T06:24:02.620 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:02 smithi017 podman[169026]: 2024-09-21 06:24:02.539486758 +0000 UTC m=+0.358259628 container start 85511cf19ef631370ba2bf9d581c21a564b9fff3f79c8be1028f115e5cd92263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T06:24:02.620 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:02 smithi017 podman[169026]: 2024-09-21 06:24:02.619129913 +0000 UTC m=+0.437902783 container attach 85511cf19ef631370ba2bf9d581c21a564b9fff3f79c8be1028f115e5cd92263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:24:02.887 INFO:journalctl@ceph.osd.9.smithi017.stdout:Sep 21 06:24:02 smithi017 podman[169026]: 2024-09-21 06:24:02.738167669 +0000 UTC m=+0.556940555 container died 85511cf19ef631370ba2bf9d581c21a564b9fff3f79c8be1028f115e5cd92263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:03.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.097+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:33.835607+0000 front 2024-09-21T06:23:33.835710+0000 (oldest deadline 2024-09-21T06:24:02.636038+0000) 2024-09-21T06:24:03.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:24:03.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:03.597 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:24:03.597 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:24:03.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:24:03.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:03 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:03.178+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:03.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:03 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:03.178+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:03.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:03 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:03.178+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:03.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:03 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:03.178+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:03.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:03 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:03.178+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:03.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:03 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:03.178+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:03.888 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 systemd[1]: Stopping Ceph osd.10 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.886+0000 7f7e5ecab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.886+0000 7f7e5ecab640 -1 osd.10 88 *** Got signal Terminated *** 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:03 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:03.886+0000 7f7e5ecab640 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:04.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:04.259 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:04 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:04.052+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:33.835607+0000 front 2024-09-21T06:23:33.835710+0000 (oldest deadline 2024-09-21T06:24:02.636038+0000) 2024-09-21T06:24:04.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:04.173+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:04.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:04.173+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:04.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:04.173+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:04.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:04.173+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:04.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:04.173+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:04.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:04 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:04.173+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:05.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:05 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:05.021+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:33.835607+0000 front 2024-09-21T06:23:33.835710+0000 (oldest deadline 2024-09-21T06:24:02.636038+0000) 2024-09-21T06:24:05.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:05 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:05.166+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:05.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:05 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:05.166+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:05.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:05 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:05.166+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:05.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:05 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:05.166+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:05.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:05 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:05.166+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:05.518 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:05 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:05.166+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:06.508 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.013+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:33.835607+0000 front 2024-09-21T06:23:33.835710+0000 (oldest deadline 2024-09-21T06:24:02.636038+0000) 2024-09-21T06:24:06.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:06.153+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:06.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:06.153+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:06.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:06.153+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:06.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:06.153+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:06.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:06.153+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:06.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:06.153+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:07.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:07.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:07.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:07.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:07.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:07.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:07.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:06 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:06.984+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:33.835607+0000 front 2024-09-21T06:23:33.835710+0000 (oldest deadline 2024-09-21T06:24:02.636038+0000) 2024-09-21T06:24:07.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:07 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:07.109+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:07.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:07 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:07.109+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:07.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:07 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:07.109+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:07.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:07 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:07.109+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:07.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:07 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:07.109+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:07.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:07 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:07.109+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:08.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:44.228197+0000 front 2024-09-21T06:22:44.228066+0000 (oldest deadline 2024-09-21T06:23:09.528020+0000) 2024-09-21T06:24:08.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6804 osd.1 since back 2024-09-21T06:22:54.829100+0000 front 2024-09-21T06:22:54.829045+0000 (oldest deadline 2024-09-21T06:23:20.129210+0000) 2024-09-21T06:24:08.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:03.030236+0000 front 2024-09-21T06:23:03.030260+0000 (oldest deadline 2024-09-21T06:23:28.330386+0000) 2024-09-21T06:24:08.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:11.831563+0000 front 2024-09-21T06:23:11.831465+0000 (oldest deadline 2024-09-21T06:23:34.131343+0000) 2024-09-21T06:24:08.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.732765+0000 front 2024-09-21T06:23:18.732829+0000 (oldest deadline 2024-09-21T06:23:41.533458+0000) 2024-09-21T06:24:08.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:27.935283+0000 front 2024-09-21T06:23:27.935179+0000 (oldest deadline 2024-09-21T06:23:53.835031+0000) 2024-09-21T06:24:08.258 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:07 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10[57019]: 2024-09-21T06:24:07.942+0000 7f7e5728e640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:33.835607+0000 front 2024-09-21T06:23:33.835710+0000 (oldest deadline 2024-09-21T06:24:02.636038+0000) 2024-09-21T06:24:08.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:08.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:08.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:08.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:08.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:08.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:08.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:08 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:08.064+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:09.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:09.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:09.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:09.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:09.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:09.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:09.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:09 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:09.052+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:09.589 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:09 smithi081 podman[66520]: 2024-09-21 06:24:09.315616643 +0000 UTC m=+5.529028878 container died 5099d99d369f312e2e68480abf8671b17392c1e26ff98a2ab8e3deaffd9ffe01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:09.964 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:09 smithi081 podman[66520]: 2024-09-21 06:24:09.711849946 +0000 UTC m=+5.925262180 container cleanup 5099d99d369f312e2e68480abf8671b17392c1e26ff98a2ab8e3deaffd9ffe01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:24:09.964 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:09 smithi081 bash[66520]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:24:10.257 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:09 smithi081 podman[66537]: 2024-09-21 06:24:09.963158048 +0000 UTC m=+0.639867362 container remove 5099d99d369f312e2e68480abf8671b17392c1e26ff98a2ab8e3deaffd9ffe01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T06:24:10.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:10.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:10.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:10.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:10.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:10.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:10.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:10 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:10.045+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:10.584 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:10 smithi081 podman[66625]: 2024-09-21 06:24:10.174298331 +0000 UTC m=+0.015550509 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:24:10.584 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:10 smithi081 podman[66625]: 2024-09-21 06:24:10.297448275 +0000 UTC m=+0.138700447 container create c149313129479058fe615db6d1adfff956fca8ca485bb4b17c3e9c4cfb14b8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:24:10.584 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:10 smithi081 podman[66625]: 2024-09-21 06:24:10.516955385 +0000 UTC m=+0.358207561 container init c149313129479058fe615db6d1adfff956fca8ca485bb4b17c3e9c4cfb14b8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:24:10.584 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:10 smithi081 podman[66625]: 2024-09-21 06:24:10.520402351 +0000 UTC m=+0.361654518 container start c149313129479058fe615db6d1adfff956fca8ca485bb4b17c3e9c4cfb14b8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:24:10.584 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:10 smithi081 podman[66625]: 2024-09-21 06:24:10.582925416 +0000 UTC m=+0.424177590 container attach c149313129479058fe615db6d1adfff956fca8ca485bb4b17c3e9c4cfb14b8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:24:11.007 INFO:journalctl@ceph.osd.10.smithi081.stdout:Sep 21 06:24:10 smithi081 podman[66625]: 2024-09-21 06:24:10.719334609 +0000 UTC m=+0.560586776 container died c149313129479058fe615db6d1adfff956fca8ca485bb4b17c3e9c4cfb14b8d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T06:24:11.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:24:11.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:11.347 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:24:11.348 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:24:11.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:24:11.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:11.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:11.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:11.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:11.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:11.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:11.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.051+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:11.670 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 systemd[1]: Stopping Ceph osd.11 for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:12.056 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.668+0000 7f200f2a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:12.056 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.668+0000 7f200f2a3640 -1 osd.11 88 *** Got signal Terminated *** 2024-09-21T06:24:12.056 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:11 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:11.668+0000 7f200f2a3640 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:24:12.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:12.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:12.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:12.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:12.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:12.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:12.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:12 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:12.055+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:13.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:13.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:13.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:13.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:13.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:13.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:13.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:13 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:13.086+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:14.366 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:14.367 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:14 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:14.104+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6820 osd.8 since back 2024-09-21T06:23:51.470583+0000 front 2024-09-21T06:23:51.470618+0000 (oldest deadline 2024-09-21T06:24:13.770580+0000) 2024-09-21T06:24:15.567 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:15.568 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:15 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:15.133+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6820 osd.8 since back 2024-09-21T06:23:51.470583+0000 front 2024-09-21T06:23:51.470618+0000 (oldest deadline 2024-09-21T06:24:13.770580+0000) 2024-09-21T06:24:16.616 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-21T06:22:46.959706+0000 front 2024-09-21T06:22:46.959753+0000 (oldest deadline 2024-09-21T06:23:10.459659+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6804 osd.2 since back 2024-09-21T06:23:02.062251+0000 front 2024-09-21T06:23:02.062213+0000 (oldest deadline 2024-09-21T06:23:26.762371+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2024-09-21T06:23:08.463483+0000 front 2024-09-21T06:23:08.463415+0000 (oldest deadline 2024-09-21T06:23:37.863803+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6812 osd.4 since back 2024-09-21T06:23:18.365026+0000 front 2024-09-21T06:23:18.364885+0000 (oldest deadline 2024-09-21T06:23:41.864985+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6812 osd.5 since back 2024-09-21T06:23:28.667480+0000 front 2024-09-21T06:23:28.667557+0000 (oldest deadline 2024-09-21T06:23:52.167569+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2024-09-21T06:23:32.168326+0000 front 2024-09-21T06:23:32.168277+0000 (oldest deadline 2024-09-21T06:23:59.768732+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.81:6820 osd.7 since back 2024-09-21T06:23:39.769261+0000 front 2024-09-21T06:23:39.769199+0000 (oldest deadline 2024-09-21T06:24:07.369665+0000) 2024-09-21T06:24:16.617 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:16 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11[57321]: 2024-09-21T06:24:16.116+0000 7f2007886640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.89:6820 osd.8 since back 2024-09-21T06:23:51.470583+0000 front 2024-09-21T06:23:51.470618+0000 (oldest deadline 2024-09-21T06:24:13.770580+0000) 2024-09-21T06:24:17.422 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:17 smithi089 podman[67042]: 2024-09-21 06:24:17.154236446 +0000 UTC m=+5.610030931 container died d377361e8c2048c4310072374b1ddcb97d725396bbe6ecc29209ee039c690451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:24:17.771 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:17 smithi089 podman[67042]: 2024-09-21 06:24:17.510807436 +0000 UTC m=+5.966601917 container cleanup d377361e8c2048c4310072374b1ddcb97d725396bbe6ecc29209ee039c690451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:24:17.771 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:17 smithi089 bash[67042]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:24:18.116 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:17 smithi089 podman[67058]: 2024-09-21 06:24:17.770337429 +0000 UTC m=+0.616930618 container remove d377361e8c2048c4310072374b1ddcb97d725396bbe6ecc29209ee039c690451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:24:18.391 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:18 smithi089 podman[67146]: 2024-09-21 06:24:18.12930716 +0000 UTC m=+0.110299310 container create 204333d6b8d26b29aeeac7c8167450d087238d6ab22e4372f7af73a0675a15e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T06:24:18.391 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:18 smithi089 podman[67146]: 2024-09-21 06:24:18.03457066 +0000 UTC m=+0.015562818 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:24:18.391 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:18 smithi089 podman[67146]: 2024-09-21 06:24:18.390028723 +0000 UTC m=+0.371020880 container init 204333d6b8d26b29aeeac7c8167450d087238d6ab22e4372f7af73a0675a15e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:24:18.862 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:18 smithi089 podman[67146]: 2024-09-21 06:24:18.393351872 +0000 UTC m=+0.374344020 container start 204333d6b8d26b29aeeac7c8167450d087238d6ab22e4372f7af73a0675a15e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:18.862 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:18 smithi089 podman[67146]: 2024-09-21 06:24:18.481597186 +0000 UTC m=+0.462589336 container attach 204333d6b8d26b29aeeac7c8167450d087238d6ab22e4372f7af73a0675a15e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:24:18.862 INFO:journalctl@ceph.osd.11.smithi089.stdout:Sep 21 06:24:18 smithi089 podman[67146]: 2024-09-21 06:24:18.57604193 +0000 UTC m=+0.557034078 container died 204333d6b8d26b29aeeac7c8167450d087238d6ab22e4372f7af73a0675a15e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T06:24:19.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:24:19.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:19.262 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:24:19.263 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:24:19.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:24:19.576 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:19 smithi017 systemd[1]: Stopping Ceph mds.a for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:19.846 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:19 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a[72932]: 2024-09-21T06:24:19.574+0000 7fcc29ffb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:19.846 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:19 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a[72932]: 2024-09-21T06:24:19.574+0000 7fcc29ffb640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:24:23.887 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:23 smithi017 podman[169129]: 2024-09-21 06:24:23.584436398 +0000 UTC m=+4.124808296 container died 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:24:24.318 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:24 smithi017 podman[169129]: 2024-09-21 06:24:24.123964291 +0000 UTC m=+4.664336228 container cleanup 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:24:24.318 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:24 smithi017 bash[169129]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:24:24.569 INFO:journalctl@ceph.mds.a.smithi017.stdout:Sep 21 06:24:24 smithi017 podman[169153]: 2024-09-21 06:24:24.316873523 +0000 UTC m=+0.726919809 container remove 9e67ea141299015cef9d65684d681bc38046829cf90e7bad238f3884be1dfc6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T06:24:24.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:24:24.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:24.614 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:24:24.614 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:24:24.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:24:24.887 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:24:24 smithi017 systemd[1]: Stopping Ceph mds.d for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:25.387 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:24:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d[71809]: 2024-09-21T06:24:24.927+0000 7fd4bc479640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:25.387 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:24:24 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d[71809]: 2024-09-21T06:24:24.927+0000 7fd4bc479640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:24:28.887 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:24:28 smithi017 podman[169263]: 2024-09-21 06:24:28.581903031 +0000 UTC m=+3.748864045 container died 4e44f0cdd5d8ea7dc149cdaf81ba9f4fc92207d541cecfdfdda6480cec39d4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:28.887 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:24:28 smithi017 podman[169263]: 2024-09-21 06:24:28.88595015 +0000 UTC m=+4.052911154 container cleanup 4e44f0cdd5d8ea7dc149cdaf81ba9f4fc92207d541cecfdfdda6480cec39d4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:24:29.137 INFO:journalctl@ceph.mds.d.smithi017.stdout:Sep 21 06:24:28 smithi017 bash[169263]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:24:29.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:29.391 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:24:29.391 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:24:29.391 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:24:29.637 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:24:29 smithi017 systemd[1]: Stopping Ceph mds.g for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:30.137 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:24:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g[72580]: 2024-09-21T06:24:29.748+0000 7fe17cb94640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:30.137 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:24:29 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g[72580]: 2024-09-21T06:24:29.748+0000 7fe17cb94640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:24:32.733 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:24:32 smithi017 podman[169383]: 2024-09-21 06:24:32.446187357 +0000 UTC m=+2.834637533 container died 12434fbd55d0a11ae776f96990bc84815fd1a65d89a3824b6f4d8718aa2837f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:24:33.124 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:24:32 smithi017 podman[169383]: 2024-09-21 06:24:32.830950377 +0000 UTC m=+3.219400556 container cleanup 12434fbd55d0a11ae776f96990bc84815fd1a65d89a3824b6f4d8718aa2837f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:33.124 INFO:journalctl@ceph.mds.g.smithi017.stdout:Sep 21 06:24:32 smithi017 bash[169383]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:24:33.253 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:24:33.287 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:33.287 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:24:33.287 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:24:33.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:24:33.387 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:24:33 smithi017 systemd[1]: Stopping Ceph mds.j for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:33.887 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:24:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j[71440]: 2024-09-21T06:24:33.617+0000 7fa151d11640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:33.887 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:24:33 smithi017 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j[71440]: 2024-09-21T06:24:33.617+0000 7fa151d11640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:24:37.277 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:24:37 smithi017 podman[169503]: 2024-09-21 06:24:37.014938113 +0000 UTC m=+3.507059594 container died da7564de0be741302203e84fe0c3ae48e77f94e7238eda953358d5b77bee730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:24:37.628 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:24:37 smithi017 podman[169503]: 2024-09-21 06:24:37.376089256 +0000 UTC m=+3.868210725 container cleanup da7564de0be741302203e84fe0c3ae48e77f94e7238eda953358d5b77bee730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:24:37.628 INFO:journalctl@ceph.mds.j.smithi017.stdout:Sep 21 06:24:37 smithi017 bash[169503]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:24:37.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:24:37.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:37.788 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:24:37.788 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:24:37.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:24:38.106 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:24:37 smithi081 systemd[1]: Stopping Ceph mds.b for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:38.507 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:24:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: 2024-09-21T06:24:38.104+0000 7f9d6086f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:38.507 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:24:38 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b[61882]: 2024-09-21T06:24:38.104+0000 7f9d6086f640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:24:41.156 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:24:40 smithi081 podman[66741]: 2024-09-21 06:24:40.882070627 +0000 UTC m=+2.879326469 container died 680df72977827e1a98454c75d85553f4d1aa1b74060cc4e1e2d39b8362fe98a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T06:24:41.507 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:24:41 smithi081 podman[66741]: 2024-09-21 06:24:41.254190545 +0000 UTC m=+3.251446430 container cleanup 680df72977827e1a98454c75d85553f4d1aa1b74060cc4e1e2d39b8362fe98a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:24:41.508 INFO:journalctl@ceph.mds.b.smithi081.stdout:Sep 21 06:24:41 smithi081 bash[66741]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:24:41.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:24:41.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:41.717 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:24:41.717 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:24:41.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:24:42.035 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:24:41 smithi081 systemd[1]: Stopping Ceph mds.e for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:42.507 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:24:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e[61327]: 2024-09-21T06:24:42.033+0000 7f8f515a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:42.508 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:24:42 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e[61327]: 2024-09-21T06:24:42.033+0000 7f8f515a2640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:24:45.257 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:24:44 smithi081 podman[66862]: 2024-09-21 06:24:44.883055499 +0000 UTC m=+2.954327245 container died 97a6e2837c7195944204a5bbb5d757a14d487dc259cd93de51fd82c1a4d8a681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:24:45.619 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:24:45 smithi081 podman[66862]: 2024-09-21 06:24:45.350510556 +0000 UTC m=+3.421782301 container cleanup 97a6e2837c7195944204a5bbb5d757a14d487dc259cd93de51fd82c1a4d8a681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:24:45.619 INFO:journalctl@ceph.mds.e.smithi081.stdout:Sep 21 06:24:45 smithi081 bash[66862]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:24:45.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:24:45.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:45.809 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:24:45.809 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:24:45.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:24:46.122 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:45 smithi081 systemd[1]: Stopping Ceph mds.h for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:46.507 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h[61596]: 2024-09-21T06:24:46.120+0000 7fc43b9e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:46.507 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:46 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h[61596]: 2024-09-21T06:24:46.120+0000 7fc43b9e7640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:24:49.205 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:48 smithi081 podman[66997]: 2024-09-21 06:24:48.880035267 +0000 UTC m=+2.855006950 container died f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:24:49.205 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:49 smithi081 podman[66997]: 2024-09-21 06:24:49.204046513 +0000 UTC m=+3.179018185 container cleanup f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:24:49.507 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:49 smithi081 bash[66997]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:24:49.507 INFO:journalctl@ceph.mds.h.smithi081.stdout:Sep 21 06:24:49 smithi081 podman[67009]: 2024-09-21 06:24:49.380559249 +0000 UTC m=+0.502016758 container remove f5ebbcbbbbece2fd53f699de8c19c32a8ce2f9e6b53c16da52a487475acfb69b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-h, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T06:24:49.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:24:49.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:49.668 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:24:49.668 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:24:49.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:24:50.010 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:24:49 smithi081 systemd[1]: Stopping Ceph mds.k for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:50.507 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:24:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k[61045]: 2024-09-21T06:24:50.007+0000 7f8a95027640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:50.508 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:24:50 smithi081 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k[61045]: 2024-09-21T06:24:50.007+0000 7f8a95027640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:24:54.194 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:24:53 smithi081 podman[67121]: 2024-09-21 06:24:53.776046919 +0000 UTC m=+3.896712954 container died d6924a8e2637c99e56ed77340668dac22e35a99b312250d971da099c98bacedf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:24:54.493 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:24:54 smithi081 podman[67121]: 2024-09-21 06:24:54.266357163 +0000 UTC m=+4.387023198 container cleanup d6924a8e2637c99e56ed77340668dac22e35a99b312250d971da099c98bacedf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T06:24:54.493 INFO:journalctl@ceph.mds.k.smithi081.stdout:Sep 21 06:24:54 smithi081 bash[67121]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:24:54.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:24:54.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:54.672 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:24:54.672 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:24:54.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:24:54.986 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:54 smithi089 systemd[1]: Stopping Ceph mds.c for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:55.243 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c[62381]: 2024-09-21T06:24:54.984+0000 7f93e8e44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:55.243 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:54 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c[62381]: 2024-09-21T06:24:54.984+0000 7f93e8e44640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:24:57.136 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:56 smithi089 podman[67249]: 2024-09-21 06:24:56.868456055 +0000 UTC m=+1.987570319 container died 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:24:57.403 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:57 smithi089 podman[67249]: 2024-09-21 06:24:57.209086049 +0000 UTC m=+2.328200313 container cleanup 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:24:57.403 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:57 smithi089 bash[67249]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:24:57.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:24:57.662 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:57 smithi089 podman[67271]: 2024-09-21 06:24:57.402128842 +0000 UTC m=+0.527852498 container remove 41bf22f8a63966480ca0bc8e6126d0f0a0999ff38d42878196032224bae5d262 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:24:57.662 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:57 smithi089 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.c.service: Deactivated successfully. 2024-09-21T06:24:57.662 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:57 smithi089 systemd[1]: Stopped Ceph mds.c for dc6785ee-77de-11ef-baf5-efdc52797490. 2024-09-21T06:24:57.663 INFO:journalctl@ceph.mds.c.smithi089.stdout:Sep 21 06:24:57 smithi089 systemd[1]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.c.service: Consumed 1min 57.493s CPU time. 2024-09-21T06:24:57.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:24:57.676 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:24:57.676 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:24:57.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:24:58.026 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:24:57 smithi089 systemd[1]: Stopping Ceph mds.f for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:24:58.367 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:24:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f[62110]: 2024-09-21T06:24:58.024+0000 7f57f68c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:24:58.367 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:24:58 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f[62110]: 2024-09-21T06:24:58.024+0000 7f57f68c6640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:25:01.157 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:25:00 smithi089 podman[67380]: 2024-09-21 06:25:00.872960988 +0000 UTC m=+2.982271458 container died c689eb1a1d81ad8aff2b956cbfde15b4c8897204bed24eab5fe414551a37d5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:25:01.498 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:25:01 smithi089 podman[67380]: 2024-09-21 06:25:01.238254152 +0000 UTC m=+3.347564610 container cleanup c689eb1a1d81ad8aff2b956cbfde15b4c8897204bed24eab5fe414551a37d5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:25:01.499 INFO:journalctl@ceph.mds.f.smithi089.stdout:Sep 21 06:25:01 smithi089 bash[67380]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:25:01.675 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:25:01.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:25:01.708 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:25:01.708 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:25:01.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:25:02.027 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:25:01 smithi089 systemd[1]: Stopping Ceph mds.i for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:25:02.366 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:25:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i[62652]: 2024-09-21T06:25:02.024+0000 7f6edc693640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:25:02.366 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:25:02 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i[62652]: 2024-09-21T06:25:02.024+0000 7f6edc693640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:25:05.145 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:25:04 smithi089 podman[67500]: 2024-09-21 06:25:04.866190601 +0000 UTC m=+2.945094120 container died 7ce077b0c2ebb8a8473480c72d176a38e8ef6f7070dec0d17b4e1bfc71654f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T06:25:05.496 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:25:05 smithi089 podman[67500]: 2024-09-21 06:25:05.275538776 +0000 UTC m=+3.354442287 container cleanup 7ce077b0c2ebb8a8473480c72d176a38e8ef6f7070dec0d17b4e1bfc71654f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T06:25:05.496 INFO:journalctl@ceph.mds.i.smithi089.stdout:Sep 21 06:25:05 smithi089 bash[67500]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:25:05.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:25:05.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:25:05.689 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:25:05.689 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:25:05.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:25:06.005 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:05 smithi089 systemd[1]: Stopping Ceph mds.l for dc6785ee-77de-11ef-baf5-efdc52797490... 2024-09-21T06:25:06.366 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l[61841]: 2024-09-21T06:25:06.003+0000 7f2197831640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:25:06.366 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:06 smithi089 ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l[61841]: 2024-09-21T06:25:06.003+0000 7f2197831640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:25:07.439 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:07 smithi089 podman[67620]: 2024-09-21 06:25:07.150878464 +0000 UTC m=+1.241781623 container stop f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T06:25:07.439 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:07 smithi089 podman[67620]: 2024-09-21 06:25:07.176551609 +0000 UTC m=+1.267454779 container died f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T06:25:07.689 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:07 smithi089 podman[67620]: 2024-09-21 06:25:07.512750922 +0000 UTC m=+1.603654083 container cleanup f4960c5001de3904d83ef42f51bf338323d739b0b55eb3510750f629781c95ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:25:07.690 INFO:journalctl@ceph.mds.l.smithi089.stdout:Sep 21 06:25:07 smithi089 bash[67620]: ceph-dc6785ee-77de-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:25:07.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-dc6785ee-77de-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:25:07.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:25:07.924 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:25:07.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:25:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:25:10.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:25:10.961 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:25:13.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:25:13.564 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:25:15.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:25:15.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:25:16.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:25:16.034 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:25:16.037 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi017/crash 2024-09-21T06:25:16.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:25:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:25:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:25:16.070 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi081/crash 2024-09-21T06:25:16.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:25:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:25:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:25:16.149 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi089/crash 2024-09-21T06:25:16.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:25:16.181 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:25:16.181 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:25:16.182 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:25:16.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T06:25:16.239 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:25:16.239 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:25:16.241 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:25:16.244 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:25:16.266 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T06:25:16.266 INFO:teuthology.orchestra.run.smithi017.stderr:: No such file or directory 2024-09-21T06:25:16.266 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:25:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:25:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:25:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.a.log: 82.4% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:25:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:25:16.272 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:: No such file or directory 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr: 82.4% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.2.log: --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:25:16.273 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log: 90.3% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:25:16.275 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:25:16.275 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.g.log: /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:25:16.275 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:25:16.277 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:25:16.277 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:25:16.277 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:25:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T06:25:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:25:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:25:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:25:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:25:16.278 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:25:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:25:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:25:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:25:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:25:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:25:16.281 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log: 95.1% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:25:16.281 INFO:teuthology.orchestra.run.smithi017.stderr: 86.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:25:16.281 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:25:16.281 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:25:16.281 INFO:teuthology.orchestra.run.smithi017.stderr: 95.0%/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.x.log: -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:25:16.284 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.8.log: 94.9% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:25:16.284 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:25:16.284 INFO:teuthology.orchestra.run.smithi089.stderr: 90.8% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:25:16.285 INFO:teuthology.orchestra.run.smithi081.stderr: 94.9% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:25:16.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:25:16.285 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:25:16.286 INFO:teuthology.orchestra.run.smithi081.stderr: 82.5% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:25:16.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:25:16.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log: 86.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:25:16.286 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:25:16.287 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:25:16.288 INFO:teuthology.orchestra.run.smithi017.stderr: 95.1% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:25:16.288 INFO:teuthology.orchestra.run.smithi017.stderr: 90.9% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:25:16.288 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:25:16.288 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T06:25:16.288 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:25:16.289 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:25:16.289 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:25:16.289 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:25:16.290 INFO:teuthology.orchestra.run.smithi081.stderr: 92.4% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:25:16.291 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.log: 95.2% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:25:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:25:16.298 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:25:16.299 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/cephadm.log: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:25:16.309 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:25:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:25:16.550 INFO:teuthology.orchestra.run.smithi017.stderr: 90.4% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:25:16.647 INFO:teuthology.orchestra.run.smithi089.stderr: 91.8% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:25:16.673 INFO:teuthology.orchestra.run.smithi081.stderr: 91.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:25:17.078 INFO:teuthology.orchestra.run.smithi017.stderr: 90.5% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:25:18.075 INFO:teuthology.orchestra.run.smithi081.stderr: 94.3% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:25:18.482 INFO:teuthology.orchestra.run.smithi089.stderr: 94.5% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:25:20.893 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:25:21.898 INFO:teuthology.orchestra.run.smithi081.stderr: 91.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:25:22.308 INFO:teuthology.orchestra.run.smithi017.stderr: 91.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:25:22.357 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:25:22.829 INFO:teuthology.orchestra.run.smithi089.stderr: 91.1% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:25:23.496 INFO:teuthology.orchestra.run.smithi081.stderr: 91.7% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:25:24.022 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:25:24.650 INFO:teuthology.orchestra.run.smithi089.stderr: 91.4% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:25:25.753 INFO:teuthology.orchestra.run.smithi081.stderr: 91.5% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:25:25.989 INFO:teuthology.orchestra.run.smithi017.stderr: 91.5% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:25:26.054 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:25:26.209 INFO:teuthology.orchestra.run.smithi081.stderr: 91.3% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:25:26.781 INFO:teuthology.orchestra.run.smithi089.stderr: 91.2% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:25:50.207 INFO:teuthology.orchestra.run.smithi081.stderr: 94.3% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:25:50.209 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:25:50.209 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m33.950s 2024-09-21T06:25:50.209 INFO:teuthology.orchestra.run.smithi081.stderr:user 1m10.625s 2024-09-21T06:25:50.209 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m2.256s 2024-09-21T06:25:52.206 INFO:teuthology.orchestra.run.smithi089.stderr: 94.3% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:26:49.217 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/dc6785ee-77de-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:26:49.218 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-21T06:26:49.219 INFO:teuthology.orchestra.run.smithi089.stderr:real 1m32.960s 2024-09-21T06:26:49.219 INFO:teuthology.orchestra.run.smithi089.stderr:user 2m37.679s 2024-09-21T06:26:49.219 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m4.932s 2024-09-21T06:27:02.895 INFO:teuthology.orchestra.run.smithi017.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T06:27:02.897 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-21T06:27:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:real 1m46.642s 2024-09-21T06:27:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:user 2m16.870s 2024-09-21T06:27:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m3.864s 2024-09-21T06:27:02.898 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:27:02.898 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi017/log 2024-09-21T06:27:02.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:27:23.209 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi081/log 2024-09-21T06:27:23.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:27:32.494 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi089/log 2024-09-21T06:27:32.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:27:53.985 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:27:53.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --force 2024-09-21T06:27:54.201 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:27:54.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --force 2024-09-21T06:27:54.710 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:27:55.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid dc6785ee-77de-11ef-baf5-efdc52797490 --force 2024-09-21T06:27:55.247 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: dc6785ee-77de-11ef-baf5-efdc52797490 2024-09-21T06:27:55.675 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:27:55.676 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:27:55.696 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:27:55.714 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:27:55.729 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:27:55.730 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:27:55.740 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:27:55.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:27:55.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:27:55.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:27:55.883 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:27:55.904 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:27:55.905 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:27:55.908 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:27:55.911 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:27:55.924 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:27:55.924 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:27:55.925 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:27:55.928 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:27:55.928 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-21T06:27:55.928 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 -83us[ -59us] +/- 46ms 2024-09-21T06:27:55.928 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +304us[ +304us] +/- 73ms 2024-09-21T06:27:55.929 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -56us[ -33us] +/- 77ms 2024-09-21T06:27:55.929 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:27:55.932 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:27:55.932 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-21T06:27:55.932 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 -110us[ -102us] +/- 46ms 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +290us[ +299us] +/- 73ms 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -55us[ -55us] +/- 77ms 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 -106us[ -103us] +/- 46ms 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 +288us[ +288us] +/- 73ms 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -78us[ -78us] +/- 77ms 2024-09-21T06:27:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:27:55.934 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:27:55.946 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:27:55.947 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:27:55.965 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:27:56.059 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:27:56.130 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:27:56.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:27:56.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:27:56.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:27:56.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:27:56.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:27:56.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:27:56.284 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:27:56.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:27:56.305 INFO:teuthology.task.internal:Duration was 1963.248199 seconds 2024-09-21T06:27:56.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:27:56.315 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:27:56.315 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:27:56.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:27:56.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:27:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:27:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:27:56.363 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:27:56.796 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:27:56.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-21T06:27:56.796 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:27:56.819 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:27:56.819 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:27:56.858 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:27:56.859 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:27:56.888 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:27:56.888 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:27:56.891 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:27:56.901 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:27:56.955 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:27:56.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:27:56.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:27:56.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:27:57.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:27:57.676 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:27:57.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:27:57.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:27:57.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:27:57.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:27:57.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:27:57.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:27:57.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:27:57.788 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-21T06:27:57.792 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-21T06:27:57.818 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-21T06:27:57.849 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:27:57.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:27:57.864 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:27:57.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:27:57.879 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:27:57.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:27:57.904 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:27:57.915 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:27:57.916 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi017 2024-09-21T06:27:57.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:27:57.968 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi081 2024-09-21T06:27:57.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:27:58.004 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913521/remote/smithi089 2024-09-21T06:27:58.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:27:58.039 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:27:58.040 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:27:58.042 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:27:58.044 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:27:58.090 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:27:58.103 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:27:58.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:27:58.113 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:27:58.114 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:27:58.116 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:27:58.118 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:27:58.129 INFO:teuthology.orchestra.run.smithi017.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:27 /home/ubuntu/cephtest 2024-09-21T06:27:58.132 INFO:teuthology.orchestra.run.smithi081.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:27 /home/ubuntu/cephtest 2024-09-21T06:27:58.146 INFO:teuthology.orchestra.run.smithi089.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:27 /home/ubuntu/cephtest 2024-09-21T06:27:58.147 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:27:58.158 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:27:58.182 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} duration: 1963.2481994628906 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:27:58.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:27:58.284 INFO:teuthology.run:pass